OpenVINO/phi-2-fp16-ov
Text Generation • Updated • 84 • 1
LLM
Collection of OpenVINO optimized LLMs
-
-
OpenVINO/phi-2-int8-ov
Text Generation • Updated • 41 -
OpenVINO/mistral-7b-instruct-v0.1-int8-ov
Text Generation • Updated • 48 • 1 -
OpenVINO/mistral-7b-instruct-v0.1-fp16-ov
Text Generation • Updated • 9 -
OpenVINO/mistral-7b-instruct-v0.1-int4-ov
Text Generation • Updated • 13 -
OpenVINO/codegen25-7b-multi-fp16-ov
Text Generation • Updated • 11 -
OpenVINO/mixtral-8x7b-instruct-v0.1-int4-ov
Text Generation • Updated • 14 • 4 -
OpenVINO/Mixtral-8x7B-Instruct-v0.1-int8-ov
Text Generation • Updated • 15 • 4 -
OpenVINO/neural-chat-7b-v3-3-fp16-ov
Text Generation • Updated • 4 -
OpenVINO/neural-chat-7b-v3-3-int8-ov
Text Generation • Updated • 5 • 1 -
OpenVINO/zephyr-7b-beta-int8-ov
Text Generation • Updated • 5 -
OpenVINO/zephyr-7b-beta-int4-ov
Text Generation • Updated • 7 -
OpenVINO/dolly-v2-3b-int4-ov
Text Generation • Updated • 5 -
OpenVINO/dolly-v2-3b-int8-ov
Text Generation • Updated • 3 -
OpenVINO/dolly-v2-3b-fp16-ov
Text Generation • Updated • 3 -
OpenVINO/zephyr-7b-beta-fp16-ov
Text Generation • Updated • 2 -
OpenVINO/TinyLlama-1.1B-Chat-v1.0-fp16-ov
Text Generation • Updated • 51 • 2 -
OpenVINO/TinyLlama-1.1B-Chat-v1.0-int4-ov
Text Generation • Updated • 534 • 1 -
OpenVINO/TinyLlama-1.1B-Chat-v1.0-int8-ov
Text Generation • Updated • 1.19k • 1 -
OpenVINO/gpt-neox-20b-int8-ov
Text Generation • Updated • 2 -
OpenVINO/gpt-neox-20b-fp16-ov
Text Generation • Updated • 2 -
OpenVINO/gpt-j-6b-int4-ov
Text Generation • Updated • 11 -
OpenVINO/gpt-j-6b-int8-ov
Text Generation • Updated • 4 -
OpenVINO/gpt-j-6b-fp16-ov
Text Generation • Updated -
OpenVINO/falcon-7b-instruct-int4-ov
Text Generation • Updated • 9 -
OpenVINO/falcon-7b-instruct-fp16-ov
Text Generation • Updated • 4 -
OpenVINO/falcon-7b-instruct-int8-ov
Text Generation • Updated • 6 -
OpenVINO/phi-2-int4-ov
Text Generation • Updated • 37 • 1 -
OpenVINO/neural-chat-7b-v3-3-int4-ov
Text Generation • Updated • 6 • 1 -
OpenVINO/RedPajama-INCITE-Chat-3B-v1-int8-ov
Text Generation • Updated • 1 -
OpenVINO/RedPajama-INCITE-Chat-3B-v1-int4-ov
Text Generation • Updated • 1 -
OpenVINO/RedPajama-INCITE-Chat-3B-v1-fp16-ov
Text Generation • Updated -
OpenVINO/dolly-v2-7b-fp16-ov
Text Generation • Updated • 4 -
OpenVINO/Mistral-7B-Instruct-v0.2-int8-ov
Text Generation • Updated • 4 • 1 -
OpenVINO/dolly-v2-12b-int8-ov
Text Generation • Updated • 3 -
OpenVINO/Mistral-7B-Instruct-v0.2-int4-ov
Text Generation • Updated • 284 • 1 -
OpenVINO/Mistral-7B-Instruct-v0.2-fp16-ov
Text Generation • Updated • 2 -
OpenVINO/persimmon-8b-chat-int4-ov
Text Generation • Updated • 2 -
OpenVINO/persimmon-8b-chat-int8-ov
Text Generation • Updated • 16 -
OpenVINO/persimmon-8b-chat-fp16-ov
Text Generation • Updated • 3 -
OpenVINO/pythia-12b-int8-ov
Text Generation • Updated • 3 -
OpenVINO/pythia-12b-fp16-ov
Text Generation • Updated • 1 -
OpenVINO/pythia-6.9b-int4-ov
Text Generation • Updated • 4 -
OpenVINO/pythia-6.9b-int8-ov
Text Generation • Updated • 4 -
OpenVINO/pythia-6.9b-fp16-ov
Text Generation • Updated • 5 -
OpenVINO/pythia-1b-int4-ov
Text Generation • Updated • 2 -
OpenVINO/Phi-3-medium-4k-instruct-fp16-ov
Text Generation • Updated • 5 -
OpenVINO/Phi-3-medium-4k-instruct-int4-ov
Text Generation • Updated • 20 • 3 -
OpenVINO/Phi-3-medium-4k-instruct-int8-ov
Text Generation • Updated • 19 -
OpenVINO/starcoder2-15b-int8-ov
Text Generation • Updated • 2 -
OpenVINO/starcoder2-15b-int4-ov
Text Generation • Updated • 3 -
OpenVINO/starcoder2-15b-fp16-ov
Text Generation • Updated -
OpenVINO/starcoder2-7b-fp16-ov
Text Generation • Updated • 4 -
OpenVINO/starcoder2-7b-int4-ov
Text Generation • Updated • 3 -
OpenVINO/starcoder2-7b-int8-ov
Text Generation • Updated • 3 -
OpenVINO/Phi-3-mini-4k-instruct-fp16-ov
Text Generation • Updated • 5 • 3 -
OpenVINO/Phi-3-mini-128k-instruct-fp16-ov
Text Generation • Updated • 8 -
OpenVINO/Phi-3-mini-128k-instruct-int4-ov
Text Generation • Updated • 12 • 2 -
OpenVINO/Phi-3-mini-4k-instruct-int4-ov
Text Generation • Updated • 4.54k • 3 -
OpenVINO/Phi-3-mini-4k-instruct-int8-ov
Text Generation • Updated • 6 -
OpenVINO/Phi-3-mini-128k-instruct-int8-ov
Text Generation • Updated • 9 • 5 -
OpenVINO/RedPajama-INCITE-Instruct-3B-v1-fp16-ov
Updated • 2 -
OpenVINO/RedPajama-INCITE-Instruct-3B-v1-int4-ov
Updated • 1 -
OpenVINO/RedPajama-INCITE-Instruct-3B-v1-int8-ov
Updated -
OpenVINO/gemma-2b-it-fp16-ov
Updated • 5 -
OpenVINO/gemma-2b-it-int8-ov
Updated • 4 -
OpenVINO/gemma-2b-it-int4-ov
Updated • 118 -
OpenVINO/gemma-7b-fp16-ov
Updated • 3 -
OpenVINO/gemma-7b-int4-ov
Updated • 5 • 1 -
OpenVINO/gemma-7b-int8-ov
Updated • 1 -
OpenVINO/gemma-7b-it-int8-ov
Updated • 3 -
OpenVINO/gemma-7b-it-fp16-ov
Updated • 1 -
OpenVINO/gemma-7b-it-int4-ov
Updated • 1 -
OpenVINO/codegen-6B-multi-int4-ov
Updated • 6 -
OpenVINO/codegen-6B-multi-fp16-ov
Updated • 4 -
OpenVINO/codegen-6B-multi-int8-ov
Updated • 3 -
OpenVINO/Phi-3.5-mini-instruct-fp16-ov
Updated • 3 -
OpenVINO/Phi-3.5-mini-instruct-int8-ov
Updated • 8 -
OpenVINO/Phi-3.5-mini-instruct-int4-ov
Updated • 763 • 7 -
OpenVINO/gemma-2-9b-it-int4-ov
Updated • 68 -
OpenVINO/gemma-2-9b-it-int8-ov
Updated • 14 -
OpenVINO/gemma-2-9b-it-fp16-ov
Updated • 1 -
OpenVINO/DeepSeek-R1-Distill-Qwen-1.5B-fp16-ov
Updated • 8 -
OpenVINO/DeepSeek-R1-Distill-Qwen-1.5B-int8-ov
Updated • 13 -
OpenVINO/DeepSeek-R1-Distill-Qwen-1.5B-int4-ov
Updated • 1.42k • 1 -
OpenVINO/DeepSeek-R1-Distill-Qwen-7B-int4-ov
Updated • 544 • 1 -
OpenVINO/DeepSeek-R1-Distill-Qwen-7B-int8-ov
Updated • 7 -
OpenVINO/DeepSeek-R1-Distill-Qwen-7B-fp16-ov
Updated • 10 -
OpenVINO/DeepSeek-R1-Distill-Qwen-14B-fp16-ov
Updated • 11 • 1 -
OpenVINO/DeepSeek-R1-Distill-Qwen-14B-int8-ov
Updated • 12 • 1 -
OpenVINO/DeepSeek-R1-Distill-Qwen-14B-int4-ov
Updated • 45 -
OpenVINO/Qwen2.5-1.5B-Instruct-fp16-ov
Updated • 163 -
OpenVINO/Qwen2.5-1.5B-Instruct-int4-ov
Updated • 1.1k • 1 -
OpenVINO/Qwen2.5-1.5B-Instruct-int8-ov
Updated • 36 -
OpenVINO/Qwen2.5-14B-Instruct-int4-ov
Updated • 222 -
OpenVINO/Qwen2.5-14B-Instruct-int8-ov
Updated • 3 -
OpenVINO/Qwen2.5-14B-Instruct-fp16-ov
Updated • 4 • 1 -
OpenVINO/Qwen2.5-7B-Instruct-fp16-ov
Updated • 2 -
OpenVINO/Qwen2.5-7B-Instruct-int8-ov
Updated • 148 -
OpenVINO/Qwen2.5-7B-Instruct-int4-ov
Updated • 886 • 3 -
OpenVINO/Phi-4-mini-instruct-int4-ov
Text Generation • Updated • 486 • 2 -
OpenVINO/Phi-4-mini-instruct-int8-ov
Text Generation • Updated • 29 -
OpenVINO/Phi-4-mini-instruct-fp16-ov
Text Generation • Updated • 13 -
OpenVINO/Qwen2-0.5B-Instruct-fp16-ov
Updated • 1 -
OpenVINO/Qwen2-0.5B-Instruct-int8-ov
Updated • 11 -
OpenVINO/Qwen2-0.5B-Instruct-int4-ov
Updated • 18 • 1 -
OpenVINO/Qwen2-0.5B-int8-ov
Updated • 3 • 1 -
OpenVINO/Qwen2-0.5B-fp16-ov
Updated • 3 -
OpenVINO/Qwen2-0.5B-int4-ov
Updated • 9 -
OpenVINO/Qwen2-1.5B-fp16-ov
Updated • 2 -
OpenVINO/Qwen2-1.5B-int8-ov
Updated • 1 -
OpenVINO/Qwen2-1.5B-int4-ov
Updated • 2 -
OpenVINO/Qwen2-1.5B-Instruct-fp16-ov
Updated • 1 -
OpenVINO/Qwen2-1.5B-Instruct-int8-ov
Updated • 3 -
OpenVINO/Qwen2-7B-Instruct-fp16-ov
Updated -
OpenVINO/Qwen2-7B-Instruct-int4-ov
Updated • 10 -
OpenVINO/Qwen2-1.5B-Instruct-int4-ov
Updated • 7 -
OpenVINO/Qwen2-7B-Instruct-int8-ov
Updated • 11 -
OpenVINO/Qwen3-0.6B-int4-ov
Updated • 1.42k • 3 -
OpenVINO/Qwen3-0.6B-fp16-ov
Updated • 26 • 1 -
OpenVINO/Qwen3-0.6B-int8-ov
Updated • 10 -
OpenVINO/Qwen3-1.7B-fp16-ov
Updated • 32 -
OpenVINO/Qwen3-1.7B-int8-ov
Updated • 53 • 1 -
OpenVINO/Qwen3-1.7B-int4-ov
Updated • 105 -
OpenVINO/Qwen3-4B-fp16-ov
Updated • 17 • 1 -
OpenVINO/Qwen3-4B-int8-ov
Updated • 44 • 1 -
OpenVINO/Qwen3-4B-int4-ov
Updated • 454 • 1 -
OpenVINO/Qwen3-8B-fp16-ov
Updated • 19 • 1 -
OpenVINO/Qwen3-8B-int8-ov
Updated • 395 -
OpenVINO/Qwen3-8B-int4-ov
Updated • 807 • 5 -
OpenVINO/Qwen3-14B-int8-ov
Updated • 17 -
OpenVINO/Qwen3-14B-fp16-ov
Updated • 4 -
OpenVINO/Qwen3-14B-int4-ov
Updated • 95 -
OpenVINO/phi-4-fp16-ov
Text Generation • Updated • 5 -
OpenVINO/phi-4-int8-ov
Text Generation • Updated • 7 -
OpenVINO/phi-4-int4-ov
Text Generation • Updated • 41 • 1 -
OpenVINO/Qwen3-30B-A3B-Instruct-2507-int8-ov
Text Generation • Updated • 14 -
OpenVINO/Qwen3-30B-A3B-Instruct-2507-int4-ov
Text Generation • Updated • 170 • 3 -
OpenVINO/Qwen3-Coder-30B-A3B-Instruct-int4-ov
Text Generation • Updated • 198 -
OpenVINO/Qwen3-Coder-30B-A3B-Instruct-int8-ov
Text Generation • Updated • 38 • 1 -
OpenVINO/gpt-oss-20b-int4-ov
Text Generation • Updated • 390 • 3 -
OpenVINO/gpt-oss-20b-int8-ov
Text Generation • Updated • 50 • 1 -
OpenVINO/LFM2.5-350M-int8-ov
Text Generation • Updated • 88 • 3 -
OpenVINO/LFM2.5-350M-fp16-ov
Text Generation • Updated • 801 • 2