OpenVINO/Llama-3.1-8B-Instruct-FastDraft-150M-int8-ov
Updated • 41 • 9
Speculative Decoding Draft Models
Collection of OpenVINO optimized efficient draft models for speculative decoding
Collection of OpenVINO optimized efficient draft models for speculative decoding