zentorch TorchAO Quantized Models - PyTorch 2.10 - a amd Collection

amd 's Collections

zentorch TorchAO Quantized Models - PyTorch 2.10

Ryzen AI 1.7.1 — NPU LFM2 Models

Ryzen AI 1.7.1 — NPU 16K

Ryzen AI 1.7.1 — NPU 4K

Ryzen AI 1.7.1 — Hybrid

Ryzen-AI-1.7-NPU-LLM_V2

Ryzen-AI SD Models

Ryzen-AI-1.7-NPU-creativity-models

Ryzen-AI-1.7-NPU-LLM

Ryzen-AI-1.7-Hybrid-LLM

Ryzen AI 1.7 Whisper NPU Optimized ONNX models

Ryzen-AI-1.6-NPU-LLM

Ryzen-AI-1.6-Hybrid-LLM

Quark Quantized Auto Mixed Precision (AMP) Models

Quark ByteDance Models

OGA_CPU_8_8_2025

OGA_DML_8_6_2025

Dell Pro AI Studio

Quark Quantized PTPC FP8 Models

RyzenAI-1.5_LLM_Hybrid_Models

RyzenAI-1.5_LLM_NPU_Models

OGA FP32 CPU models

OGA CPU LLM Collection

Quark Quantized MXFP4 models

Quark Quantized DeepSeek Models

Quark Quantized LLaMA4 Models

RyzenAI-finetuned-local-LLMs

AMDGPU OnnxGenAI

RyzenAI-1.4_LLM_NPU_Models

RyzenAI-1.4_LLM_Hybrid_Models

AMD-HybridLM-Models ✨

AMD-RyzenAI-Deepseek-R1-Distill-Hybrid

RyzenAI-1.3_LLM_NPU_Models

RyzenAI-1.3_LLM_Hybrid_Models

Quark Quantized INT8 Models

Nitro Diffusion 💥

Quark Quantized Diffusion Models

Quark Quantized ONNX LLMs for Ryzen AI 1.3 EA

Quark Quantized OCP FP8 Models

Quark ONNX: int8 Quantized Models

Quark Quantized INT4 Models

Quark Quantized INT4 ONNX Models

zentorch TorchAO Quantized Models - PyTorch 2.10

updated 5 days ago

TorchAO quantized models for AMD EPYC CPU inference. The inference stack includes vLLM (0.15.0 to 0.18.0), PyTorch 2.10, and zentorch 5.2.1.