Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Docs
  • Enterprise
  • 免费去水印

  • Log In
  • Sign Up
nm-testing 's Collections
KV Cache Quantization
Models in CI
FP8-Block Quantized Models
LLM Compressor testing
Speculators testing
Sparse-Llama-3.1-8B-2of4
SparseGPT LLMs
FP8 Models

KV Cache Quantization

updated Nov 25

Collection on FP8 Quantization of Weights, Activations and KV Cache

Upvote
-

  • nm-testing/Llama-3.1-8B-Instruct-QKV-Cache-FP8-Per-Tensor

    Updated Nov 25

  • nm-testing/Llama-3.1-8B-Instruct-QKV-Cache-FP8-Per-Head

    Updated Nov 25

  • nm-testing/Llama-3.1-8B-Instruct-FP8-dynamic-QKV-Cache-FP8-Per-Tensor

    Updated Nov 25

  • nm-testing/Llama-3.1-8B-Instruct-FP8-dynamic-QKV-Cache-FP8-Per-Head

    Updated Nov 25

  • nm-testing/Qwen3-32B-QKV-Cache-FP8-Per-Tensor

    Updated Nov 25

  • nm-testing/Qwen3-32B-QKV-Cache-FP8-Per-Head

    Updated Nov 25

  • nm-testing/Qwen3-32B-FP8-dynamic-QKV-Cache-FP8-Per-Tensor

    Updated Nov 25

  • nm-testing/Qwen3-32B-FP8-dynamic-QKV-Cache-FP8-Per-Head

    Updated Nov 25

  • nm-testing/Llama-3.3-70B-Instruct-QKV-Cache-FP8-Per-Tensor

    Updated Nov 25

  • nm-testing/Llama-3.3-70B-Instruct-QKV-Cache-FP8-Per-Head

    Updated Nov 25

  • nm-testing/Llama-3.3-70B-Instruct-FP8-dynamic-QKV-Cache-FP8-Per-Tensor

    Updated Nov 25

  • nm-testing/Llama-3.3-70B-Instruct-FP8-dynamic-QKV-Cache-FP8-Per-Head

    Updated Nov 25
Upvote
-
  • Collection guide
  • Browse collections
Company
TOS Privacy About Careers
Website
Models Datasets 免费Z-image图片生成 免费去水印 Vibevoice

🎉 Free Image Generator Now Available!

Totally Free + Zero Barriers + No Login Required