Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
RedHatAI
/
quantization
like
6
Follow
Red Hat AI
1.47k
kernel
License:
apache-2.0
Model card
Files
Files and versions
Community
1
2f56f34
quantization
2 contributors
History:
43 commits
danieldk
HF Staff
Export Marlin and quantization utilities
2f56f34
2 months ago
attention
Sync to vLLM 20250627
3 months ago
build
Build (AArch64)
3 months ago
compressed_tensors
Sync to vLLM 20250627
3 months ago
core
Sync to vLLM 20250627
3 months ago
cutlass_extensions
Sync to vLLM 20250627
3 months ago
cutlass_w8a8
Sync to vLLM 20250627
3 months ago
fp8
Sync to vLLM 20250627
3 months ago
gptq_marlin
Sync to vLLM 20250627
3 months ago
marlin
Sync to vLLM 20250627
3 months ago
tests
Sync to vLLM 20250627
3 months ago
torch-ext
Export Marlin and quantization utilities
2 months ago
.gitattributes
Safe
1.56 kB
Build
9 months ago
LICENSE
Safe
11.4 kB
Add cutlass_w8a8
9 months ago
README.md
Safe
195 Bytes
Update README.md (#1)
7 months ago
build.toml
Safe
5.92 kB
Set CUDA minimum versions for hopper/blackwell cutlass kernels
3 months ago
cuda_utils.h
Safe
1.41 kB
Sync on vLLM 20240402
5 months ago
dispatch_utils.h
Safe
3.9 kB
Sync to vLLM 20250627
3 months ago
flake.lock
4.5 kB
Set CUDA minimum versions for hopper/blackwell cutlass kernels
3 months ago
flake.nix
354 Bytes
Set CUDA minimum versions for hopper/blackwell cutlass kernels
3 months ago
utils.cuh
Safe
1.84 kB
Sync on vLLM 20240402
5 months ago
vectorization.cuh
Safe
878 Bytes
Sync to vLLM 20250627
3 months ago
vectorization_utils.cuh
Safe
2.61 kB
Sync to vLLM 20250627
3 months ago
