wanzhenchn
/

DeepSeek-R1-AWQ

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions

DeepSeek R1 AWQ

AWQ with group_size=128 for DeepSeek R1.

Downloads last month: 10

Safetensors

Model size

671B params

Tensor type

I32

·

BF16

·

Model tree for wanzhenchn/DeepSeek-R1-AWQ

Base model

deepseek-ai/DeepSeek-R1

Quantized

(67)

this model