AutoGPTQ model for pe-nlp/deepseek-pt-v3-quantized-int4: 8bits, gr128, desc_act=False d1641d3 verified shawnzzzzz commited on Jul 9, 2024