shuyuej/Command-R-Plus-GPTQ
Text Generation
•
104B
•
Updated
•
11
•
1
Quantization
A collection of quantized models. All the models can be fine-tuned by adding a LoRA Adapter.
-
-
shuyuej/Meta-Llama-3-8B-Instruct-GPTQ
Text Generation • 8B • Updated • 10 • 1 -
shuyuej/Command-R-GPTQ
Text Generation • 37B • Updated • 14 • 1 -
shuyuej/Meta-Llama-3-70B-Instruct-GPTQ
Text Generation • 71B • Updated • 12 -
shuyuej/gemma-2-27b-it-GPTQ
Text Generation • 28B • Updated • 105 • 3 -
shuyuej/Mixtral-8x7B-Instruct-v0.1-GPTQ
Text Generation • 47B • Updated • 11 -
shuyuej/Mixtral-8x22B-Instruct-v0.1-GPTQ
Text Generation • 141B • Updated • 6 • 1 -
shuyuej/Command-R-Plus-Smaller-GPTQ
Text Generation • 104B • Updated • 8 -
shuyuej/gemma-2b-it-GPTQ
Text Generation • 3B • Updated • 6 -
shuyuej/gemma-7b-it-GPTQ
Text Generation • 9B • Updated • 11 -
shuyuej/gemma-2-9b-it-GPTQ
Text Generation • 9B • Updated • 15 -
shuyuej/Command-R-HF-GPTQ
Text Generation • 35B • Updated • 7 -
shuyuej/Command-R-Smaller-HF-GPTQ
Text Generation • 35B • Updated • 11 -
shuyuej/Meta-Llama-3.1-8B-Instruct-GPTQ
Text Generation • 8B • Updated • 8 • 1 -
shuyuej/Meta-Llama-3.1-70B-Instruct-GPTQ
Text Generation • 71B • Updated • 19 • 3 -
shuyuej/Mistral-7B-Instruct-v0.1-GPTQ
Text Generation • 7B • Updated • 7 -
shuyuej/Mistral-7B-Instruct-v0.2-GPTQ
Text Generation • 7B • Updated • 7 -
shuyuej/Mistral-Nemo-Instruct-2407-GPTQ
Text Generation • 12B • Updated • 162 • 7 -
shuyuej/Mistral-7B-Instruct-v0.3-GPTQ
Text Generation • 7B • Updated • 8 -
shuyuej/Mistral-Nemo-Base-2407-GPTQ
Text Generation • 12B • Updated • 7 -
shuyuej/mathstral-7B-v0.1-GPTQ
Text Generation • 7B • Updated • 8 -
shuyuej/Llama-Guard-3-8B-GPTQ
Text Generation • 8B • Updated • 50 -
shuyuej/Meta-Llama-3.1-8B-GPTQ
Text Generation • 8B • Updated • 8 -
shuyuej/Meta-Llama-3-8B-GPTQ
Text Generation • 8B • Updated • 8 • 1 -
shuyuej/Llama-2-13b-hf-GPTQ
Text Generation • 13B • Updated • 6 -
shuyuej/Llama-2-7b-hf-GPTQ
Text Generation • 7B • Updated • 7 -
shuyuej/Llama-2-13b-chat-hf-GPTQ
Text Generation • 13B • Updated • 4 -
shuyuej/Llama-2-7b-chat-hf-GPTQ
Text Generation • 7B • Updated • 7 -
shuyuej/Mistral-Large-Instruct-2407-GPTQ
Text Generation • 123B • Updated • 10 • 3 -
shuyuej/Meta-Llama-3.1-70B-Smaller-GPTQ
Text Generation • 71B • Updated • 9 -
shuyuej/Meta-Llama-3.1-70B-Instruct-Smaller-GPTQ
Text Generation • 71B • Updated • 9 -
shuyuej/Meta-Llama-3.1-70B-GPTQ
Text Generation • 71B • Updated • 8 -
shuyuej/Meta-Llama-Guard-2-8B-GPTQ
Text Generation • 8B • Updated • 4 -
shuyuej/Mixtral-8x7B-v0.1-GPTQ
Text Generation • 47B • Updated • 10 -
shuyuej/Mixtral-8x22B-v0.1-GPTQ
Text Generation • 141B • Updated • 4 -
shuyuej/Mistral-Large-Instruct-2407-Smaller-GPTQ
Text Generation • 123B • Updated • 8 -
shuyuej/gemma-2b-GPTQ
Text Generation • 3B • Updated • 5 -
shuyuej/gemma-7b-GPTQ
Text Generation • 9B • Updated • 8 -
shuyuej/gemma-2-9b-GPTQ
Text Generation • 9B • Updated • 6 -
shuyuej/gemma-2-27b-GPTQ
Text Generation • 28B • Updated • 7 -
shuyuej/Qwen2-1.5B-GPTQ
Text Generation • 2B • Updated • 6 -
shuyuej/Qwen2-57B-A14B-GPTQ
Text Generation • 57B • Updated • 8 -
shuyuej/Qwen2-0.5B-GPTQ
Text Generation • 0.5B • Updated • 6 -
shuyuej/Qwen2-1.5B-Instruct-GPTQ
Text Generation • 2B • Updated • 7 -
shuyuej/Qwen2-0.5B-Instruct-GPTQ
Text Generation • 0.5B • Updated • 6 -
shuyuej/Qwen2-7B-Instruct-GPTQ
Text Generation • 8B • Updated • 9 -
shuyuej/Qwen2-57B-A14B-Instruct-GPTQ
Text Generation • 57B • Updated • 7 -
shuyuej/Qwen2-72B-Instruct-GPTQ
Text Generation • 73B • Updated • 4 -
shuyuej/Qwen2-72B-GPTQ
Text Generation • 73B • Updated • 6 -
shuyuej/Linq-Embed-Mistral-GPTQ
Feature Extraction • 7B • Updated • 3 -
shuyuej/gte-Qwen2-1.5B-instruct-GPTQ
Text Generation • 2B • Updated • 5 -
shuyuej/gte-Qwen2-7B-instruct-GPTQ
Text Generation • 8B • Updated • 62 • 2 -
shuyuej/bge-multilingual-gemma2-GPTQ
Feature Extraction • 10B • Updated • 2.23k • 5 -
shuyuej/e5-mistral-7b-instruct-GPTQ
Feature Extraction • 7B • Updated • 10 -
shuyuej/SFR-Embedding-2_R-GPTQ
Feature Extraction • 7B • Updated • 14 • 1 -
shuyuej/bge-en-icl-GPTQ
Feature Extraction • 7B • Updated • 9 • 2 -
shuyuej/SFR-Embedding-Mistral-GPTQ
Feature Extraction • 7B • Updated • 5 -
shuyuej/gte-Qwen1.5-7B-instruct-GPTQ
Text Generation • 8B • Updated • 8 -
shuyuej/Phi-3-vision-128k-instruct-GPTQ
Text Generation • Updated • 6 -
shuyuej/Phi-3-medium-128k-instruct-GPTQ
Text Generation • 14B • Updated • 7 -
shuyuej/Phi-3-medium-4k-instruct-GPTQ
Text Generation • 14B • Updated • 7 -
shuyuej/Phi-3-small-128k-instruct-GPTQ
Text Generation • 7B • Updated • 6 -
shuyuej/Phi-3-small-8k-instruct-GPTQ
Text Generation • 7B • Updated • 11 -
shuyuej/Phi-3-mini-128k-instruct-GPTQ
Text Generation • 4B • Updated • 28 -
shuyuej/Phi-3-mini-4k-instruct-GPTQ
Text Generation • 4B • Updated • 5 -
shuyuej/aya-23-8B-GPTQ
Text Generation • Updated • 12 -
shuyuej/aya-23-35B-GPTQ
Text Generation • Updated • 9 -
shuyuej/Mistral-Nemo-Instruct-2407-GPTQ-INT8
12B • Updated • 71 • 3 -
shuyuej/vicuna-13b-v1.5-GPTQ
13B • Updated • 7 -
shuyuej/vicuna-7b-v1.5-GPTQ
7B • Updated • 4 -
shuyuej/Mistral-Small-Instruct-2409-GPTQ
3B • Updated • 16 -
shuyuej/OLMoE-1B-7B-0924-GPTQ
7B • Updated • 5 -
shuyuej/Llama-Guard-3-1B-GPTQ
1B • Updated • 4 -
shuyuej/Llama-3.2-1B-Instruct-GPTQ
1B • Updated • 6.08k • 4 -
shuyuej/Llama-3.2-1B-GPTQ
1B • Updated • 54 • 1 -
shuyuej/Llama-3.2-3B-Instruct-GPTQ
3B • Updated • 1.48k • 1 -
shuyuej/Llama-3.2-3B-GPTQ
3B • Updated • 6 -
shuyuej/c4ai-command-r-08-2024-GPTQ
34B • Updated • 6 -
shuyuej/c4ai-command-r-plus-08-2024-GPTQ
107B • Updated • 7 -
shuyuej/gemma-2-2b-GPTQ
3B • Updated • 5 -
shuyuej/gemma-2-2b-it-GPTQ
3B • Updated • 6 -
shuyuej/Llama-3.3-70B-Instruct-GPTQ
71B • Updated • 894 • 6