marcsun13/Llama-3.1-8B-Instruct-bnb-4bit
Text Generation • 8B • Updated • 1
Marc Sun
marcsun13
AI & ML interests
LLM, Quantization, Training, Inference
Recent Activity
upvoted an article about 7 hours ago
Welcome Gemma 4: Frontier multimodal intelligence on device liked a model 9 days ago
kernels-community/flash-attn3 upvoted an article about 1 month ago
GGML and llama.cpp join HF to ensure the long-term progress of Local AIOrganizations
marcsun13/phi-4-bnb-4bit
Text Generation • 15B • Updated • 13
marcsun13/Llama-3.2-1B-bnb-4bit
Text Generation • 1B • Updated • 26
marcsun13/Llama-3.2-1B-Instruct-SpinQuant_INT4_EO8
2B • Updated • 2
marcsun13/paligemma_vqav2
Updated
marcsun13/Meta-Llama-3-8B-torchao-int8_weight_only
Updated • 1
marcsun13/sft_openassistant-guanaco
Text Generation • 7B • Updated • 5
marcsun13/gemma-2-27b-it-bnb-colab
Text Generation • 28B • Updated • 5
marcsun13/gemma-2-9b-it-GPTQ
Text Generation • 9B • Updated • 39 • 3
marcsun13/test_push_checkpoint
Fill-Mask • 0.1B • Updated • 14
marcsun13/Mixtral-8x7B-v0.1-GPTQ
Text Generation • 47B • Updated • 4
marcsun13/Mixtral-tiny-GPTQ
Text Generation • 0.2B • Updated • 6
marcsun13/Llama-2-13B-AWQ
Text Generation • 13B • Updated • 5
marcsun13/opt-125m-awq
Text Generation • Updated • 7
marcsun13/opt-350m-gptq-4bit
Text Generation • Updated • 1.36k
marcsun13/gpt2-xl-linear-sharded
Updated • 2
marcsun13/gpt2-xl-linear
Updated
marcsun13/bloom-1b7_with_lm_head
Text Generation • Updated • 3.54k
marcsun13/dummy-model
Fill-Mask • Updated • 1