ghostplant's picture

21 3

ghostplant

ghostplant

·

AI & ML interests

None yet

Recent Activity

updated a dataset 13 days ago

ghostplant/data-collections

new activity 17 days ago

openai/gpt-oss-120b:Can gpt-oss support local vllm deployment on a100 GPU?

new activity 17 days ago

openai/gpt-oss-20b:Running gpt-oss Without FlashAttention 3 – Any Alternatives to Ollama?

View all activity

Organizations

None yet

New activity in openai/gpt-oss-120b 17 days ago

Can gpt-oss support local vllm deployment on a100 GPU?

#73 opened 18 days ago by

New activity in openai/gpt-oss-20b 17 days ago

Running gpt-oss Without FlashAttention 3 – Any Alternatives to Ollama?

#72 opened 18 days ago by

New activity in openai/gpt-oss-120b 17 days ago

Run GPT-OSS-120B with just Single A100 (80GB)

#80 opened 17 days ago by

New activity in Qwen/Qwen3-Coder-480B-A35B-Instruct about 1 month ago

How is Qwen3's inv_freq computed from scratch?

#13 opened about 1 month ago by

New activity in moonshotai/Kimi-K2-Instruct about 1 month ago

Run 1T-param on A100/H100(80G)x8 using FP4

#9 opened about 1 month ago by

New activity in nvidia/DeepSeek-R1-FP4 about 2 months ago

quantize deepseek-r1-0528 please

#14 opened 3 months ago by

New activity in deepseek-ai/DeepSeek-R1-0528 3 months ago

刚部署满血deepseek r1 0528版本，推理性能提升这么多嘛？不是架构没变嘛？

#75 opened 3 months ago by

How to run 0528version on GPU which don't support FP8

#64 opened 3 months ago by

这个问题大家的输出是什么？

#49 opened 3 months ago by

New activity in unsloth/DeepSeek-R1-GGUF 4 months ago

Share a mmlu test result,I use 2.51bit,and compare with ds api, baidu's ds,it seems 2.51bit is very smart at least in mmlu

#42 opened 6 months ago by

New activity in deepseek-ai/DeepSeek-R1 5 months ago

Does R1 support long context (> 4K)?

#172 opened 6 months ago by

New activity in nvidia/DeepSeek-R1-FP4 5 months ago

can this model run on Hopper GPU

#8 opened 6 months ago by

can this model run on A800 ?

#10 opened 5 months ago by

Why not use FP2 or IQ2 as kTransformers does?

#11 opened 5 months ago by

New activity in deepseek-ai/DeepSeek-R1 6 months ago

Deploying production ready service with Unsloth GGUF quants on your AWS account. (4 x L40S)

#171 opened 6 months ago by

samagra-tensorfuse

90+ tokens per second for MI300x8 using batch_size = 1

#166 opened 6 months ago by

New activity in unsloth/DeepSeek-R1-GGUF 6 months ago

Q2_K_XL 好还是 Q4好呢

#34 opened 6 months ago by

New activity in deepseek-ai/DeepSeek-R1 6 months ago

所以部署一个671B的模型显存需要多少有什么基准的硬件配置？

#118 opened 7 months ago by

New activity in deepseek-ai/DeepSeek-R1-Distill-Llama-70B 7 months ago

How much vram do you need?

#12 opened 7 months ago by

New activity in unsloth/DeepSeek-R1-GGUF 7 months ago

Is there a model removing non-shared MoE experts?

#17 opened 7 months ago by