MagicDec: Breaking the Latency-Throughput Tradeoff for Long Context Generation with Speculative Decoding
Paper
•
2408.11049
•
Published
•
13
Jian Chen
jianchen0311
AI & ML interests
None yet
Recent Activity
updated
a model
about 6 hours ago
z-lab/Qwen3-Coder-30B-A3B-DFlash
updated
a model
about 6 hours ago
z-lab/Qwen3-8B-DFlash-b16
updated
a model
about 6 hours ago
z-lab/Qwen3-4B-DFlash-b16
Organizations
authored
2
papers
4 months ago