Hanshi's picture

3 6 2

Hanshi

preminstrel

·

https://preminstrel.com

AI & ML interests

ML

Recent Activity

upvoted a paper 12 days ago

MMGR: Multi-Modal Generative Reasoning

new activity 4 months ago

ByteDance-Seed/cudaLLM-8B:What is the meaning of "Bo"?

liked a model 4 months ago

ByteDance-Seed/Seed-OSS-36B-Instruct

View all activity

Organizations

authored 2 papers about 1 year ago

Fast Best-of-N Decoding via Speculative Rejection

Paper • 2410.20290 • Published Oct 26, 2024 • 10

ShadowKV: KV Cache in Shadows for High-Throughput Long-Context LLM Inference

Paper • 2410.21465 • Published Oct 28, 2024 • 11

authored a paper over 1 year ago

TriForce: Lossless Acceleration of Long Sequence Generation with Hierarchical Speculative Decoding

Paper • 2404.11912 • Published Apr 18, 2024 • 17