OpenMOSS-Team/SmolLM-135M-MLA-d_kv_8-refactor
Text Generation • 0.1B • Updated • 3 • 1
MHA2MLA-refactor
The MHA2MLA model published in the paper "Towards Economical Inference: Enabling DeepSeek's Multi-Head Latent Attention in Any Transformer-Based LLMs"
-
-
OpenMOSS-Team/SmolLM-135M-MLA-d_kv_32-refactor
Text Generation • 0.1B • Updated • 20 • 1 -
OpenMOSS-Team/SmolLM-135M-MLA-d_kv_16-refactor
Text Generation • 0.1B • Updated • 3 • 1 -
OpenMOSS-Team/SmolLM-360M-MLA-d_kv_8-refactor
Text Generation • 0.3B • Updated • 7 • 1 -
OpenMOSS-Team/SmolLM-360M-MLA-d_kv_16-refactor
Text Generation • 0.3B • Updated • 6 -
OpenMOSS-Team/SmolLM-360M-MLA-d_kv_32-refactor
Text Generation • 0.4B • Updated • 1 -
OpenMOSS-Team/smollm1-1B7-d_kv_8-refactor
Text Generation • 2B • Updated • 1 -
OpenMOSS-Team/smollm1-1B7-d_kv_16-refactor
Text Generation • 2B • Updated • 2 -
OpenMOSS-Team/smollm1-1B7-d_kv_32-refactor
Text Generation • 2B • Updated • 3 -
OpenMOSS-Team/llama2-7B-d_kv_16-refactor
Text Generation • 6B • Updated • 1 -
OpenMOSS-Team/llama2-7B-d_kv_32-refactor
Text Generation • 6B • Updated • 8 -
OpenMOSS-Team/llama2-7B-d_kv_64-refactor
Text Generation • 7B • Updated • 1