mlx-community

/

Mamba-Codestral-7B-v0.1

like 2

Follow

MLX Community 6.44k

Hi,

I tried to run the model with mlx but I have this error : ValueError: Model type mamba2 not supported (see logs below).
Does anyone had a similar issue (I tried also with mlx 0.21.1).

((.venv) ) darlentar@Host-003 mlx % pip install -U mlx-lm
Requirement already satisfied: mlx-lm in ./.venv/lib/python3.12/site-packages (0.26.3)
Requirement already satisfied: mlx>=0.26.0 in ./.venv/lib/python3.12/site-packages (from mlx-lm) (0.28.0)
Requirement already satisfied: numpy in ./.venv/lib/python3.12/site-packages (from mlx-lm) (2.3.2)
Requirement already satisfied: transformers>=4.39.3 in ./.venv/lib/python3.12/site-packages (from mlx-lm) (4.55.0)
Requirement already satisfied: protobuf in ./.venv/lib/python3.12/site-packages (from mlx-lm) (6.31.1)
Requirement already satisfied: pyyaml in ./.venv/lib/python3.12/site-packages (from mlx-lm) (6.0.2)
Requirement already satisfied: jinja2 in ./.venv/lib/python3.12/site-packages (from mlx-lm) (3.1.6)
Requirement already satisfied: mlx-metal==0.28.0 in ./.venv/lib/python3.12/site-packages (from mlx>=0.26.0->mlx-lm) (0.28.0)
Requirement already satisfied: filelock in ./.venv/lib/python3.12/site-packages (from transformers>=4.39.3->mlx-lm) (3.18.0)
Requirement already satisfied: huggingface-hub<1.0,>=0.34.0 in ./.venv/lib/python3.12/site-packages (from transformers>=4.39.3->mlx-lm) (0.34.4)
Requirement already satisfied: packaging>=20.0 in ./.venv/lib/python3.12/site-packages (from transformers>=4.39.3->mlx-lm) (25.0)
Requirement already satisfied: regex!=2019.12.17 in ./.venv/lib/python3.12/site-packages (from transformers>=4.39.3->mlx-lm) (2025.7.34)
Requirement already satisfied: requests in ./.venv/lib/python3.12/site-packages (from transformers>=4.39.3->mlx-lm) (2.32.4)
Requirement already satisfied: tokenizers<0.22,>=0.21 in ./.venv/lib/python3.12/site-packages (from transformers>=4.39.3->mlx-lm) (0.21.4)
Requirement already satisfied: safetensors>=0.4.3 in ./.venv/lib/python3.12/site-packages (from transformers>=4.39.3->mlx-lm) (0.6.2)
Requirement already satisfied: tqdm>=4.27 in ./.venv/lib/python3.12/site-packages (from transformers>=4.39.3->mlx-lm) (4.67.1)
Requirement already satisfied: fsspec>=2023.5.0 in ./.venv/lib/python3.12/site-packages (from huggingface-hub<1.0,>=0.34.0->transformers>=4.39.3->mlx-lm) (2025.7.0)
Requirement already satisfied: typing-extensions>=3.7.4.3 in ./.venv/lib/python3.12/site-packages (from huggingface-hub<1.0,>=0.34.0->transformers>=4.39.3->mlx-lm) (4.14.1)
Requirement already satisfied: hf-xet<2.0.0,>=1.1.3 in ./.venv/lib/python3.12/site-packages (from huggingface-hub<1.0,>=0.34.0->transformers>=4.39.3->mlx-lm) (1.1.7)
Requirement already satisfied: MarkupSafe>=2.0 in ./.venv/lib/python3.12/site-packages (from jinja2->mlx-lm) (3.0.2)
Requirement already satisfied: charset_normalizer<4,>=2 in ./.venv/lib/python3.12/site-packages (from requests->transformers>=4.39.3->mlx-lm) (3.4.3)
Requirement already satisfied: idna<4,>=2.5 in ./.venv/lib/python3.12/site-packages (from requests->transformers>=4.39.3->mlx-lm) (3.10)
Requirement already satisfied: urllib3<3,>=1.21.1 in ./.venv/lib/python3.12/site-packages (from requests->transformers>=4.39.3->mlx-lm) (2.5.0)
Requirement already satisfied: certifi>=2017.4.17 in ./.venv/lib/python3.12/site-packages (from requests->transformers>=4.39.3->mlx-lm) (2025.8.3)
((.venv) ) darlentar@Host-003 mlx % pip install -U mlx
Requirement already satisfied: mlx in ./.venv/lib/python3.12/site-packages (0.28.0)
Requirement already satisfied: mlx-metal==0.28.0 in ./.venv/lib/python3.12/site-packages (from mlx) (0.28.0)
((.venv) ) darlentar@Host-003 mlx % python llm.py
Fetching 9 files: 100%|█████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 9/9 [00:00<00:00, 111025.69it/s]
ERROR:root:Model type mamba2 not supported.
Traceback (most recent call last):
  File "/Users/darlentar/virtualenvs/mlx/.venv/lib/python3.12/site-packages/mlx_lm/utils.py", line 66, in _get_classes
    arch = importlib.import_module(f"mlx_lm.models.{model_type}")
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/opt/homebrew/Cellar/[email protected]/3.12.11/Frameworks/Python.framework/Versions/3.12/lib/python3.12/importlib/__init__.py", line 90, in import_module
    return _bootstrap._gcd_import(name[level:], package, level)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "<frozen importlib._bootstrap>", line 1387, in _gcd_import
  File "<frozen importlib._bootstrap>", line 1360, in _find_and_load
  File "<frozen importlib._bootstrap>", line 1324, in _find_and_load_unlocked
ModuleNotFoundError: No module named 'mlx_lm.models.mamba2'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/Users/darlentar/virtualenvs/mlx/llm.py", line 3, in <module>
    model, tokenizer = load("mlx-community/Mamba-Codestral-7B-v0.1")
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/darlentar/virtualenvs/mlx/.venv/lib/python3.12/site-packages/mlx_lm/utils.py", line 254, in load
    model, config = load_model(model_path, lazy)
                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/darlentar/virtualenvs/mlx/.venv/lib/python3.12/site-packages/mlx_lm/utils.py", line 183, in load_model
    model_class, model_args_class = get_model_classes(config=config)
                                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/darlentar/virtualenvs/mlx/.venv/lib/python3.12/site-packages/mlx_lm/utils.py", line 70, in _get_classes
    raise ValueError(msg)
ValueError: Model type mamba2 not supported.
((.venv) ) darlentar@Host-003 mlx %