issues when running the provided script for inference

#2
by atinsood - opened
ERROR:root:Model type Dream not supported.
Traceback (most recent call last):
  File "/home/opensource/ml-diffucoder/.venv/lib/python3.11/site-packages/mlx_lm/utils.py", line 67, in _get_classes
    arch = importlib.import_module(f"mlx_lm.models.{model_type}")
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/boomer/Library/Application Support/uv/python/cpython-3.11.13-macos-aarch64-none/lib/python3.11/importlib/__init__.py", line 126, in import_module
    return _bootstrap._gcd_import(name[level:], package, level)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "<frozen importlib._bootstrap>", line 1204, in _gcd_import
  File "<frozen importlib._bootstrap>", line 1176, in _find_and_load
  File "<frozen importlib._bootstrap>", line 1140, in _find_and_load_unlocked
ModuleNotFoundError: No module named 'mlx_lm.models.Dream'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/opensource/ml-diffucoder/inference_demo_mac.py", line 3, in <module>
    model, tokenizer = load("mlx-community/DiffuCoder-7B-cpGRPO-8bit")
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/opensource/ml-diffucoder/.venv/lib/python3.11/site-packages/mlx_lm/utils.py", line 241, in load
    model, config = load_model(model_path, lazy)
                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/opensource/ml-diffucoder/.venv/lib/python3.11/site-packages/mlx_lm/utils.py", line 176, in load_model
    model_class, model_args_class = get_model_classes(config=config)
                                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/opensource/ml-diffucoder/.venv/lib/python3.11/site-packages/mlx_lm/utils.py", line 71, in _get_classes
    raise ValueError(msg)
ValueError: Model type Dream not supported.

version of mlx-lm being used
mlx-lm==0.26.3

Sign up or log in to comment