issues when running the provided script for inference
#2
by
atinsood
- opened
ERROR:root:Model type Dream not supported.
Traceback (most recent call last):
File "/home/opensource/ml-diffucoder/.venv/lib/python3.11/site-packages/mlx_lm/utils.py", line 67, in _get_classes
arch = importlib.import_module(f"mlx_lm.models.{model_type}")
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/Users/boomer/Library/Application Support/uv/python/cpython-3.11.13-macos-aarch64-none/lib/python3.11/importlib/__init__.py", line 126, in import_module
return _bootstrap._gcd_import(name[level:], package, level)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "<frozen importlib._bootstrap>", line 1204, in _gcd_import
File "<frozen importlib._bootstrap>", line 1176, in _find_and_load
File "<frozen importlib._bootstrap>", line 1140, in _find_and_load_unlocked
ModuleNotFoundError: No module named 'mlx_lm.models.Dream'
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/home/opensource/ml-diffucoder/inference_demo_mac.py", line 3, in <module>
model, tokenizer = load("mlx-community/DiffuCoder-7B-cpGRPO-8bit")
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/opensource/ml-diffucoder/.venv/lib/python3.11/site-packages/mlx_lm/utils.py", line 241, in load
model, config = load_model(model_path, lazy)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/opensource/ml-diffucoder/.venv/lib/python3.11/site-packages/mlx_lm/utils.py", line 176, in load_model
model_class, model_args_class = get_model_classes(config=config)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/opensource/ml-diffucoder/.venv/lib/python3.11/site-packages/mlx_lm/utils.py", line 71, in _get_classes
raise ValueError(msg)
ValueError: Model type Dream not supported.
version of mlx-lm being used
mlx-lm==0.26.3