Failed! Model mixtral-8x7b-instruct failed to start after update
I just did the update to the latest version of Jan after words Jan refuses to start, and I get the following error message.
"Failed! Model mixtral-8x7b-instruct failed to start. Model failed to start: Failed to load model"
It was running fine before, and it sure ant my system because I have an intel i9 1490 3.20 Ghz 64 gigs of ram 64 bit with a 4090 with 32 ram
me too
Me too- I have bit sitting with this problem a long time before i saw this post. Can somebody please spread some light over what is going on?
hey @fleicht you might find Impulse AI (https://www.impulselabs.ai/) useful. we make it super easy to fine-tune and deploy open source models. hopefully you find it helpful! i know not relevant to your problem above but might be easier to use us to fine tune and deploy
docs: https://docs.impulselabs.ai/introduction
python sdk: https://pypi.org/project/impulse-api-sdk-python/