Error installing model
#13
by
nototon
- opened
How to solve this problem? Wherever and wherever I install the quantized model, this error is displayed correctly:
Error: 500 Internal Server Error: unable to load model: C:\Users\1.ollama\models\blobs\sha256-7dd573dc3e0ba2e7d6bf76e16d400cf69b6afc2ae58f213e4eb1d133c38e938b
I had this error too, I fixed it by turning off KV cache quantization. But the model in general (not unsloth specifically) seems a bit... buggy at the moment. Support is a bit iffy imo.
Thank you very much for your answer, but how can I do what you advised in Ollama or LM Studio?