quanting problem
I tried making quants with R1 and V3 and I keep getting:
load: control token: 128074 '<｜place▁holder▁no▁74｜>' is not marked as EOG
load: control token: 128177 '<｜place▁holder▁no▁177｜>' is not marked as EOG
load: control token: 128702 '<｜place▁holder▁no▁702｜>' is not marked as EOG
load: control token: 128443 '<｜place▁holder▁no▁443｜>' is not marked as EOG
load: control token: 128316 '<｜place▁holder▁no▁316｜>' is not marked as EOG
load: control token: 128525 '<｜place▁holder▁no▁525｜>' is not marked as EOG
load: control token: 128137 '<｜place▁holder▁no▁137｜>' is not marked as EOG
load: control token: 128477 '<｜place▁holder▁no▁477｜>' is not marked as EOG
load: control token: 128205 '<｜place▁holder▁no▁205｜>' is not marked as EOG
When I load it. Have you maybe run into this issue yourself?
I tried quanting with:
https://huggingface.co/bartowski/DeepSeek-R1-GGUF/blob/main/DeepSeek-R1.imatrix
And it works properly. You can probably update your repo with Bartowski's imat.