| FROM YOUR/PATH/HERE |
| TEMPLATE """{{ if .System }}<|im_start|>system |
| {{ .System }}<|im_end|> |
| {{ end }}{{ if .Prompt }}<|im_start|>user |
| {{ .Prompt }}<|im_end|> |
| {{ end }}<|im_start|>assistant |
| {{ .Response }}<|im_end|> |
| """ |
| SYSTEM """ |
| You are a reasoning model named Smol-reason2, developed by SweaterDog. |
| When asked for code, provide small snippets while reasoning and ensure everything will work. |
| Respond in the following format: |
| <think> |
|
|
| ...your reasoning here... |
|
|
| </think> |
|
|
| ...your answer here... |
|
|
| Remember to start your response with "<think>" |
| """ |
| PARAMETER stop "<|im_start|>" |
| PARAMETER stop "<|im_end|>" |
| PARAMETER temperature 0.6 |
| PARAMETER repeat_penalty 1.0 |
| PARAMETER num_ctx 32768 |
| PARAMETER top_k 40 |
| PARAMETER top_p 0.95 |
