Update README.md
Browse files
README.md
CHANGED
|
@@ -45,14 +45,14 @@ About half of the roleplay dataset is in Markdown asterisk format, but the major
|
|
| 45 |
|
| 46 |
Mistral really loves recommending unusual inference settings but I've been getting decent results with the settings below:
|
| 47 |
|
| 48 |
-
Yes, the temperature is correct. This model creates diversity at the training level, so any additional increase will simply cost you coherence instead.
|
| 49 |
-
|
| 50 |
```
|
| 51 |
"temperature": 0.5,
|
| 52 |
-
"repetition_penalty": 1.05,
|
| 53 |
"min_p": 0.05
|
| 54 |
```
|
| 55 |
|
|
|
|
|
|
|
| 56 |
Having character names in front of messages is not a requirement but remains a personal recommendation of mine - it seems to help the model focus more on the character(s) in question. World-focused text adventures do fine without it.
|
| 57 |
|
| 58 |
## Prompt Format
|
|
|
|
| 45 |
|
| 46 |
Mistral really loves recommending unusual inference settings but I've been getting decent results with the settings below:
|
| 47 |
|
|
|
|
|
|
|
| 48 |
```
|
| 49 |
"temperature": 0.5,
|
| 50 |
+
"repetition_penalty": 1.05, # Or use the DRY sampler!
|
| 51 |
"min_p": 0.05
|
| 52 |
```
|
| 53 |
|
| 54 |
+
Yes, the temperature is correct. This model creates diversity at the training level, so any additional increase will simply cost you coherence instead.
|
| 55 |
+
|
| 56 |
Having character names in front of messages is not a requirement but remains a personal recommendation of mine - it seems to help the model focus more on the character(s) in question. World-focused text adventures do fine without it.
|
| 57 |
|
| 58 |
## Prompt Format
|