Undi95
/

Mistral-11B-RP-v1

Text Generation

Not-For-All-Audiences

nsfw

text-generation-inference

Model card Files Files and versions

Undi95 commited on Oct 9, 2023

Commit

003d69c

·

1 Parent(s): a7916c9

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -53,7 +53,7 @@ slices:
     - model: mistralai/Mistral-7B-v0.1
       layer_range: [8, 32]
 merge_method: passthrough
-dtype: float16
 ```

     - model: mistralai/Mistral-7B-v0.1
       layer_range: [8, 32]
 merge_method: passthrough
+dtype: bfloat16
 ```