FlorianJc
/

ghost-8b-beta-vllm-fp8

Text Generation

text-generation-inference

Model card Files Files and versions

FlorianJc commited on Jul 25, 2024

Commit

db18e0a

·

verified ·

1 Parent(s): 8ac186c

Update generation_config.json

Files changed (1) hide show

generation_config.json +1 -1

generation_config.json CHANGED Viewed

@@ -6,7 +6,7 @@
     128003,
     128009
   ],
-  "max_length": 8192,
   "temperature": 0.4,
   "top_p": 0.95,
   "transformers_version": "4.43.0.dev0"

     128003,
     128009
   ],
+  "max_length": 128256,
   "temperature": 0.4,
   "top_p": 0.95,
   "transformers_version": "4.43.0.dev0"