togethercomputer
/

RedPajama-INCITE-7B-Base

Text Generation

text-generation-inference

Model card Files Files and versions

juewang commited on May 5, 2023

Commit

8fd22c7

·

1 Parent(s): 6ebc83d

Update README.md

Files changed (1) hide show

README.md +2 -2

README.md CHANGED Viewed

@@ -19,7 +19,7 @@ RedPajama-Base-INCITE-6.9B-v1, is a large transformer-based language model devel
 ## GPU Inference
-This requires a GPU with 8GB memory.
 ```python
 from transformers import AutoTokenizer, AutoModelForCausalLM
 # init
@@ -35,7 +35,7 @@ print(output_str)
 ## GPU Inference in Int8
-This requires a GPU with 6GB memory.
 ```python
 from transformers import AutoTokenizer, AutoModelForCausalLM

 ## GPU Inference
+This requires a GPU with 16GB memory.
 ```python
 from transformers import AutoTokenizer, AutoModelForCausalLM
 # init
 ## GPU Inference in Int8
+This requires a GPU with 12GB memory.
 ```python
 from transformers import AutoTokenizer, AutoModelForCausalLM