ynhe commited on
Commit
887d1ac
·
verified ·
1 Parent(s): 7dca794

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -0
README.md CHANGED
@@ -102,6 +102,8 @@ We measured the average inference speed (tokens/s) of generating 1024 new tokens
102
  |BF16 | 33.40 | 31.91 | 21.33|
103
  |INT4 | - | 31.95 | - |
104
 
 
 
105
 
106
  ## 🚀 How to use the model
107
 
 
102
  |BF16 | 33.40 | 31.91 | 21.33|
103
  |INT4 | - | 31.95 | - |
104
 
105
+ The profiling runs on a single A800-SXM4-80G GPU with PyTorch 2.4.0 and CUDA 12.1.
106
+
107
 
108
  ## 🚀 How to use the model
109