qaihm-bot commited on
Commit
ac1c12b
·
verified ·
1 Parent(s): 4ca2006

See https://github.com/quic/ai-hub-models/releases/v0.31.0 for changelog.

Files changed (1) hide show
  1. README.md +3 -3
README.md CHANGED
@@ -46,9 +46,9 @@ This model is an implementation of Llama-v2-7B-Chat found [here](https://hugging
46
 
47
  | Model | Precision | Device | Chipset | Target Runtime | Response Rate (tokens per second) | Time To First Token (range, seconds)
48
  |---|---|---|---|---|---|
49
- | Llama-v2-7B-Chat | w4a16 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN | 12.85 | 1.49583 - 1.49583 | -- | -- |
50
- | Llama-v2-7B-Chat | w4a16 | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN | 11.2 | 1.919 - 1.919 | -- | -- |
51
- | Llama-v2-7B-Chat | w4a16 | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | QNN | 17.94 | 1.44 - 1.44 | -- | -- |
52
 
53
  ## Deploying Llama 2 on-device
54
 
 
46
 
47
  | Model | Precision | Device | Chipset | Target Runtime | Response Rate (tokens per second) | Time To First Token (range, seconds)
48
  |---|---|---|---|---|---|
49
+ | Llama-v2-7B-Chat | w4a16 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN_CONTEXT_BINARY | 12.85 | 1.49583 - 1.49583 | -- | -- |
50
+ | Llama-v2-7B-Chat | w4a16 | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN_CONTEXT_BINARY | 11.2 | 1.919 - 1.919 | -- | -- |
51
+ | Llama-v2-7B-Chat | w4a16 | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | QNN_CONTEXT_BINARY | 17.94 | 1.44 - 1.44 | -- | -- |
52
 
53
  ## Deploying Llama 2 on-device
54