qaihm-bot commited on
Commit
9d83c34
·
verified ·
1 Parent(s): 21de78c

See https://github.com/quic/ai-hub-models/releases/v0.30.5 for changelog.

Files changed (2) hide show
  1. MobileSam_SAMDecoder.tflite +2 -2
  2. README.md +64 -66
MobileSam_SAMDecoder.tflite CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:3c288824c7d6aa7a318792f5fb6d7f2638b906773d884317f5c0773e0ca332e1
3
- size 24802396
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1e89c1095d13c9bbe2f4b5a10a5de0d4781e16d8eeddd1be074d2387911e2f38
3
+ size 24802624
README.md CHANGED
@@ -35,64 +35,62 @@ More details on model performance across various devices, can be found
35
 
36
  | Model | Precision | Device | Chipset | Target Runtime | Inference Time (ms) | Peak Memory Range (MB) | Primary Compute Unit | Target Model
37
  |---|---|---|---|---|---|---|---|---|
38
- | SAMEncoder | float | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | TFLITE | 805.961 ms | 33 - 165 MB | NPU | [MobileSam.tflite](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.tflite) |
39
- | SAMEncoder | float | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | QNN | 992.926 ms | 12 - 22 MB | NPU | Use Export Script |
40
- | SAMEncoder | float | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | TFLITE | 595.924 ms | 33 - 171 MB | NPU | [MobileSam.tflite](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.tflite) |
41
- | SAMEncoder | float | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | QNN | 491.545 ms | 12 - 591 MB | NPU | Use Export Script |
42
- | SAMEncoder | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | TFLITE | 432.572 ms | 33 - 60 MB | NPU | [MobileSam.tflite](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.tflite) |
43
- | SAMEncoder | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | QNN | 268.105 ms | 12 - 14 MB | NPU | Use Export Script |
44
- | SAMEncoder | float | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | TFLITE | 420.623 ms | 33 - 166 MB | NPU | [MobileSam.tflite](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.tflite) |
45
- | SAMEncoder | float | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | QNN | 274.994 ms | 1 - 15 MB | NPU | Use Export Script |
46
- | SAMEncoder | float | SA7255P ADP | Qualcomm® SA7255P | TFLITE | 805.961 ms | 33 - 165 MB | NPU | [MobileSam.tflite](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.tflite) |
47
- | SAMEncoder | float | SA7255P ADP | Qualcomm® SA7255P | QNN | 992.926 ms | 12 - 22 MB | NPU | Use Export Script |
48
- | SAMEncoder | float | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | TFLITE | 428.72 ms | 33 - 67 MB | NPU | [MobileSam.tflite](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.tflite) |
49
- | SAMEncoder | float | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | QNN | 269.684 ms | 2 - 4 MB | NPU | Use Export Script |
50
- | SAMEncoder | float | SA8295P ADP | Qualcomm® SA8295P | TFLITE | 587.766 ms | 28 - 163 MB | NPU | [MobileSam.tflite](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.tflite) |
51
- | SAMEncoder | float | SA8295P ADP | Qualcomm® SA8295P | QNN | 425.537 ms | 0 - 18 MB | NPU | Use Export Script |
52
- | SAMEncoder | float | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | TFLITE | 436.151 ms | 33 - 58 MB | NPU | [MobileSam.tflite](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.tflite) |
53
- | SAMEncoder | float | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | QNN | 268.611 ms | 4 - 6 MB | NPU | Use Export Script |
54
- | SAMEncoder | float | SA8775P ADP | Qualcomm® SA8775P | TFLITE | 420.623 ms | 33 - 166 MB | NPU | [MobileSam.tflite](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.tflite) |
55
- | SAMEncoder | float | SA8775P ADP | Qualcomm® SA8775P | QNN | 274.994 ms | 1 - 15 MB | NPU | Use Export Script |
56
- | SAMEncoder | float | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | TFLITE | 427.162 ms | 33 - 60 MB | NPU | [MobileSam.tflite](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.tflite) |
57
- | SAMEncoder | float | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | QNN | 268.541 ms | 12 - 82 MB | NPU | Use Export Script |
58
- | SAMEncoder | float | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | ONNX | 385.43 ms | 79 - 137 MB | NPU | [MobileSam.onnx](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.onnx) |
59
- | SAMEncoder | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | TFLITE | 339.111 ms | 26 - 149 MB | NPU | [MobileSam.tflite](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.tflite) |
60
- | SAMEncoder | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN | 201.973 ms | 12 - 619 MB | NPU | Use Export Script |
61
- | SAMEncoder | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | ONNX | 298.164 ms | 97 - 212 MB | NPU | [MobileSam.onnx](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.onnx) |
62
- | SAMEncoder | float | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | TFLITE | 237.268 ms | 33 - 167 MB | NPU | [MobileSam.tflite](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.tflite) |
63
- | SAMEncoder | float | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | QNN | 175.606 ms | 12 - 599 MB | NPU | Use Export Script |
64
- | SAMEncoder | float | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | ONNX | 227.732 ms | 78 - 207 MB | NPU | [MobileSam.onnx](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.onnx) |
65
- | SAMEncoder | float | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN | 274.786 ms | 12 - 12 MB | NPU | Use Export Script |
66
- | SAMEncoder | float | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 426.719 ms | 131 - 131 MB | NPU | [MobileSam.onnx](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.onnx) |
67
- | SAMDecoder | float | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | TFLITE | 16.758 ms | 0 - 39 MB | NPU | [MobileSam.tflite](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.tflite) |
68
- | SAMDecoder | float | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | QNN | 13.94 ms | 0 - 9 MB | NPU | Use Export Script |
69
- | SAMDecoder | float | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | TFLITE | 8.86 ms | 0 - 40 MB | NPU | [MobileSam.tflite](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.tflite) |
70
- | SAMDecoder | float | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | QNN | 8.795 ms | 4 - 49 MB | NPU | Use Export Script |
71
- | SAMDecoder | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | TFLITE | 7.372 ms | 0 - 29 MB | NPU | [MobileSam.tflite](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.tflite) |
72
- | SAMDecoder | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | QNN | 6.219 ms | 4 - 15 MB | NPU | Use Export Script |
73
- | SAMDecoder | float | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | TFLITE | 8.594 ms | 0 - 42 MB | NPU | [MobileSam.tflite](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.tflite) |
74
- | SAMDecoder | float | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | QNN | 7.344 ms | 3 - 17 MB | NPU | Use Export Script |
75
- | SAMDecoder | float | SA7255P ADP | Qualcomm® SA7255P | TFLITE | 16.758 ms | 0 - 39 MB | NPU | [MobileSam.tflite](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.tflite) |
76
- | SAMDecoder | float | SA7255P ADP | Qualcomm® SA7255P | QNN | 13.94 ms | 0 - 9 MB | NPU | Use Export Script |
77
- | SAMDecoder | float | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | TFLITE | 7.425 ms | 0 - 28 MB | NPU | [MobileSam.tflite](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.tflite) |
78
- | SAMDecoder | float | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | QNN | 6.176 ms | 2 - 4 MB | NPU | Use Export Script |
79
- | SAMDecoder | float | SA8295P ADP | Qualcomm® SA8295P | TFLITE | 9.892 ms | 0 - 37 MB | NPU | [MobileSam.tflite](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.tflite) |
80
- | SAMDecoder | float | SA8295P ADP | Qualcomm® SA8295P | QNN | 7.428 ms | 0 - 18 MB | NPU | Use Export Script |
81
- | SAMDecoder | float | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | TFLITE | 7.341 ms | 0 - 32 MB | NPU | [MobileSam.tflite](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.tflite) |
82
- | SAMDecoder | float | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | QNN | 6.159 ms | 4 - 6 MB | NPU | Use Export Script |
83
- | SAMDecoder | float | SA8775P ADP | Qualcomm® SA8775P | TFLITE | 8.594 ms | 0 - 42 MB | NPU | [MobileSam.tflite](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.tflite) |
84
- | SAMDecoder | float | SA8775P ADP | Qualcomm® SA8775P | QNN | 7.344 ms | 3 - 17 MB | NPU | Use Export Script |
85
- | SAMDecoder | float | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | TFLITE | 7.4 ms | 0 - 33 MB | NPU | [MobileSam.tflite](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.tflite) |
86
- | SAMDecoder | float | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | QNN | 6.14 ms | 4 - 23 MB | NPU | Use Export Script |
87
- | SAMDecoder | float | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | ONNX | 8.837 ms | 1 - 66 MB | NPU | [MobileSam.onnx](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.onnx) |
88
- | SAMDecoder | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | TFLITE | 5.16 ms | 0 - 49 MB | NPU | [MobileSam.tflite](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.tflite) |
89
- | SAMDecoder | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN | 4.148 ms | 4 - 49 MB | NPU | Use Export Script |
90
- | SAMDecoder | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | ONNX | 5.948 ms | 6 - 72 MB | NPU | [MobileSam.onnx](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.onnx) |
91
- | SAMDecoder | float | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | TFLITE | 5.022 ms | 0 - 42 MB | NPU | [MobileSam.tflite](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.tflite) |
92
- | SAMDecoder | float | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | QNN | 3.123 ms | 4 - 43 MB | NPU | Use Export Script |
93
- | SAMDecoder | float | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | ONNX | 5.458 ms | 0 - 58 MB | NPU | [MobileSam.onnx](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.onnx) |
94
- | SAMDecoder | float | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN | 6.669 ms | 4 - 4 MB | NPU | Use Export Script |
95
- | SAMDecoder | float | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 10.0 ms | 11 - 11 MB | NPU | [MobileSam.onnx](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.onnx) |
96
 
97
 
98
 
@@ -156,8 +154,8 @@ Profiling Results
156
  SAMEncoder
157
  Device : cs_8275 (ANDROID 14)
158
  Runtime : TFLITE
159
- Estimated inference time (ms) : 806.0
160
- Estimated peak memory usage (MB): [33, 165]
161
  Total # Ops : 592
162
  Compute Unit(s) : npu (532 ops) gpu (0 ops) cpu (60 ops)
163
 
@@ -165,10 +163,10 @@ Compute Unit(s) : npu (532 ops) gpu (0 ops) cpu (60 ops)
165
  SAMDecoder
166
  Device : cs_8275 (ANDROID 14)
167
  Runtime : TFLITE
168
- Estimated inference time (ms) : 16.8
169
- Estimated peak memory usage (MB): [0, 39]
170
- Total # Ops : 845
171
- Compute Unit(s) : npu (845 ops) gpu (0 ops) cpu (0 ops)
172
  ```
173
 
174
 
@@ -255,13 +253,13 @@ AI Hub. [Sign up for access](https://myaccount.qualcomm.com/signup).
255
  You can also run the demo on-device.
256
 
257
  ```bash
258
- python -m qai_hub_models.models.mobilesam.demo --on-device
259
  ```
260
 
261
  **NOTE**: If you want running in a Jupyter Notebook or Google Colab like
262
  environment, please add the following to your cell (instead of the above).
263
  ```
264
- %run -m qai_hub_models.models.mobilesam.demo -- --on-device
265
  ```
266
 
267
 
 
35
 
36
  | Model | Precision | Device | Chipset | Target Runtime | Inference Time (ms) | Peak Memory Range (MB) | Primary Compute Unit | Target Model
37
  |---|---|---|---|---|---|---|---|---|
38
+ | SAMEncoder | float | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | TFLITE | 1242.255 ms | 33 - 377 MB | NPU | [MobileSam.tflite](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.tflite) |
39
+ | SAMEncoder | float | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | QNN | 1006.865 ms | 4 - 13 MB | NPU | Use Export Script |
40
+ | SAMEncoder | float | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | TFLITE | 591.137 ms | 33 - 730 MB | NPU | [MobileSam.tflite](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.tflite) |
41
+ | SAMEncoder | float | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | QNN | 489.819 ms | 15 - 623 MB | NPU | Use Export Script |
42
+ | SAMEncoder | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | TFLITE | 429.812 ms | 21 - 47 MB | NPU | [MobileSam.tflite](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.tflite) |
43
+ | SAMEncoder | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | QNN | 274.837 ms | 12 - 14 MB | NPU | Use Export Script |
44
+ | SAMEncoder | float | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | TFLITE | 424.245 ms | 33 - 380 MB | NPU | [MobileSam.tflite](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.tflite) |
45
+ | SAMEncoder | float | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | QNN | 279.142 ms | 0 - 11 MB | NPU | Use Export Script |
46
+ | SAMEncoder | float | SA7255P ADP | Qualcomm® SA7255P | TFLITE | 1242.255 ms | 33 - 377 MB | NPU | [MobileSam.tflite](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.tflite) |
47
+ | SAMEncoder | float | SA7255P ADP | Qualcomm® SA7255P | QNN | 1006.865 ms | 4 - 13 MB | NPU | Use Export Script |
48
+ | SAMEncoder | float | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | TFLITE | 438.945 ms | 33 - 63 MB | NPU | [MobileSam.tflite](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.tflite) |
49
+ | SAMEncoder | float | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | QNN | 274.665 ms | 12 - 14 MB | NPU | Use Export Script |
50
+ | SAMEncoder | float | SA8295P ADP | Qualcomm® SA8295P | TFLITE | 585.38 ms | 33 - 382 MB | NPU | [MobileSam.tflite](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.tflite) |
51
+ | SAMEncoder | float | SA8295P ADP | Qualcomm® SA8295P | QNN | 437.657 ms | 0 - 16 MB | NPU | Use Export Script |
52
+ | SAMEncoder | float | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | TFLITE | 434.96 ms | 33 - 58 MB | NPU | [MobileSam.tflite](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.tflite) |
53
+ | SAMEncoder | float | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | QNN | 274.743 ms | 12 - 14 MB | NPU | Use Export Script |
54
+ | SAMEncoder | float | SA8775P ADP | Qualcomm® SA8775P | TFLITE | 424.245 ms | 33 - 380 MB | NPU | [MobileSam.tflite](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.tflite) |
55
+ | SAMEncoder | float | SA8775P ADP | Qualcomm® SA8775P | QNN | 279.142 ms | 0 - 11 MB | NPU | Use Export Script |
56
+ | SAMEncoder | float | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | TFLITE | 447.282 ms | 33 - 65 MB | NPU | [MobileSam.tflite](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.tflite) |
57
+ | SAMEncoder | float | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | QNN | 273.574 ms | 12 - 87 MB | NPU | Use Export Script |
58
+ | SAMEncoder | float | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | ONNX | 410.209 ms | 60 - 147 MB | NPU | [MobileSam.onnx](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.onnx) |
59
+ | SAMEncoder | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | TFLITE | 334.716 ms | 33 - 724 MB | NPU | [MobileSam.tflite](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.tflite) |
60
+ | SAMEncoder | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN | 205.413 ms | 12 - 2429 MB | NPU | Use Export Script |
61
+ | SAMEncoder | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | ONNX | 310.435 ms | 98 - 821 MB | NPU | [MobileSam.onnx](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.onnx) |
62
+ | SAMEncoder | float | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | QNN | 173.559 ms | 12 - 1181 MB | NPU | Use Export Script |
63
+ | SAMEncoder | float | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | ONNX | 265.591 ms | 99 - 502 MB | NPU | [MobileSam.onnx](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.onnx) |
64
+ | SAMEncoder | float | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN | 279.386 ms | 12 - 12 MB | NPU | Use Export Script |
65
+ | SAMEncoder | float | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 424.572 ms | 130 - 130 MB | NPU | [MobileSam.onnx](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.onnx) |
66
+ | SAMDecoder | float | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | TFLITE | 52.985 ms | 0 - 54 MB | NPU | [MobileSam.tflite](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.tflite) |
67
+ | SAMDecoder | float | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | QNN | 48.324 ms | 4 - 13 MB | NPU | Use Export Script |
68
+ | SAMDecoder | float | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | TFLITE | 8.298 ms | 0 - 58 MB | NPU | [MobileSam.tflite](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.tflite) |
69
+ | SAMDecoder | float | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | QNN | 8.517 ms | 4 - 54 MB | NPU | Use Export Script |
70
+ | SAMDecoder | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | TFLITE | 7.286 ms | 0 - 29 MB | NPU | [MobileSam.tflite](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.tflite) |
71
+ | SAMDecoder | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | QNN | 6.146 ms | 4 - 6 MB | NPU | Use Export Script |
72
+ | SAMDecoder | float | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | TFLITE | 8.453 ms | 0 - 55 MB | NPU | [MobileSam.tflite](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.tflite) |
73
+ | SAMDecoder | float | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | QNN | 7.099 ms | 1 - 13 MB | NPU | Use Export Script |
74
+ | SAMDecoder | float | SA7255P ADP | Qualcomm® SA7255P | TFLITE | 52.985 ms | 0 - 54 MB | NPU | [MobileSam.tflite](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.tflite) |
75
+ | SAMDecoder | float | SA7255P ADP | Qualcomm® SA7255P | QNN | 48.324 ms | 4 - 13 MB | NPU | Use Export Script |
76
+ | SAMDecoder | float | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | TFLITE | 7.307 ms | 0 - 31 MB | NPU | [MobileSam.tflite](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.tflite) |
77
+ | SAMDecoder | float | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | QNN | 6.068 ms | 4 - 6 MB | NPU | Use Export Script |
78
+ | SAMDecoder | float | SA8295P ADP | Qualcomm® SA8295P | TFLITE | 9.681 ms | 0 - 51 MB | NPU | [MobileSam.tflite](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.tflite) |
79
+ | SAMDecoder | float | SA8295P ADP | Qualcomm® SA8295P | QNN | 7.557 ms | 0 - 17 MB | NPU | Use Export Script |
80
+ | SAMDecoder | float | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | TFLITE | 7.292 ms | 0 - 29 MB | NPU | [MobileSam.tflite](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.tflite) |
81
+ | SAMDecoder | float | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | QNN | 6.127 ms | 4 - 8 MB | NPU | Use Export Script |
82
+ | SAMDecoder | float | SA8775P ADP | Qualcomm® SA8775P | TFLITE | 8.453 ms | 0 - 55 MB | NPU | [MobileSam.tflite](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.tflite) |
83
+ | SAMDecoder | float | SA8775P ADP | Qualcomm® SA8775P | QNN | 7.099 ms | 1 - 13 MB | NPU | Use Export Script |
84
+ | SAMDecoder | float | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | TFLITE | 7.292 ms | 0 - 29 MB | NPU | [MobileSam.tflite](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.tflite) |
85
+ | SAMDecoder | float | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | QNN | 6.076 ms | 4 - 20 MB | NPU | Use Export Script |
86
+ | SAMDecoder | float | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | ONNX | 9.215 ms | 1 - 63 MB | NPU | [MobileSam.onnx](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.onnx) |
87
+ | SAMDecoder | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | TFLITE | 5.057 ms | 0 - 63 MB | NPU | [MobileSam.tflite](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.tflite) |
88
+ | SAMDecoder | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN | 4.088 ms | 4 - 55 MB | NPU | Use Export Script |
89
+ | SAMDecoder | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | ONNX | 5.91 ms | 5 - 75 MB | NPU | [MobileSam.onnx](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.onnx) |
90
+ | SAMDecoder | float | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | QNN | 3.727 ms | 4 - 49 MB | NPU | Use Export Script |
91
+ | SAMDecoder | float | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | ONNX | 4.526 ms | 0 - 61 MB | NPU | [MobileSam.onnx](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.onnx) |
92
+ | SAMDecoder | float | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN | 6.531 ms | 4 - 4 MB | NPU | Use Export Script |
93
+ | SAMDecoder | float | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 10.187 ms | 12 - 12 MB | NPU | [MobileSam.onnx](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.onnx) |
 
 
94
 
95
 
96
 
 
154
  SAMEncoder
155
  Device : cs_8275 (ANDROID 14)
156
  Runtime : TFLITE
157
+ Estimated inference time (ms) : 1242.3
158
+ Estimated peak memory usage (MB): [33, 377]
159
  Total # Ops : 592
160
  Compute Unit(s) : npu (532 ops) gpu (0 ops) cpu (60 ops)
161
 
 
163
  SAMDecoder
164
  Device : cs_8275 (ANDROID 14)
165
  Runtime : TFLITE
166
+ Estimated inference time (ms) : 53.0
167
+ Estimated peak memory usage (MB): [0, 54]
168
+ Total # Ops : 846
169
+ Compute Unit(s) : npu (846 ops) gpu (0 ops) cpu (0 ops)
170
  ```
171
 
172
 
 
253
  You can also run the demo on-device.
254
 
255
  ```bash
256
+ python -m qai_hub_models.models.mobilesam.demo --eval-mode on-device
257
  ```
258
 
259
  **NOTE**: If you want running in a Jupyter Notebook or Google Colab like
260
  environment, please add the following to your cell (instead of the above).
261
  ```
262
+ %run -m qai_hub_models.models.mobilesam.demo -- --eval-mode on-device
263
  ```
264
 
265