qaihm-bot commited on
Commit
08105fb
·
verified ·
1 Parent(s): 64ba0be

See https://github.com/quic/ai-hub-models/releases/v0.32.0 for changelog.

.gitattributes CHANGED
@@ -37,3 +37,4 @@ SAMEncoder.so filter=lfs diff=lfs merge=lfs -text
37
  SAMDecoder.so filter=lfs diff=lfs merge=lfs -text
38
  MobileSam_SAMDecoder.dlc filter=lfs diff=lfs merge=lfs -text
39
  MobileSam_SAMEncoder.dlc filter=lfs diff=lfs merge=lfs -text
 
 
37
  SAMDecoder.so filter=lfs diff=lfs merge=lfs -text
38
  MobileSam_SAMDecoder.dlc filter=lfs diff=lfs merge=lfs -text
39
  MobileSam_SAMEncoder.dlc filter=lfs diff=lfs merge=lfs -text
40
+ DEPLOYMENT_MODEL_LICENSE.pdf filter=lfs diff=lfs merge=lfs -text
DEPLOYMENT_MODEL_LICENSE.pdf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4409f93b0e82531303b3e10f52f1fdfb56467a25f05b7441c6bbd8bb8a64b42c
3
+ size 109629
LICENSE ADDED
@@ -0,0 +1,2 @@
 
 
 
1
+ The license of the original trained model can be found at https://github.com/facebookresearch/segment-anything/blob/main/LICENSE.
2
+ The license for the deployable model files (.tflite, .onnx, .dlc, .bin, etc.) can be found in DEPLOYMENT_MODEL_LICENSE.pdf.
MobileSam_SAMDecoder.onnx CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:e17f2338f85e4c03b3ec10c922eea9df9ae50511555d721c423bb6e4dc606504
3
- size 24992789
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:09861cb72eaf9955a22ccf0a82cfc35f0878eb864fffe32ec1b34bc0eda59c56
3
+ size 25034638
MobileSam_SAMEncoder.onnx CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:f4e6fe33005851961f9d6b9f8edbd319d8d54e3bf79913b0bdacdb66d4c61a92
3
- size 27932759
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:26664f4c6706b3bcf30d9dda868609eff3f85649a229139c133518e60cf91395
3
+ size 27945151
README.md CHANGED
@@ -30,8 +30,10 @@ More details on model performance across various devices, can be found
30
  - **Model Stats:**
31
  - Model checkpoint: vit_t
32
  - Input resolution: 720p (720x1280)
33
- - Number of parameters (MobileSamDecoder): 3.876M
34
- - Model size (MobileSamDecoder): 19.6 MB
 
 
35
 
36
  | Model | Precision | Device | Chipset | Target Runtime | Inference Time (ms) | Peak Memory Range (MB) | Primary Compute Unit | Target Model
37
  |---|---|---|---|---|---|---|---|---|
@@ -55,15 +57,15 @@ More details on model performance across various devices, can be found
55
  | SAMEncoder | float | SA8775P ADP | Qualcomm® SA8775P | QNN_DLC | 277.611 ms | 1 - 1161 MB | NPU | [MobileSam.dlc](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.dlc) |
56
  | SAMEncoder | float | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | TFLITE | 443.612 ms | 25 - 58 MB | NPU | [MobileSam.tflite](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.tflite) |
57
  | SAMEncoder | float | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | QNN_DLC | 272.764 ms | 12 - 74 MB | NPU | [MobileSam.dlc](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.dlc) |
58
- | SAMEncoder | float | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | ONNX | 417.326 ms | 80 - 166 MB | NPU | [MobileSam.onnx](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.onnx) |
59
  | SAMEncoder | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | TFLITE | 339.38 ms | 33 - 712 MB | NPU | [MobileSam.tflite](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.tflite) |
60
  | SAMEncoder | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN_DLC | 206.041 ms | 12 - 2423 MB | NPU | [MobileSam.dlc](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.dlc) |
61
- | SAMEncoder | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | ONNX | 315.956 ms | 97 - 824 MB | NPU | [MobileSam.onnx](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.onnx) |
62
  | SAMEncoder | float | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | TFLITE | 236.15 ms | 31 - 378 MB | NPU | [MobileSam.tflite](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.tflite) |
63
  | SAMEncoder | float | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | QNN_DLC | 173.015 ms | 12 - 1181 MB | NPU | [MobileSam.dlc](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.dlc) |
64
- | SAMEncoder | float | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | ONNX | 266.659 ms | 97 - 501 MB | NPU | [MobileSam.onnx](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.onnx) |
65
  | SAMEncoder | float | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN_DLC | 298.206 ms | 85 - 85 MB | NPU | [MobileSam.dlc](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.dlc) |
66
- | SAMEncoder | float | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 464.538 ms | 130 - 130 MB | NPU | [MobileSam.onnx](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.onnx) |
67
  | SAMDecoder | float | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | TFLITE | 16.509 ms | 0 - 55 MB | NPU | [MobileSam.tflite](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.tflite) |
68
  | SAMDecoder | float | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | QNN_DLC | 13.893 ms | 4 - 47 MB | NPU | [MobileSam.dlc](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.dlc) |
69
  | SAMDecoder | float | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | TFLITE | 8.268 ms | 0 - 55 MB | NPU | [MobileSam.tflite](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.tflite) |
@@ -84,15 +86,15 @@ More details on model performance across various devices, can be found
84
  | SAMDecoder | float | SA8775P ADP | Qualcomm® SA8775P | QNN_DLC | 7.283 ms | 1 - 44 MB | NPU | [MobileSam.dlc](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.dlc) |
85
  | SAMDecoder | float | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | TFLITE | 7.277 ms | 0 - 31 MB | NPU | [MobileSam.tflite](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.tflite) |
86
  | SAMDecoder | float | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | QNN_DLC | 6.101 ms | 4 - 24 MB | NPU | [MobileSam.dlc](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.dlc) |
87
- | SAMDecoder | float | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | ONNX | 9.409 ms | 1 - 62 MB | NPU | [MobileSam.onnx](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.onnx) |
88
  | SAMDecoder | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | TFLITE | 5.104 ms | 0 - 61 MB | NPU | [MobileSam.tflite](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.tflite) |
89
  | SAMDecoder | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN_DLC | 4.201 ms | 0 - 55 MB | NPU | [MobileSam.dlc](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.dlc) |
90
- | SAMDecoder | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | ONNX | 5.975 ms | 0 - 76 MB | NPU | [MobileSam.onnx](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.onnx) |
91
  | SAMDecoder | float | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | TFLITE | 5.075 ms | 0 - 57 MB | NPU | [MobileSam.tflite](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.tflite) |
92
  | SAMDecoder | float | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | QNN_DLC | 3.695 ms | 4 - 55 MB | NPU | [MobileSam.dlc](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.dlc) |
93
- | SAMDecoder | float | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | ONNX | 5.382 ms | 0 - 61 MB | NPU | [MobileSam.onnx](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.onnx) |
94
  | SAMDecoder | float | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN_DLC | 7.965 ms | 4 - 4 MB | NPU | [MobileSam.dlc](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.dlc) |
95
- | SAMDecoder | float | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 10.122 ms | 11 - 11 MB | NPU | [MobileSam.onnx](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.onnx) |
96
 
97
 
98
 
 
30
  - **Model Stats:**
31
  - Model checkpoint: vit_t
32
  - Input resolution: 720p (720x1280)
33
+ - Number of parameters (SAMEncoder): 6.95M
34
+ - Model size (SAMEncoder) (float): 26.6 MB
35
+ - Number of parameters (SAMDecoder): 6.16M
36
+ - Model size (SAMDecoder) (float): 23.7 MB
37
 
38
  | Model | Precision | Device | Chipset | Target Runtime | Inference Time (ms) | Peak Memory Range (MB) | Primary Compute Unit | Target Model
39
  |---|---|---|---|---|---|---|---|---|
 
57
  | SAMEncoder | float | SA8775P ADP | Qualcomm® SA8775P | QNN_DLC | 277.611 ms | 1 - 1161 MB | NPU | [MobileSam.dlc](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.dlc) |
58
  | SAMEncoder | float | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | TFLITE | 443.612 ms | 25 - 58 MB | NPU | [MobileSam.tflite](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.tflite) |
59
  | SAMEncoder | float | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | QNN_DLC | 272.764 ms | 12 - 74 MB | NPU | [MobileSam.dlc](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.dlc) |
60
+ | SAMEncoder | float | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | ONNX | 417.653 ms | 95 - 152 MB | NPU | [MobileSam.onnx](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.onnx) |
61
  | SAMEncoder | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | TFLITE | 339.38 ms | 33 - 712 MB | NPU | [MobileSam.tflite](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.tflite) |
62
  | SAMEncoder | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN_DLC | 206.041 ms | 12 - 2423 MB | NPU | [MobileSam.dlc](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.dlc) |
63
+ | SAMEncoder | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | ONNX | 303.821 ms | 97 - 827 MB | NPU | [MobileSam.onnx](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.onnx) |
64
  | SAMEncoder | float | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | TFLITE | 236.15 ms | 31 - 378 MB | NPU | [MobileSam.tflite](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.tflite) |
65
  | SAMEncoder | float | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | QNN_DLC | 173.015 ms | 12 - 1181 MB | NPU | [MobileSam.dlc](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.dlc) |
66
+ | SAMEncoder | float | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | ONNX | 255.315 ms | 99 - 502 MB | NPU | [MobileSam.onnx](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.onnx) |
67
  | SAMEncoder | float | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN_DLC | 298.206 ms | 85 - 85 MB | NPU | [MobileSam.dlc](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.dlc) |
68
+ | SAMEncoder | float | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 436.531 ms | 131 - 131 MB | NPU | [MobileSam.onnx](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.onnx) |
69
  | SAMDecoder | float | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | TFLITE | 16.509 ms | 0 - 55 MB | NPU | [MobileSam.tflite](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.tflite) |
70
  | SAMDecoder | float | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | QNN_DLC | 13.893 ms | 4 - 47 MB | NPU | [MobileSam.dlc](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.dlc) |
71
  | SAMDecoder | float | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | TFLITE | 8.268 ms | 0 - 55 MB | NPU | [MobileSam.tflite](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.tflite) |
 
86
  | SAMDecoder | float | SA8775P ADP | Qualcomm® SA8775P | QNN_DLC | 7.283 ms | 1 - 44 MB | NPU | [MobileSam.dlc](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.dlc) |
87
  | SAMDecoder | float | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | TFLITE | 7.277 ms | 0 - 31 MB | NPU | [MobileSam.tflite](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.tflite) |
88
  | SAMDecoder | float | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | QNN_DLC | 6.101 ms | 4 - 24 MB | NPU | [MobileSam.dlc](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.dlc) |
89
+ | SAMDecoder | float | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | ONNX | 9.654 ms | 1 - 66 MB | NPU | [MobileSam.onnx](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.onnx) |
90
  | SAMDecoder | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | TFLITE | 5.104 ms | 0 - 61 MB | NPU | [MobileSam.tflite](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.tflite) |
91
  | SAMDecoder | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN_DLC | 4.201 ms | 0 - 55 MB | NPU | [MobileSam.dlc](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.dlc) |
92
+ | SAMDecoder | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | ONNX | 6.1 ms | 4 - 75 MB | NPU | [MobileSam.onnx](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.onnx) |
93
  | SAMDecoder | float | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | TFLITE | 5.075 ms | 0 - 57 MB | NPU | [MobileSam.tflite](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.tflite) |
94
  | SAMDecoder | float | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | QNN_DLC | 3.695 ms | 4 - 55 MB | NPU | [MobileSam.dlc](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.dlc) |
95
+ | SAMDecoder | float | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | ONNX | 5.362 ms | 4 - 65 MB | NPU | [MobileSam.onnx](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.onnx) |
96
  | SAMDecoder | float | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN_DLC | 7.965 ms | 4 - 4 MB | NPU | [MobileSam.dlc](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.dlc) |
97
+ | SAMDecoder | float | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 10.148 ms | 11 - 11 MB | NPU | [MobileSam.onnx](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.onnx) |
98
 
99
 
100