Hugging Face's logo

qualcomm
/
Segment-Anything-Model

Image Segmentation
PyTorch
LiteRT
ONNX
foundation
android
Model card Files Community
bhushans commited on
Commit
8c93b19
·
verified ·
1 Parent(s): 5ca384d

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +26 -25
README.md CHANGED
@@ -35,24 +35,24 @@ More details on model performance across various devices, can be found
35
 
36
  | Model | Device | Chipset | Target Runtime | Inference Time (ms) | Peak Memory Range (MB) | Precision | Primary Compute Unit | Target Model
37
  |---|---|---|---|---|---|---|---|---|
38
- | SAMDecoder | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 | TFLITE | 28.971 ms | 4 - 21 MB | FP16 | NPU | [Segment-Anything-Model.tflite](https://huggingface.co/qualcomm/Segment-Anything-Model/blob/main/SAMDecoder.tflite) |
39
- | SAMDecoder | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 | TFLITE | 20.306 ms | 2 - 231 MB | FP16 | NPU | [Segment-Anything-Model.tflite](https://huggingface.co/qualcomm/Segment-Anything-Model/blob/main/SAMDecoder.tflite) |
40
- | SAMDecoder | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite | TFLITE | 16.82 ms | 3 - 163 MB | FP16 | NPU | [Segment-Anything-Model.tflite](https://huggingface.co/qualcomm/Segment-Anything-Model/blob/main/SAMDecoder.tflite) |
41
- | SAMDecoder | QCS8550 (Proxy) | QCS8550 Proxy | TFLITE | 29.1 ms | 4 - 12 MB | FP16 | NPU | [Segment-Anything-Model.tflite](https://huggingface.co/qualcomm/Segment-Anything-Model/blob/main/SAMDecoder.tflite) |
42
- | SAMDecoder | SA8255 (Proxy) | SA8255P Proxy | TFLITE | 28.998 ms | 4 - 12 MB | FP16 | NPU | [Segment-Anything-Model.tflite](https://huggingface.co/qualcomm/Segment-Anything-Model/blob/main/SAMDecoder.tflite) |
43
- | SAMDecoder | SA8775 (Proxy) | SA8775P Proxy | TFLITE | 28.935 ms | 4 - 12 MB | FP16 | NPU | [Segment-Anything-Model.tflite](https://huggingface.co/qualcomm/Segment-Anything-Model/blob/main/SAMDecoder.tflite) |
44
- | SAMDecoder | SA8650 (Proxy) | SA8650P Proxy | TFLITE | 29.074 ms | 4 - 12 MB | FP16 | NPU | [Segment-Anything-Model.tflite](https://huggingface.co/qualcomm/Segment-Anything-Model/blob/main/SAMDecoder.tflite) |
45
- | SAMDecoder | SA8295P ADP | SA8295P | TFLITE | 36.287 ms | 4 - 157 MB | FP16 | NPU | [Segment-Anything-Model.tflite](https://huggingface.co/qualcomm/Segment-Anything-Model/blob/main/SAMDecoder.tflite) |
46
- | SAMDecoder | QCS8450 (Proxy) | QCS8450 Proxy | TFLITE | 32.956 ms | 5 - 224 MB | FP16 | NPU | [Segment-Anything-Model.tflite](https://huggingface.co/qualcomm/Segment-Anything-Model/blob/main/SAMDecoder.tflite) |
47
- | SAMEncoder | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 | TFLITE | 11666.822 ms | 123 - 128 MB | FP32 | CPU | [Segment-Anything-Model.tflite](https://huggingface.co/qualcomm/Segment-Anything-Model/blob/main/SAMEncoder.tflite) |
48
- | SAMEncoder | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 | TFLITE | 9304.036 ms | 123 - 1632 MB | FP32 | CPU | [Segment-Anything-Model.tflite](https://huggingface.co/qualcomm/Segment-Anything-Model/blob/main/SAMEncoder.tflite) |
49
- | SAMEncoder | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite | TFLITE | 6695.328 ms | 98 - 1575 MB | FP32 | CPU | [Segment-Anything-Model.tflite](https://huggingface.co/qualcomm/Segment-Anything-Model/blob/main/SAMEncoder.tflite) |
50
- | SAMEncoder | QCS8550 (Proxy) | QCS8550 Proxy | TFLITE | 11003.431 ms | 123 - 127 MB | FP32 | CPU | [Segment-Anything-Model.tflite](https://huggingface.co/qualcomm/Segment-Anything-Model/blob/main/SAMEncoder.tflite) |
51
- | SAMEncoder | SA8255 (Proxy) | SA8255P Proxy | TFLITE | 10520.745 ms | 123 - 127 MB | FP32 | CPU | [Segment-Anything-Model.tflite](https://huggingface.co/qualcomm/Segment-Anything-Model/blob/main/SAMEncoder.tflite) |
52
- | SAMEncoder | SA8775 (Proxy) | SA8775P Proxy | TFLITE | 10821.202 ms | 123 - 127 MB | FP32 | CPU | [Segment-Anything-Model.tflite](https://huggingface.co/qualcomm/Segment-Anything-Model/blob/main/SAMEncoder.tflite) |
53
- | SAMEncoder | SA8650 (Proxy) | SA8650P Proxy | TFLITE | 10167.032 ms | 41 - 132 MB | FP32 | CPU | [Segment-Anything-Model.tflite](https://huggingface.co/qualcomm/Segment-Anything-Model/blob/main/SAMEncoder.tflite) |
54
- | SAMEncoder | SA8295P ADP | SA8295P | TFLITE | 10764.145 ms | 124 - 1646 MB | FP32 | CPU | [Segment-Anything-Model.tflite](https://huggingface.co/qualcomm/Segment-Anything-Model/blob/main/SAMEncoder.tflite) |
55
- | SAMEncoder | QCS8450 (Proxy) | QCS8450 Proxy | TFLITE | 13901.352 ms | 132 - 1695 MB | FP32 | CPU | [Segment-Anything-Model.tflite](https://huggingface.co/qualcomm/Segment-Anything-Model/blob/main/SAMEncoder.tflite) |
56
 
57
 
58
 
@@ -117,8 +117,8 @@ Profiling Results
117
  SAMDecoder
118
  Device : Samsung Galaxy S23 (13)
119
  Runtime : TFLITE
120
- Estimated inference time (ms) : 29.0
121
- Estimated peak memory usage (MB): [4, 21]
122
  Total # Ops : 337
123
  Compute Unit(s) : NPU (337 ops)
124
 
@@ -126,8 +126,8 @@ Compute Unit(s) : NPU (337 ops)
126
  SAMEncoder
127
  Device : Samsung Galaxy S23 (13)
128
  Runtime : TFLITE
129
- Estimated inference time (ms) : 11666.8
130
- Estimated peak memory usage (MB): [123, 128]
131
  Total # Ops : 818
132
  Compute Unit(s) : GPU (36 ops) CPU (782 ops)
133
  ```
@@ -148,11 +148,12 @@ in memory using the `jit.trace` and then call the `submit_compile_job` API.
148
  import torch
149
 
150
  import qai_hub as hub
151
- from qai_hub_models.models.sam import SAMDecoder,SAMEncoder
152
 
153
  # Load the model
154
- get_sam_decoder()_model = SAMDecoder.from_pretrained()
155
- get_sam_encoder()_model = SAMEncoder.from_pretrained()
 
156
 
157
  # Device
158
  device = hub.Device("Samsung Galaxy S23")
 
35
 
36
  | Model | Device | Chipset | Target Runtime | Inference Time (ms) | Peak Memory Range (MB) | Precision | Primary Compute Unit | Target Model
37
  |---|---|---|---|---|---|---|---|---|
38
+ | SAMDecoder | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 | TFLITE | 29.311 ms | 4 - 40 MB | FP16 | NPU | [Segment-Anything-Model.tflite](https://huggingface.co/qualcomm/Segment-Anything-Model/blob/main/SAMDecoder.tflite) |
39
+ | SAMDecoder | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 | TFLITE | 20.843 ms | 4 - 119 MB | FP16 | NPU | [Segment-Anything-Model.tflite](https://huggingface.co/qualcomm/Segment-Anything-Model/blob/main/SAMDecoder.tflite) |
40
+ | SAMDecoder | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite | TFLITE | 20.649 ms | 3 - 128 MB | FP16 | NPU | [Segment-Anything-Model.tflite](https://huggingface.co/qualcomm/Segment-Anything-Model/blob/main/SAMDecoder.tflite) |
41
+ | SAMDecoder | QCS8550 (Proxy) | QCS8550 Proxy | TFLITE | 29.453 ms | 4 - 41 MB | FP16 | NPU | [Segment-Anything-Model.tflite](https://huggingface.co/qualcomm/Segment-Anything-Model/blob/main/SAMDecoder.tflite) |
42
+ | SAMDecoder | SA8255 (Proxy) | SA8255P Proxy | TFLITE | 29.485 ms | 4 - 36 MB | FP16 | NPU | [Segment-Anything-Model.tflite](https://huggingface.co/qualcomm/Segment-Anything-Model/blob/main/SAMDecoder.tflite) |
43
+ | SAMDecoder | SA8295P ADP | SA8295P | TFLITE | 36.583 ms | 4 - 114 MB | FP16 | NPU | [Segment-Anything-Model.tflite](https://huggingface.co/qualcomm/Segment-Anything-Model/blob/main/SAMDecoder.tflite) |
44
+ | SAMDecoder | SA8650 (Proxy) | SA8650P Proxy | TFLITE | 29.064 ms | 4 - 37 MB | FP16 | NPU | [Segment-Anything-Model.tflite](https://huggingface.co/qualcomm/Segment-Anything-Model/blob/main/SAMDecoder.tflite) |
45
+ | SAMDecoder | QCS8450 (Proxy) | QCS8450 Proxy | TFLITE | 33.135 ms | 4 - 126 MB | FP16 | NPU | [Segment-Anything-Model.tflite](https://huggingface.co/qualcomm/Segment-Anything-Model/blob/main/SAMDecoder.tflite) |
46
+ | SAMEncoder | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 | TFLITE | 10369.27 ms | 123 - 126 MB | FP32 | CPU | [Segment-Anything-Model.tflite](https://huggingface.co/qualcomm/Segment-Anything-Model/blob/main/SAMEncoder.tflite) |
47
+ | SAMEncoder | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 | TFLITE | 9136.859 ms | 91 - 1603 MB | FP32 | CPU | [Segment-Anything-Model.tflite](https://huggingface.co/qualcomm/Segment-Anything-Model/blob/main/SAMEncoder.tflite) |
48
+ | SAMEncoder | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite | TFLITE | 6694.41 ms | 110 - 1589 MB | FP32 | CPU | [Segment-Anything-Model.tflite](https://huggingface.co/qualcomm/Segment-Anything-Model/blob/main/SAMEncoder.tflite) |
49
+ | SAMEncoder | QCS8550 (Proxy) | QCS8550 Proxy | TFLITE | 10714.354 ms | 122 - 381 MB | FP32 | CPU | [Segment-Anything-Model.tflite](https://huggingface.co/qualcomm/Segment-Anything-Model/blob/main/SAMEncoder.tflite) |
50
+ | SAMEncoder | SA7255P ADP | SA7255P | TFLITE | 17192.024 ms | 125 - 1597 MB | FP32 | CPU | [Segment-Anything-Model.tflite](https://huggingface.co/qualcomm/Segment-Anything-Model/blob/main/SAMEncoder.tflite) |
51
+ | SAMEncoder | SA8255 (Proxy) | SA8255P Proxy | TFLITE | 11081.197 ms | 124 - 127 MB | FP32 | CPU | [Segment-Anything-Model.tflite](https://huggingface.co/qualcomm/Segment-Anything-Model/blob/main/SAMEncoder.tflite) |
52
+ | SAMEncoder | SA8295P ADP | SA8295P | TFLITE | 10359.771 ms | 124 - 1654 MB | FP32 | CPU | [Segment-Anything-Model.tflite](https://huggingface.co/qualcomm/Segment-Anything-Model/blob/main/SAMEncoder.tflite) |
53
+ | SAMEncoder | SA8650 (Proxy) | SA8650P Proxy | TFLITE | 10872.614 ms | 118 - 125 MB | FP32 | CPU | [Segment-Anything-Model.tflite](https://huggingface.co/qualcomm/Segment-Anything-Model/blob/main/SAMEncoder.tflite) |
54
+ | SAMEncoder | SA8775P ADP | SA8775P | TFLITE | 13361.634 ms | 124 - 1596 MB | FP32 | CPU | [Segment-Anything-Model.tflite](https://huggingface.co/qualcomm/Segment-Anything-Model/blob/main/SAMEncoder.tflite) |
55
+ | SAMEncoder | QCS8450 (Proxy) | QCS8450 Proxy | TFLITE | 16830.94 ms | 82 - 1648 MB | FP32 | CPU | [Segment-Anything-Model.tflite](https://huggingface.co/qualcomm/Segment-Anything-Model/blob/main/SAMEncoder.tflite) |
56
 
57
 
58
 
 
117
  SAMDecoder
118
  Device : Samsung Galaxy S23 (13)
119
  Runtime : TFLITE
120
+ Estimated inference time (ms) : 29.3
121
+ Estimated peak memory usage (MB): [4, 40]
122
  Total # Ops : 337
123
  Compute Unit(s) : NPU (337 ops)
124
 
 
126
  SAMEncoder
127
  Device : Samsung Galaxy S23 (13)
128
  Runtime : TFLITE
129
+ Estimated inference time (ms) : 10369.3
130
+ Estimated peak memory usage (MB): [123, 126]
131
  Total # Ops : 818
132
  Compute Unit(s) : GPU (36 ops) CPU (782 ops)
133
  ```
 
148
  import torch
149
 
150
  import qai_hub as hub
151
+ from qai_hub_models.models.sam import Model
152
 
153
  # Load the model
154
+ model = Model.from_pretrained()
155
+ get_sam_decoder()_model = model.get_sam_decoder()
156
+ get_sam_encoder()_model = model.get_sam_encoder()
157
 
158
  # Device
159
  device = hub.Device("Samsung Galaxy S23")