qaihm-bot commited on
Commit
dd6f939
·
verified ·
1 Parent(s): 5688b17

See https://github.com/quic/ai-hub-models/releases/v0.42.0 for changelog.

README.md CHANGED
@@ -37,71 +37,74 @@ More details on model performance across various devices, can be found
37
 
38
  | Model | Precision | Device | Chipset | Target Runtime | Inference Time (ms) | Peak Memory Range (MB) | Primary Compute Unit | Target Model
39
  |---|---|---|---|---|---|---|---|---|
40
- | ResNet101 | float | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | TFLITE | 18.466 ms | 0 - 93 MB | NPU | [ResNet101.tflite](https://huggingface.co/qualcomm/ResNet101/blob/main/ResNet101.tflite) |
41
- | ResNet101 | float | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | QNN_DLC | 18.278 ms | 1 - 43 MB | NPU | [ResNet101.dlc](https://huggingface.co/qualcomm/ResNet101/blob/main/ResNet101.dlc) |
42
- | ResNet101 | float | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | TFLITE | 4.693 ms | 0 - 97 MB | NPU | [ResNet101.tflite](https://huggingface.co/qualcomm/ResNet101/blob/main/ResNet101.tflite) |
43
- | ResNet101 | float | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | QNN_DLC | 5.836 ms | 1 - 37 MB | NPU | [ResNet101.dlc](https://huggingface.co/qualcomm/ResNet101/blob/main/ResNet101.dlc) |
44
- | ResNet101 | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | TFLITE | 3.376 ms | 0 - 16 MB | NPU | [ResNet101.tflite](https://huggingface.co/qualcomm/ResNet101/blob/main/ResNet101.tflite) |
45
- | ResNet101 | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | QNN_DLC | 3.283 ms | 1 - 14 MB | NPU | [ResNet101.dlc](https://huggingface.co/qualcomm/ResNet101/blob/main/ResNet101.dlc) |
46
- | ResNet101 | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | ONNX | 3.339 ms | 0 - 108 MB | NPU | [ResNet101.onnx.zip](https://huggingface.co/qualcomm/ResNet101/blob/main/ResNet101.onnx.zip) |
47
- | ResNet101 | float | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | TFLITE | 5.603 ms | 0 - 92 MB | NPU | [ResNet101.tflite](https://huggingface.co/qualcomm/ResNet101/blob/main/ResNet101.tflite) |
48
- | ResNet101 | float | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | QNN_DLC | 5.441 ms | 1 - 43 MB | NPU | [ResNet101.dlc](https://huggingface.co/qualcomm/ResNet101/blob/main/ResNet101.dlc) |
49
- | ResNet101 | float | SA7255P ADP | Qualcomm® SA7255P | TFLITE | 18.466 ms | 0 - 93 MB | NPU | [ResNet101.tflite](https://huggingface.co/qualcomm/ResNet101/blob/main/ResNet101.tflite) |
50
- | ResNet101 | float | SA7255P ADP | Qualcomm® SA7255P | QNN_DLC | 18.278 ms | 1 - 43 MB | NPU | [ResNet101.dlc](https://huggingface.co/qualcomm/ResNet101/blob/main/ResNet101.dlc) |
51
- | ResNet101 | float | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | TFLITE | 3.338 ms | 0 - 101 MB | NPU | [ResNet101.tflite](https://huggingface.co/qualcomm/ResNet101/blob/main/ResNet101.tflite) |
52
- | ResNet101 | float | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | QNN_DLC | 3.3 ms | 1 - 13 MB | NPU | [ResNet101.dlc](https://huggingface.co/qualcomm/ResNet101/blob/main/ResNet101.dlc) |
53
- | ResNet101 | float | SA8295P ADP | Qualcomm® SA8295P | TFLITE | 5.633 ms | 0 - 81 MB | NPU | [ResNet101.tflite](https://huggingface.co/qualcomm/ResNet101/blob/main/ResNet101.tflite) |
54
- | ResNet101 | float | SA8295P ADP | Qualcomm® SA8295P | QNN_DLC | 5.519 ms | 0 - 33 MB | NPU | [ResNet101.dlc](https://huggingface.co/qualcomm/ResNet101/blob/main/ResNet101.dlc) |
55
- | ResNet101 | float | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | TFLITE | 3.343 ms | 0 - 125 MB | NPU | [ResNet101.tflite](https://huggingface.co/qualcomm/ResNet101/blob/main/ResNet101.tflite) |
56
- | ResNet101 | float | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | QNN_DLC | 3.313 ms | 1 - 15 MB | NPU | [ResNet101.dlc](https://huggingface.co/qualcomm/ResNet101/blob/main/ResNet101.dlc) |
57
- | ResNet101 | float | SA8775P ADP | Qualcomm® SA8775P | TFLITE | 5.603 ms | 0 - 92 MB | NPU | [ResNet101.tflite](https://huggingface.co/qualcomm/ResNet101/blob/main/ResNet101.tflite) |
58
- | ResNet101 | float | SA8775P ADP | Qualcomm® SA8775P | QNN_DLC | 5.441 ms | 1 - 43 MB | NPU | [ResNet101.dlc](https://huggingface.co/qualcomm/ResNet101/blob/main/ResNet101.dlc) |
59
- | ResNet101 | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | TFLITE | 2.429 ms | 0 - 101 MB | NPU | [ResNet101.tflite](https://huggingface.co/qualcomm/ResNet101/blob/main/ResNet101.tflite) |
60
- | ResNet101 | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN_DLC | 2.383 ms | 1 - 51 MB | NPU | [ResNet101.dlc](https://huggingface.co/qualcomm/ResNet101/blob/main/ResNet101.dlc) |
61
- | ResNet101 | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | ONNX | 2.417 ms | 0 - 54 MB | NPU | [ResNet101.onnx.zip](https://huggingface.co/qualcomm/ResNet101/blob/main/ResNet101.onnx.zip) |
62
- | ResNet101 | float | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | TFLITE | 1.98 ms | 0 - 98 MB | NPU | [ResNet101.tflite](https://huggingface.co/qualcomm/ResNet101/blob/main/ResNet101.tflite) |
63
- | ResNet101 | float | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | QNN_DLC | 1.93 ms | 1 - 48 MB | NPU | [ResNet101.dlc](https://huggingface.co/qualcomm/ResNet101/blob/main/ResNet101.dlc) |
64
- | ResNet101 | float | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | ONNX | 2.024 ms | 0 - 44 MB | NPU | [ResNet101.onnx.zip](https://huggingface.co/qualcomm/ResNet101/blob/main/ResNet101.onnx.zip) |
65
- | ResNet101 | float | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | TFLITE | 1.718 ms | 0 - 93 MB | NPU | [ResNet101.tflite](https://huggingface.co/qualcomm/ResNet101/blob/main/ResNet101.tflite) |
66
- | ResNet101 | float | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | QNN_DLC | 1.653 ms | 1 - 49 MB | NPU | [ResNet101.dlc](https://huggingface.co/qualcomm/ResNet101/blob/main/ResNet101.dlc) |
67
- | ResNet101 | float | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | ONNX | 1.766 ms | 1 - 45 MB | NPU | [ResNet101.onnx.zip](https://huggingface.co/qualcomm/ResNet101/blob/main/ResNet101.onnx.zip) |
68
- | ResNet101 | float | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN_DLC | 3.49 ms | 270 - 270 MB | NPU | [ResNet101.dlc](https://huggingface.co/qualcomm/ResNet101/blob/main/ResNet101.dlc) |
69
- | ResNet101 | float | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 3.277 ms | 86 - 86 MB | NPU | [ResNet101.onnx.zip](https://huggingface.co/qualcomm/ResNet101/blob/main/ResNet101.onnx.zip) |
70
- | ResNet101 | w8a8 | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | TFLITE | 2.678 ms | 0 - 60 MB | NPU | [ResNet101.tflite](https://huggingface.co/qualcomm/ResNet101/blob/main/ResNet101_w8a8.tflite) |
71
- | ResNet101 | w8a8 | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | QNN_DLC | 2.925 ms | 0 - 62 MB | NPU | [ResNet101.dlc](https://huggingface.co/qualcomm/ResNet101/blob/main/ResNet101_w8a8.dlc) |
72
- | ResNet101 | w8a8 | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | TFLITE | 1.357 ms | 0 - 104 MB | NPU | [ResNet101.tflite](https://huggingface.co/qualcomm/ResNet101/blob/main/ResNet101_w8a8.tflite) |
73
- | ResNet101 | w8a8 | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | QNN_DLC | 1.835 ms | 0 - 93 MB | NPU | [ResNet101.dlc](https://huggingface.co/qualcomm/ResNet101/blob/main/ResNet101_w8a8.dlc) |
74
- | ResNet101 | w8a8 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | TFLITE | 1.151 ms | 0 - 229 MB | NPU | [ResNet101.tflite](https://huggingface.co/qualcomm/ResNet101/blob/main/ResNet101_w8a8.tflite) |
75
- | ResNet101 | w8a8 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | QNN_DLC | 1.274 ms | 0 - 216 MB | NPU | [ResNet101.dlc](https://huggingface.co/qualcomm/ResNet101/blob/main/ResNet101_w8a8.dlc) |
76
- | ResNet101 | w8a8 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | ONNX | 1.603 ms | 0 - 110 MB | NPU | [ResNet101.onnx.zip](https://huggingface.co/qualcomm/ResNet101/blob/main/ResNet101_w8a8.onnx.zip) |
77
- | ResNet101 | w8a8 | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | TFLITE | 1.326 ms | 0 - 60 MB | NPU | [ResNet101.tflite](https://huggingface.co/qualcomm/ResNet101/blob/main/ResNet101_w8a8.tflite) |
78
- | ResNet101 | w8a8 | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | QNN_DLC | 1.455 ms | 0 - 62 MB | NPU | [ResNet101.dlc](https://huggingface.co/qualcomm/ResNet101/blob/main/ResNet101_w8a8.dlc) |
79
- | ResNet101 | w8a8 | RB3 Gen 2 (Proxy) | Qualcomm® QCS6490 (Proxy) | TFLITE | 4.451 ms | 0 - 80 MB | NPU | [ResNet101.tflite](https://huggingface.co/qualcomm/ResNet101/blob/main/ResNet101_w8a8.tflite) |
80
- | ResNet101 | w8a8 | RB3 Gen 2 (Proxy) | Qualcomm® QCS6490 (Proxy) | QNN_DLC | 6.363 ms | 0 - 81 MB | NPU | [ResNet101.dlc](https://huggingface.co/qualcomm/ResNet101/blob/main/ResNet101_w8a8.dlc) |
81
- | ResNet101 | w8a8 | RB3 Gen 2 (Proxy) | Qualcomm® QCS6490 (Proxy) | ONNX | 51.713 ms | 7 - 26 MB | CPU | [ResNet101.onnx.zip](https://huggingface.co/qualcomm/ResNet101/blob/main/ResNet101_w8a8.onnx.zip) |
82
- | ResNet101 | w8a8 | RB5 (Proxy) | Qualcomm® QCS8250 (Proxy) | TFLITE | 17.541 ms | 0 - 12 MB | NPU | [ResNet101.tflite](https://huggingface.co/qualcomm/ResNet101/blob/main/ResNet101_w8a8.tflite) |
83
- | ResNet101 | w8a8 | RB5 (Proxy) | Qualcomm® QCS8250 (Proxy) | ONNX | 40.558 ms | 14 - 36 MB | CPU | [ResNet101.onnx.zip](https://huggingface.co/qualcomm/ResNet101/blob/main/ResNet101_w8a8.onnx.zip) |
84
- | ResNet101 | w8a8 | SA7255P ADP | Qualcomm® SA7255P | TFLITE | 2.678 ms | 0 - 60 MB | NPU | [ResNet101.tflite](https://huggingface.co/qualcomm/ResNet101/blob/main/ResNet101_w8a8.tflite) |
85
- | ResNet101 | w8a8 | SA7255P ADP | Qualcomm® SA7255P | QNN_DLC | 2.925 ms | 0 - 62 MB | NPU | [ResNet101.dlc](https://huggingface.co/qualcomm/ResNet101/blob/main/ResNet101_w8a8.dlc) |
86
- | ResNet101 | w8a8 | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | TFLITE | 1.148 ms | 0 - 233 MB | NPU | [ResNet101.tflite](https://huggingface.co/qualcomm/ResNet101/blob/main/ResNet101_w8a8.tflite) |
87
- | ResNet101 | w8a8 | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | QNN_DLC | 1.273 ms | 0 - 216 MB | NPU | [ResNet101.dlc](https://huggingface.co/qualcomm/ResNet101/blob/main/ResNet101_w8a8.dlc) |
88
- | ResNet101 | w8a8 | SA8295P ADP | Qualcomm® SA8295P | TFLITE | 1.78 ms | 0 - 64 MB | NPU | [ResNet101.tflite](https://huggingface.co/qualcomm/ResNet101/blob/main/ResNet101_w8a8.tflite) |
89
- | ResNet101 | w8a8 | SA8295P ADP | Qualcomm® SA8295P | QNN_DLC | 1.927 ms | 0 - 69 MB | NPU | [ResNet101.dlc](https://huggingface.co/qualcomm/ResNet101/blob/main/ResNet101_w8a8.dlc) |
90
- | ResNet101 | w8a8 | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | TFLITE | 1.147 ms | 0 - 231 MB | NPU | [ResNet101.tflite](https://huggingface.co/qualcomm/ResNet101/blob/main/ResNet101_w8a8.tflite) |
91
- | ResNet101 | w8a8 | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | QNN_DLC | 1.272 ms | 0 - 216 MB | NPU | [ResNet101.dlc](https://huggingface.co/qualcomm/ResNet101/blob/main/ResNet101_w8a8.dlc) |
92
- | ResNet101 | w8a8 | SA8775P ADP | Qualcomm® SA8775P | TFLITE | 1.326 ms | 0 - 60 MB | NPU | [ResNet101.tflite](https://huggingface.co/qualcomm/ResNet101/blob/main/ResNet101_w8a8.tflite) |
93
- | ResNet101 | w8a8 | SA8775P ADP | Qualcomm® SA8775P | QNN_DLC | 1.455 ms | 0 - 62 MB | NPU | [ResNet101.dlc](https://huggingface.co/qualcomm/ResNet101/blob/main/ResNet101_w8a8.dlc) |
94
- | ResNet101 | w8a8 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | TFLITE | 0.868 ms | 0 - 102 MB | NPU | [ResNet101.tflite](https://huggingface.co/qualcomm/ResNet101/blob/main/ResNet101_w8a8.tflite) |
95
- | ResNet101 | w8a8 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN_DLC | 0.965 ms | 0 - 97 MB | NPU | [ResNet101.dlc](https://huggingface.co/qualcomm/ResNet101/blob/main/ResNet101_w8a8.dlc) |
96
- | ResNet101 | w8a8 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | ONNX | 1.137 ms | 0 - 105 MB | NPU | [ResNet101.onnx.zip](https://huggingface.co/qualcomm/ResNet101/blob/main/ResNet101_w8a8.onnx.zip) |
97
- | ResNet101 | w8a8 | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | TFLITE | 0.75 ms | 0 - 65 MB | NPU | [ResNet101.tflite](https://huggingface.co/qualcomm/ResNet101/blob/main/ResNet101_w8a8.tflite) |
98
- | ResNet101 | w8a8 | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | QNN_DLC | 0.776 ms | 0 - 64 MB | NPU | [ResNet101.dlc](https://huggingface.co/qualcomm/ResNet101/blob/main/ResNet101_w8a8.dlc) |
99
- | ResNet101 | w8a8 | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | ONNX | 1.002 ms | 0 - 71 MB | NPU | [ResNet101.onnx.zip](https://huggingface.co/qualcomm/ResNet101/blob/main/ResNet101_w8a8.onnx.zip) |
100
- | ResNet101 | w8a8 | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | TFLITE | 0.715 ms | 0 - 65 MB | NPU | [ResNet101.tflite](https://huggingface.co/qualcomm/ResNet101/blob/main/ResNet101_w8a8.tflite) |
101
- | ResNet101 | w8a8 | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | QNN_DLC | 0.751 ms | 0 - 69 MB | NPU | [ResNet101.dlc](https://huggingface.co/qualcomm/ResNet101/blob/main/ResNet101_w8a8.dlc) |
102
- | ResNet101 | w8a8 | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | ONNX | 0.973 ms | 0 - 70 MB | NPU | [ResNet101.onnx.zip](https://huggingface.co/qualcomm/ResNet101/blob/main/ResNet101_w8a8.onnx.zip) |
103
- | ResNet101 | w8a8 | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN_DLC | 1.267 ms | 228 - 228 MB | NPU | [ResNet101.dlc](https://huggingface.co/qualcomm/ResNet101/blob/main/ResNet101_w8a8.dlc) |
104
- | ResNet101 | w8a8 | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 1.336 ms | 45 - 45 MB | NPU | [ResNet101.onnx.zip](https://huggingface.co/qualcomm/ResNet101/blob/main/ResNet101_w8a8.onnx.zip) |
 
 
 
105
 
106
 
107
 
@@ -115,9 +118,9 @@ pip install qai-hub-models
115
  ```
116
 
117
 
118
- ## Configure Qualcomm® AI Hub to run this model on a cloud-hosted device
119
 
120
- Sign-in to [Qualcomm® AI Hub](https://app.aihub.qualcomm.com/) with your
121
  Qualcomm® ID. Once signed in navigate to `Account -> Settings -> API Token`.
122
 
123
  With this API token, you can configure your client to run models on the cloud
@@ -125,7 +128,7 @@ hosted devices.
125
  ```bash
126
  qai-hub configure --api_token API_TOKEN
127
  ```
128
- Navigate to [docs](https://app.aihub.qualcomm.com/docs/) for more information.
129
 
130
 
131
 
@@ -236,7 +239,7 @@ With the output of the model, you can compute like PSNR, relative errors or
236
  spot check the output with expected output.
237
 
238
  **Note**: This on-device profiling and inference requires access to Qualcomm®
239
- AI Hub. [Sign up for access](https://myaccount.qualcomm.com/signup).
240
 
241
 
242
 
 
37
 
38
  | Model | Precision | Device | Chipset | Target Runtime | Inference Time (ms) | Peak Memory Range (MB) | Primary Compute Unit | Target Model
39
  |---|---|---|---|---|---|---|---|---|
40
+ | ResNet101 | float | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | TFLITE | 18.43 ms | 0 - 94 MB | NPU | [ResNet101.tflite](https://huggingface.co/qualcomm/ResNet101/blob/main/ResNet101.tflite) |
41
+ | ResNet101 | float | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | QNN_DLC | 18.281 ms | 1 - 44 MB | NPU | [ResNet101.dlc](https://huggingface.co/qualcomm/ResNet101/blob/main/ResNet101.dlc) |
42
+ | ResNet101 | float | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | TFLITE | 4.722 ms | 0 - 101 MB | NPU | [ResNet101.tflite](https://huggingface.co/qualcomm/ResNet101/blob/main/ResNet101.tflite) |
43
+ | ResNet101 | float | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | QNN_DLC | 5.844 ms | 1 - 41 MB | NPU | [ResNet101.dlc](https://huggingface.co/qualcomm/ResNet101/blob/main/ResNet101.dlc) |
44
+ | ResNet101 | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | TFLITE | 3.385 ms | 0 - 69 MB | NPU | [ResNet101.tflite](https://huggingface.co/qualcomm/ResNet101/blob/main/ResNet101.tflite) |
45
+ | ResNet101 | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | QNN_DLC | 3.281 ms | 1 - 14 MB | NPU | [ResNet101.dlc](https://huggingface.co/qualcomm/ResNet101/blob/main/ResNet101.dlc) |
46
+ | ResNet101 | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | ONNX | 3.359 ms | 1 - 13 MB | NPU | [ResNet101.onnx.zip](https://huggingface.co/qualcomm/ResNet101/blob/main/ResNet101.onnx.zip) |
47
+ | ResNet101 | float | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | TFLITE | 5.555 ms | 0 - 94 MB | NPU | [ResNet101.tflite](https://huggingface.co/qualcomm/ResNet101/blob/main/ResNet101.tflite) |
48
+ | ResNet101 | float | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | QNN_DLC | 5.395 ms | 1 - 44 MB | NPU | [ResNet101.dlc](https://huggingface.co/qualcomm/ResNet101/blob/main/ResNet101.dlc) |
49
+ | ResNet101 | float | SA7255P ADP | Qualcomm® SA7255P | TFLITE | 18.43 ms | 0 - 94 MB | NPU | [ResNet101.tflite](https://huggingface.co/qualcomm/ResNet101/blob/main/ResNet101.tflite) |
50
+ | ResNet101 | float | SA7255P ADP | Qualcomm® SA7255P | QNN_DLC | 18.281 ms | 1 - 44 MB | NPU | [ResNet101.dlc](https://huggingface.co/qualcomm/ResNet101/blob/main/ResNet101.dlc) |
51
+ | ResNet101 | float | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | TFLITE | 3.363 ms | 0 - 100 MB | NPU | [ResNet101.tflite](https://huggingface.co/qualcomm/ResNet101/blob/main/ResNet101.tflite) |
52
+ | ResNet101 | float | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | QNN_DLC | 3.288 ms | 1 - 16 MB | NPU | [ResNet101.dlc](https://huggingface.co/qualcomm/ResNet101/blob/main/ResNet101.dlc) |
53
+ | ResNet101 | float | SA8295P ADP | Qualcomm® SA8295P | TFLITE | 5.63 ms | 0 - 84 MB | NPU | [ResNet101.tflite](https://huggingface.co/qualcomm/ResNet101/blob/main/ResNet101.tflite) |
54
+ | ResNet101 | float | SA8295P ADP | Qualcomm® SA8295P | QNN_DLC | 5.535 ms | 0 - 34 MB | NPU | [ResNet101.dlc](https://huggingface.co/qualcomm/ResNet101/blob/main/ResNet101.dlc) |
55
+ | ResNet101 | float | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | TFLITE | 3.372 ms | 0 - 35 MB | NPU | [ResNet101.tflite](https://huggingface.co/qualcomm/ResNet101/blob/main/ResNet101.tflite) |
56
+ | ResNet101 | float | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | QNN_DLC | 3.293 ms | 1 - 13 MB | NPU | [ResNet101.dlc](https://huggingface.co/qualcomm/ResNet101/blob/main/ResNet101.dlc) |
57
+ | ResNet101 | float | SA8775P ADP | Qualcomm® SA8775P | TFLITE | 5.555 ms | 0 - 94 MB | NPU | [ResNet101.tflite](https://huggingface.co/qualcomm/ResNet101/blob/main/ResNet101.tflite) |
58
+ | ResNet101 | float | SA8775P ADP | Qualcomm® SA8775P | QNN_DLC | 5.395 ms | 1 - 44 MB | NPU | [ResNet101.dlc](https://huggingface.co/qualcomm/ResNet101/blob/main/ResNet101.dlc) |
59
+ | ResNet101 | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | TFLITE | 2.444 ms | 0 - 104 MB | NPU | [ResNet101.tflite](https://huggingface.co/qualcomm/ResNet101/blob/main/ResNet101.tflite) |
60
+ | ResNet101 | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN_DLC | 2.365 ms | 0 - 54 MB | NPU | [ResNet101.dlc](https://huggingface.co/qualcomm/ResNet101/blob/main/ResNet101.dlc) |
61
+ | ResNet101 | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | ONNX | 2.406 ms | 0 - 50 MB | NPU | [ResNet101.onnx.zip](https://huggingface.co/qualcomm/ResNet101/blob/main/ResNet101.onnx.zip) |
62
+ | ResNet101 | float | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | TFLITE | 1.976 ms | 0 - 100 MB | NPU | [ResNet101.tflite](https://huggingface.co/qualcomm/ResNet101/blob/main/ResNet101.tflite) |
63
+ | ResNet101 | float | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | QNN_DLC | 1.954 ms | 1 - 50 MB | NPU | [ResNet101.dlc](https://huggingface.co/qualcomm/ResNet101/blob/main/ResNet101.dlc) |
64
+ | ResNet101 | float | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | ONNX | 2.103 ms | 0 - 44 MB | NPU | [ResNet101.onnx.zip](https://huggingface.co/qualcomm/ResNet101/blob/main/ResNet101.onnx.zip) |
65
+ | ResNet101 | float | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | TFLITE | 1.717 ms | 0 - 96 MB | NPU | [ResNet101.tflite](https://huggingface.co/qualcomm/ResNet101/blob/main/ResNet101.tflite) |
66
+ | ResNet101 | float | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | QNN_DLC | 1.652 ms | 1 - 50 MB | NPU | [ResNet101.dlc](https://huggingface.co/qualcomm/ResNet101/blob/main/ResNet101.dlc) |
67
+ | ResNet101 | float | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | ONNX | 1.771 ms | 0 - 45 MB | NPU | [ResNet101.onnx.zip](https://huggingface.co/qualcomm/ResNet101/blob/main/ResNet101.onnx.zip) |
68
+ | ResNet101 | float | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN_DLC | 3.48 ms | 273 - 273 MB | NPU | [ResNet101.dlc](https://huggingface.co/qualcomm/ResNet101/blob/main/ResNet101.dlc) |
69
+ | ResNet101 | float | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 3.291 ms | 86 - 86 MB | NPU | [ResNet101.onnx.zip](https://huggingface.co/qualcomm/ResNet101/blob/main/ResNet101.onnx.zip) |
70
+ | ResNet101 | w8a8 | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | TFLITE | 2.679 ms | 0 - 61 MB | NPU | [ResNet101.tflite](https://huggingface.co/qualcomm/ResNet101/blob/main/ResNet101_w8a8.tflite) |
71
+ | ResNet101 | w8a8 | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | QNN_DLC | 2.977 ms | 1 - 64 MB | NPU | [ResNet101.dlc](https://huggingface.co/qualcomm/ResNet101/blob/main/ResNet101_w8a8.dlc) |
72
+ | ResNet101 | w8a8 | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | TFLITE | 1.365 ms | 0 - 111 MB | NPU | [ResNet101.tflite](https://huggingface.co/qualcomm/ResNet101/blob/main/ResNet101_w8a8.tflite) |
73
+ | ResNet101 | w8a8 | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | QNN_DLC | 1.798 ms | 0 - 96 MB | NPU | [ResNet101.dlc](https://huggingface.co/qualcomm/ResNet101/blob/main/ResNet101_w8a8.dlc) |
74
+ | ResNet101 | w8a8 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | TFLITE | 1.149 ms | 0 - 229 MB | NPU | [ResNet101.tflite](https://huggingface.co/qualcomm/ResNet101/blob/main/ResNet101_w8a8.tflite) |
75
+ | ResNet101 | w8a8 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | QNN_DLC | 1.274 ms | 0 - 212 MB | NPU | [ResNet101.dlc](https://huggingface.co/qualcomm/ResNet101/blob/main/ResNet101_w8a8.dlc) |
76
+ | ResNet101 | w8a8 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | ONNX | 1.558 ms | 0 - 184 MB | NPU | [ResNet101.onnx.zip](https://huggingface.co/qualcomm/ResNet101/blob/main/ResNet101_w8a8.onnx.zip) |
77
+ | ResNet101 | w8a8 | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | TFLITE | 1.329 ms | 0 - 61 MB | NPU | [ResNet101.tflite](https://huggingface.co/qualcomm/ResNet101/blob/main/ResNet101_w8a8.tflite) |
78
+ | ResNet101 | w8a8 | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | QNN_DLC | 1.465 ms | 0 - 64 MB | NPU | [ResNet101.dlc](https://huggingface.co/qualcomm/ResNet101/blob/main/ResNet101_w8a8.dlc) |
79
+ | ResNet101 | w8a8 | RB3 Gen 2 (Proxy) | Qualcomm® QCS6490 (Proxy) | TFLITE | 4.482 ms | 0 - 81 MB | NPU | [ResNet101.tflite](https://huggingface.co/qualcomm/ResNet101/blob/main/ResNet101_w8a8.tflite) |
80
+ | ResNet101 | w8a8 | RB3 Gen 2 (Proxy) | Qualcomm® QCS6490 (Proxy) | QNN_DLC | 6.515 ms | 0 - 83 MB | NPU | [ResNet101.dlc](https://huggingface.co/qualcomm/ResNet101/blob/main/ResNet101_w8a8.dlc) |
81
+ | ResNet101 | w8a8 | RB3 Gen 2 (Proxy) | Qualcomm® QCS6490 (Proxy) | ONNX | 46.769 ms | 13 - 33 MB | CPU | [ResNet101.onnx.zip](https://huggingface.co/qualcomm/ResNet101/blob/main/ResNet101_w8a8.onnx.zip) |
82
+ | ResNet101 | w8a8 | RB5 (Proxy) | Qualcomm® QCS8250 (Proxy) | TFLITE | 17.471 ms | 0 - 2 MB | NPU | [ResNet101.tflite](https://huggingface.co/qualcomm/ResNet101/blob/main/ResNet101_w8a8.tflite) |
83
+ | ResNet101 | w8a8 | RB5 (Proxy) | Qualcomm® QCS8250 (Proxy) | ONNX | 45.171 ms | 14 - 52 MB | CPU | [ResNet101.onnx.zip](https://huggingface.co/qualcomm/ResNet101/blob/main/ResNet101_w8a8.onnx.zip) |
84
+ | ResNet101 | w8a8 | SA7255P ADP | Qualcomm® SA7255P | TFLITE | 2.679 ms | 0 - 61 MB | NPU | [ResNet101.tflite](https://huggingface.co/qualcomm/ResNet101/blob/main/ResNet101_w8a8.tflite) |
85
+ | ResNet101 | w8a8 | SA7255P ADP | Qualcomm® SA7255P | QNN_DLC | 2.977 ms | 1 - 64 MB | NPU | [ResNet101.dlc](https://huggingface.co/qualcomm/ResNet101/blob/main/ResNet101_w8a8.dlc) |
86
+ | ResNet101 | w8a8 | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | TFLITE | 1.15 ms | 0 - 229 MB | NPU | [ResNet101.tflite](https://huggingface.co/qualcomm/ResNet101/blob/main/ResNet101_w8a8.tflite) |
87
+ | ResNet101 | w8a8 | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | QNN_DLC | 1.285 ms | 0 - 31 MB | NPU | [ResNet101.dlc](https://huggingface.co/qualcomm/ResNet101/blob/main/ResNet101_w8a8.dlc) |
88
+ | ResNet101 | w8a8 | SA8295P ADP | Qualcomm® SA8295P | TFLITE | 1.779 ms | 0 - 65 MB | NPU | [ResNet101.tflite](https://huggingface.co/qualcomm/ResNet101/blob/main/ResNet101_w8a8.tflite) |
89
+ | ResNet101 | w8a8 | SA8295P ADP | Qualcomm® SA8295P | QNN_DLC | 1.902 ms | 0 - 68 MB | NPU | [ResNet101.dlc](https://huggingface.co/qualcomm/ResNet101/blob/main/ResNet101_w8a8.dlc) |
90
+ | ResNet101 | w8a8 | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | TFLITE | 1.157 ms | 0 - 231 MB | NPU | [ResNet101.tflite](https://huggingface.co/qualcomm/ResNet101/blob/main/ResNet101_w8a8.tflite) |
91
+ | ResNet101 | w8a8 | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | QNN_DLC | 1.28 ms | 0 - 199 MB | NPU | [ResNet101.dlc](https://huggingface.co/qualcomm/ResNet101/blob/main/ResNet101_w8a8.dlc) |
92
+ | ResNet101 | w8a8 | SA8775P ADP | Qualcomm® SA8775P | TFLITE | 1.329 ms | 0 - 61 MB | NPU | [ResNet101.tflite](https://huggingface.co/qualcomm/ResNet101/blob/main/ResNet101_w8a8.tflite) |
93
+ | ResNet101 | w8a8 | SA8775P ADP | Qualcomm® SA8775P | QNN_DLC | 1.465 ms | 0 - 64 MB | NPU | [ResNet101.dlc](https://huggingface.co/qualcomm/ResNet101/blob/main/ResNet101_w8a8.dlc) |
94
+ | ResNet101 | w8a8 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | TFLITE | 0.869 ms | 0 - 104 MB | NPU | [ResNet101.tflite](https://huggingface.co/qualcomm/ResNet101/blob/main/ResNet101_w8a8.tflite) |
95
+ | ResNet101 | w8a8 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN_DLC | 0.968 ms | 0 - 96 MB | NPU | [ResNet101.dlc](https://huggingface.co/qualcomm/ResNet101/blob/main/ResNet101_w8a8.dlc) |
96
+ | ResNet101 | w8a8 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | ONNX | 1.159 ms | 0 - 107 MB | NPU | [ResNet101.onnx.zip](https://huggingface.co/qualcomm/ResNet101/blob/main/ResNet101_w8a8.onnx.zip) |
97
+ | ResNet101 | w8a8 | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | TFLITE | 0.754 ms | 0 - 67 MB | NPU | [ResNet101.tflite](https://huggingface.co/qualcomm/ResNet101/blob/main/ResNet101_w8a8.tflite) |
98
+ | ResNet101 | w8a8 | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | QNN_DLC | 0.78 ms | 0 - 71 MB | NPU | [ResNet101.dlc](https://huggingface.co/qualcomm/ResNet101/blob/main/ResNet101_w8a8.dlc) |
99
+ | ResNet101 | w8a8 | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | ONNX | 0.995 ms | 0 - 70 MB | NPU | [ResNet101.onnx.zip](https://huggingface.co/qualcomm/ResNet101/blob/main/ResNet101_w8a8.onnx.zip) |
100
+ | ResNet101 | w8a8 | Snapdragon 7 Gen 4 QRD | Snapdragon® 7 Gen 4 Mobile | TFLITE | 1.686 ms | 0 - 75 MB | NPU | [ResNet101.tflite](https://huggingface.co/qualcomm/ResNet101/blob/main/ResNet101_w8a8.tflite) |
101
+ | ResNet101 | w8a8 | Snapdragon 7 Gen 4 QRD | Snapdragon�� 7 Gen 4 Mobile | QNN_DLC | 1.835 ms | 0 - 78 MB | NPU | [ResNet101.dlc](https://huggingface.co/qualcomm/ResNet101/blob/main/ResNet101_w8a8.dlc) |
102
+ | ResNet101 | w8a8 | Snapdragon 7 Gen 4 QRD | Snapdragon® 7 Gen 4 Mobile | ONNX | 40.329 ms | 14 - 32 MB | CPU | [ResNet101.onnx.zip](https://huggingface.co/qualcomm/ResNet101/blob/main/ResNet101_w8a8.onnx.zip) |
103
+ | ResNet101 | w8a8 | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | TFLITE | 0.713 ms | 0 - 63 MB | NPU | [ResNet101.tflite](https://huggingface.co/qualcomm/ResNet101/blob/main/ResNet101_w8a8.tflite) |
104
+ | ResNet101 | w8a8 | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | QNN_DLC | 0.746 ms | 0 - 69 MB | NPU | [ResNet101.dlc](https://huggingface.co/qualcomm/ResNet101/blob/main/ResNet101_w8a8.dlc) |
105
+ | ResNet101 | w8a8 | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | ONNX | 0.986 ms | 0 - 71 MB | NPU | [ResNet101.onnx.zip](https://huggingface.co/qualcomm/ResNet101/blob/main/ResNet101_w8a8.onnx.zip) |
106
+ | ResNet101 | w8a8 | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN_DLC | 1.28 ms | 233 - 233 MB | NPU | [ResNet101.dlc](https://huggingface.co/qualcomm/ResNet101/blob/main/ResNet101_w8a8.dlc) |
107
+ | ResNet101 | w8a8 | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 1.345 ms | 46 - 46 MB | NPU | [ResNet101.onnx.zip](https://huggingface.co/qualcomm/ResNet101/blob/main/ResNet101_w8a8.onnx.zip) |
108
 
109
 
110
 
 
118
  ```
119
 
120
 
121
+ ## Configure Qualcomm® AI Hub Workbench to run this model on a cloud-hosted device
122
 
123
+ Sign-in to [Qualcomm® AI Hub Workbench](https://workbench.aihub.qualcomm.com/) with your
124
  Qualcomm® ID. Once signed in navigate to `Account -> Settings -> API Token`.
125
 
126
  With this API token, you can configure your client to run models on the cloud
 
128
  ```bash
129
  qai-hub configure --api_token API_TOKEN
130
  ```
131
+ Navigate to [docs](https://workbench.aihub.qualcomm.com/docs/) for more information.
132
 
133
 
134
 
 
239
  spot check the output with expected output.
240
 
241
  **Note**: This on-device profiling and inference requires access to Qualcomm®
242
+ AI Hub Workbench. [Sign up for access](https://myaccount.qualcomm.com/signup).
243
 
244
 
245
 
ResNet101_float.dlc CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:dda50e0efaa526159dfa9565c90987f51b0ad4cd8f5247783fdbb33de566bde2
3
- size 178242876
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e556ff604cfaf887bc1a80e47b2889b41beef3d647762d3fddf1cfa98d4d49be
3
+ size 178242980
ResNet101_float.onnx.zip CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:fee29c7c51227c18ca95841da98d87048e90539704d14c0741b0ca6241785ea3
3
  size 166416593
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5df204e99f19100bed95e726dfcdcfd885c54802704bc3bbcfcc9a6a134880b1
3
  size 166416593
ResNet101_w8a8.dlc CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:72c10f07365974b5af9632e6e3dee0dfab824b03b84db015f611d3f1dd1c3a48
3
- size 47877308
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:94aeff42eaa5e38e5f61af1a447c50e6871233b8538e5e533b7bd3ec6ffe46f1
3
+ size 47877412
ResNet101_w8a8.onnx.zip CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:f124bd87757c1e6e770fb452b9ed4cfb7283a09d323a5b25c23dd1eedf74fca4
3
- size 78915276
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bd7b3967b6676edc0b24324aab8ab36704b42f5b7cacd1aa9d1d335ef7b05a99
3
+ size 78915406
ResNet101_w8a8.tflite CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:f1032fca9b240fca0d830379a47993cf1c1aaf27a9496634ef15dfbd81b9aede
3
  size 46007680
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ffc0a1a79321a704fcb551866922abc522675f3efbcb37d99b2e0ae5e152576a
3
  size 46007680