qaihm-bot commited on
Commit
428b1d4
·
verified ·
1 Parent(s): cd2c8ff

See https://github.com/quic/ai-hub-models/releases/v0.42.0 for changelog.

README.md CHANGED
@@ -37,71 +37,74 @@ More details on model performance across various devices, can be found
37
 
38
  | Model | Precision | Device | Chipset | Target Runtime | Inference Time (ms) | Peak Memory Range (MB) | Primary Compute Unit | Target Model
39
  |---|---|---|---|---|---|---|---|---|
40
- | WideResNet50 | float | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | TFLITE | 23.999 ms | 0 - 92 MB | NPU | [WideResNet50.tflite](https://huggingface.co/qualcomm/WideResNet50/blob/main/WideResNet50.tflite) |
41
- | WideResNet50 | float | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | QNN_DLC | 24.375 ms | 1 - 41 MB | NPU | [WideResNet50.dlc](https://huggingface.co/qualcomm/WideResNet50/blob/main/WideResNet50.dlc) |
42
- | WideResNet50 | float | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | TFLITE | 6.824 ms | 0 - 175 MB | NPU | [WideResNet50.tflite](https://huggingface.co/qualcomm/WideResNet50/blob/main/WideResNet50.tflite) |
43
- | WideResNet50 | float | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | QNN_DLC | 9.193 ms | 0 - 38 MB | NPU | [WideResNet50.dlc](https://huggingface.co/qualcomm/WideResNet50/blob/main/WideResNet50.dlc) |
44
- | WideResNet50 | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | TFLITE | 4.86 ms | 0 - 850 MB | NPU | [WideResNet50.tflite](https://huggingface.co/qualcomm/WideResNet50/blob/main/WideResNet50.tflite) |
45
- | WideResNet50 | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | QNN_DLC | 4.756 ms | 3 - 14 MB | NPU | [WideResNet50.dlc](https://huggingface.co/qualcomm/WideResNet50/blob/main/WideResNet50.dlc) |
46
- | WideResNet50 | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | ONNX | 4.781 ms | 0 - 167 MB | NPU | [WideResNet50.onnx.zip](https://huggingface.co/qualcomm/WideResNet50/blob/main/WideResNet50.onnx.zip) |
47
- | WideResNet50 | float | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | TFLITE | 7.318 ms | 0 - 92 MB | NPU | [WideResNet50.tflite](https://huggingface.co/qualcomm/WideResNet50/blob/main/WideResNet50.tflite) |
48
- | WideResNet50 | float | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | QNN_DLC | 7.156 ms | 1 - 42 MB | NPU | [WideResNet50.dlc](https://huggingface.co/qualcomm/WideResNet50/blob/main/WideResNet50.dlc) |
49
- | WideResNet50 | float | SA7255P ADP | Qualcomm® SA7255P | TFLITE | 23.999 ms | 0 - 92 MB | NPU | [WideResNet50.tflite](https://huggingface.co/qualcomm/WideResNet50/blob/main/WideResNet50.tflite) |
50
- | WideResNet50 | float | SA7255P ADP | Qualcomm® SA7255P | QNN_DLC | 24.375 ms | 1 - 41 MB | NPU | [WideResNet50.dlc](https://huggingface.co/qualcomm/WideResNet50/blob/main/WideResNet50.dlc) |
51
- | WideResNet50 | float | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | TFLITE | 4.845 ms | 0 - 860 MB | NPU | [WideResNet50.tflite](https://huggingface.co/qualcomm/WideResNet50/blob/main/WideResNet50.tflite) |
52
- | WideResNet50 | float | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | QNN_DLC | 4.787 ms | 1 - 12 MB | NPU | [WideResNet50.dlc](https://huggingface.co/qualcomm/WideResNet50/blob/main/WideResNet50.dlc) |
53
- | WideResNet50 | float | SA8295P ADP | Qualcomm® SA8295P | TFLITE | 7.921 ms | 0 - 85 MB | NPU | [WideResNet50.tflite](https://huggingface.co/qualcomm/WideResNet50/blob/main/WideResNet50.tflite) |
54
- | WideResNet50 | float | SA8295P ADP | Qualcomm® SA8295P | QNN_DLC | 7.886 ms | 1 - 33 MB | NPU | [WideResNet50.dlc](https://huggingface.co/qualcomm/WideResNet50/blob/main/WideResNet50.dlc) |
55
- | WideResNet50 | float | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | TFLITE | 4.851 ms | 0 - 868 MB | NPU | [WideResNet50.tflite](https://huggingface.co/qualcomm/WideResNet50/blob/main/WideResNet50.tflite) |
56
- | WideResNet50 | float | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | QNN_DLC | 4.785 ms | 1 - 12 MB | NPU | [WideResNet50.dlc](https://huggingface.co/qualcomm/WideResNet50/blob/main/WideResNet50.dlc) |
57
- | WideResNet50 | float | SA8775P ADP | Qualcomm® SA8775P | TFLITE | 7.318 ms | 0 - 92 MB | NPU | [WideResNet50.tflite](https://huggingface.co/qualcomm/WideResNet50/blob/main/WideResNet50.tflite) |
58
- | WideResNet50 | float | SA8775P ADP | Qualcomm® SA8775P | QNN_DLC | 7.156 ms | 1 - 42 MB | NPU | [WideResNet50.dlc](https://huggingface.co/qualcomm/WideResNet50/blob/main/WideResNet50.dlc) |
59
- | WideResNet50 | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | TFLITE | 3.577 ms | 0 - 186 MB | NPU | [WideResNet50.tflite](https://huggingface.co/qualcomm/WideResNet50/blob/main/WideResNet50.tflite) |
60
- | WideResNet50 | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN_DLC | 3.59 ms | 1 - 48 MB | NPU | [WideResNet50.dlc](https://huggingface.co/qualcomm/WideResNet50/blob/main/WideResNet50.dlc) |
61
- | WideResNet50 | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | ONNX | 3.576 ms | 0 - 49 MB | NPU | [WideResNet50.onnx.zip](https://huggingface.co/qualcomm/WideResNet50/blob/main/WideResNet50.onnx.zip) |
62
- | WideResNet50 | float | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | TFLITE | 3.027 ms | 0 - 97 MB | NPU | [WideResNet50.tflite](https://huggingface.co/qualcomm/WideResNet50/blob/main/WideResNet50.tflite) |
63
- | WideResNet50 | float | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | QNN_DLC | 2.94 ms | 1 - 49 MB | NPU | [WideResNet50.dlc](https://huggingface.co/qualcomm/WideResNet50/blob/main/WideResNet50.dlc) |
64
- | WideResNet50 | float | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | ONNX | 3.03 ms | 0 - 43 MB | NPU | [WideResNet50.onnx.zip](https://huggingface.co/qualcomm/WideResNet50/blob/main/WideResNet50.onnx.zip) |
65
- | WideResNet50 | float | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | TFLITE | 2.782 ms | 0 - 96 MB | NPU | [WideResNet50.tflite](https://huggingface.co/qualcomm/WideResNet50/blob/main/WideResNet50.tflite) |
66
- | WideResNet50 | float | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | QNN_DLC | 2.498 ms | 1 - 43 MB | NPU | [WideResNet50.dlc](https://huggingface.co/qualcomm/WideResNet50/blob/main/WideResNet50.dlc) |
67
- | WideResNet50 | float | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | ONNX | 2.817 ms | 1 - 50 MB | NPU | [WideResNet50.onnx.zip](https://huggingface.co/qualcomm/WideResNet50/blob/main/WideResNet50.onnx.zip) |
68
- | WideResNet50 | float | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN_DLC | 4.653 ms | 451 - 451 MB | NPU | [WideResNet50.dlc](https://huggingface.co/qualcomm/WideResNet50/blob/main/WideResNet50.dlc) |
69
- | WideResNet50 | float | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 4.473 ms | 133 - 133 MB | NPU | [WideResNet50.onnx.zip](https://huggingface.co/qualcomm/WideResNet50/blob/main/WideResNet50.onnx.zip) |
70
- | WideResNet50 | w8a8 | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | TFLITE | 3.762 ms | 0 - 42 MB | NPU | [WideResNet50.tflite](https://huggingface.co/qualcomm/WideResNet50/blob/main/WideResNet50_w8a8.tflite) |
71
- | WideResNet50 | w8a8 | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | QNN_DLC | 4.03 ms | 0 - 45 MB | NPU | [WideResNet50.dlc](https://huggingface.co/qualcomm/WideResNet50/blob/main/WideResNet50_w8a8.dlc) |
72
- | WideResNet50 | w8a8 | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | TFLITE | 2.076 ms | 0 - 108 MB | NPU | [WideResNet50.tflite](https://huggingface.co/qualcomm/WideResNet50/blob/main/WideResNet50_w8a8.tflite) |
73
- | WideResNet50 | w8a8 | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | QNN_DLC | 2.501 ms | 0 - 108 MB | NPU | [WideResNet50.dlc](https://huggingface.co/qualcomm/WideResNet50/blob/main/WideResNet50_w8a8.dlc) |
74
- | WideResNet50 | w8a8 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | TFLITE | 1.742 ms | 0 - 401 MB | NPU | [WideResNet50.tflite](https://huggingface.co/qualcomm/WideResNet50/blob/main/WideResNet50_w8a8.tflite) |
75
- | WideResNet50 | w8a8 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | QNN_DLC | 1.873 ms | 0 - 365 MB | NPU | [WideResNet50.dlc](https://huggingface.co/qualcomm/WideResNet50/blob/main/WideResNet50_w8a8.dlc) |
76
- | WideResNet50 | w8a8 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | ONNX | 2.143 ms | 0 - 228 MB | NPU | [WideResNet50.onnx.zip](https://huggingface.co/qualcomm/WideResNet50/blob/main/WideResNet50_w8a8.onnx.zip) |
77
- | WideResNet50 | w8a8 | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | TFLITE | 1.88 ms | 0 - 42 MB | NPU | [WideResNet50.tflite](https://huggingface.co/qualcomm/WideResNet50/blob/main/WideResNet50_w8a8.tflite) |
78
- | WideResNet50 | w8a8 | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | QNN_DLC | 2.012 ms | 0 - 44 MB | NPU | [WideResNet50.dlc](https://huggingface.co/qualcomm/WideResNet50/blob/main/WideResNet50_w8a8.dlc) |
79
- | WideResNet50 | w8a8 | RB3 Gen 2 (Proxy) | Qualcomm® QCS6490 (Proxy) | TFLITE | 7.377 ms | 0 - 97 MB | NPU | [WideResNet50.tflite](https://huggingface.co/qualcomm/WideResNet50/blob/main/WideResNet50_w8a8.tflite) |
80
- | WideResNet50 | w8a8 | RB3 Gen 2 (Proxy) | Qualcomm® QCS6490 (Proxy) | QNN_DLC | 9.977 ms | 0 - 97 MB | NPU | [WideResNet50.dlc](https://huggingface.co/qualcomm/WideResNet50/blob/main/WideResNet50_w8a8.dlc) |
81
- | WideResNet50 | w8a8 | RB3 Gen 2 (Proxy) | Qualcomm® QCS6490 (Proxy) | ONNX | 79.946 ms | 13 - 29 MB | CPU | [WideResNet50.onnx.zip](https://huggingface.co/qualcomm/WideResNet50/blob/main/WideResNet50_w8a8.onnx.zip) |
82
- | WideResNet50 | w8a8 | RB5 (Proxy) | Qualcomm® QCS8250 (Proxy) | TFLITE | 24.212 ms | 0 - 3 MB | NPU | [WideResNet50.tflite](https://huggingface.co/qualcomm/WideResNet50/blob/main/WideResNet50_w8a8.tflite) |
83
- | WideResNet50 | w8a8 | RB5 (Proxy) | Qualcomm® QCS8250 (Proxy) | ONNX | 62.122 ms | 7 - 86 MB | CPU | [WideResNet50.onnx.zip](https://huggingface.co/qualcomm/WideResNet50/blob/main/WideResNet50_w8a8.onnx.zip) |
84
- | WideResNet50 | w8a8 | SA7255P ADP | Qualcomm® SA7255P | TFLITE | 3.762 ms | 0 - 42 MB | NPU | [WideResNet50.tflite](https://huggingface.co/qualcomm/WideResNet50/blob/main/WideResNet50_w8a8.tflite) |
85
- | WideResNet50 | w8a8 | SA7255P ADP | Qualcomm® SA7255P | QNN_DLC | 4.03 ms | 0 - 45 MB | NPU | [WideResNet50.dlc](https://huggingface.co/qualcomm/WideResNet50/blob/main/WideResNet50_w8a8.dlc) |
86
- | WideResNet50 | w8a8 | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | TFLITE | 1.746 ms | 0 - 370 MB | NPU | [WideResNet50.tflite](https://huggingface.co/qualcomm/WideResNet50/blob/main/WideResNet50_w8a8.tflite) |
87
- | WideResNet50 | w8a8 | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | QNN_DLC | 1.885 ms | 0 - 367 MB | NPU | [WideResNet50.dlc](https://huggingface.co/qualcomm/WideResNet50/blob/main/WideResNet50_w8a8.dlc) |
88
- | WideResNet50 | w8a8 | SA8295P ADP | Qualcomm® SA8295P | TFLITE | 2.625 ms | 0 - 48 MB | NPU | [WideResNet50.tflite](https://huggingface.co/qualcomm/WideResNet50/blob/main/WideResNet50_w8a8.tflite) |
89
- | WideResNet50 | w8a8 | SA8295P ADP | Qualcomm® SA8295P | QNN_DLC | 2.767 ms | 0 - 48 MB | NPU | [WideResNet50.dlc](https://huggingface.co/qualcomm/WideResNet50/blob/main/WideResNet50_w8a8.dlc) |
90
- | WideResNet50 | w8a8 | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | TFLITE | 1.739 ms | 0 - 392 MB | NPU | [WideResNet50.tflite](https://huggingface.co/qualcomm/WideResNet50/blob/main/WideResNet50_w8a8.tflite) |
91
- | WideResNet50 | w8a8 | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | QNN_DLC | 1.873 ms | 0 - 372 MB | NPU | [WideResNet50.dlc](https://huggingface.co/qualcomm/WideResNet50/blob/main/WideResNet50_w8a8.dlc) |
92
- | WideResNet50 | w8a8 | SA8775P ADP | Qualcomm® SA8775P | TFLITE | 1.88 ms | 0 - 42 MB | NPU | [WideResNet50.tflite](https://huggingface.co/qualcomm/WideResNet50/blob/main/WideResNet50_w8a8.tflite) |
93
- | WideResNet50 | w8a8 | SA8775P ADP | Qualcomm® SA8775P | QNN_DLC | 2.012 ms | 0 - 44 MB | NPU | [WideResNet50.dlc](https://huggingface.co/qualcomm/WideResNet50/blob/main/WideResNet50_w8a8.dlc) |
94
- | WideResNet50 | w8a8 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | TFLITE | 1.314 ms | 0 - 106 MB | NPU | [WideResNet50.tflite](https://huggingface.co/qualcomm/WideResNet50/blob/main/WideResNet50_w8a8.tflite) |
95
- | WideResNet50 | w8a8 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN_DLC | 1.437 ms | 0 - 108 MB | NPU | [WideResNet50.dlc](https://huggingface.co/qualcomm/WideResNet50/blob/main/WideResNet50_w8a8.dlc) |
96
- | WideResNet50 | w8a8 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | ONNX | 1.577 ms | 0 - 114 MB | NPU | [WideResNet50.onnx.zip](https://huggingface.co/qualcomm/WideResNet50/blob/main/WideResNet50_w8a8.onnx.zip) |
97
- | WideResNet50 | w8a8 | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | TFLITE | 1.158 ms | 0 - 48 MB | NPU | [WideResNet50.tflite](https://huggingface.co/qualcomm/WideResNet50/blob/main/WideResNet50_w8a8.tflite) |
98
- | WideResNet50 | w8a8 | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | QNN_DLC | 1.167 ms | 0 - 51 MB | NPU | [WideResNet50.dlc](https://huggingface.co/qualcomm/WideResNet50/blob/main/WideResNet50_w8a8.dlc) |
99
- | WideResNet50 | w8a8 | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | ONNX | 1.378 ms | 0 - 52 MB | NPU | [WideResNet50.onnx.zip](https://huggingface.co/qualcomm/WideResNet50/blob/main/WideResNet50_w8a8.onnx.zip) |
100
- | WideResNet50 | w8a8 | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | TFLITE | 1.083 ms | 0 - 44 MB | NPU | [WideResNet50.tflite](https://huggingface.co/qualcomm/WideResNet50/blob/main/WideResNet50_w8a8.tflite) |
101
- | WideResNet50 | w8a8 | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | QNN_DLC | 1.089 ms | 0 - 51 MB | NPU | [WideResNet50.dlc](https://huggingface.co/qualcomm/WideResNet50/blob/main/WideResNet50_w8a8.dlc) |
102
- | WideResNet50 | w8a8 | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | ONNX | 1.365 ms | 0 - 52 MB | NPU | [WideResNet50.onnx.zip](https://huggingface.co/qualcomm/WideResNet50/blob/main/WideResNet50_w8a8.onnx.zip) |
103
- | WideResNet50 | w8a8 | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN_DLC | 1.809 ms | 392 - 392 MB | NPU | [WideResNet50.dlc](https://huggingface.co/qualcomm/WideResNet50/blob/main/WideResNet50_w8a8.dlc) |
104
- | WideResNet50 | w8a8 | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 1.848 ms | 68 - 68 MB | NPU | [WideResNet50.onnx.zip](https://huggingface.co/qualcomm/WideResNet50/blob/main/WideResNet50_w8a8.onnx.zip) |
 
 
 
105
 
106
 
107
 
@@ -115,9 +118,9 @@ pip install qai-hub-models
115
  ```
116
 
117
 
118
- ## Configure Qualcomm® AI Hub to run this model on a cloud-hosted device
119
 
120
- Sign-in to [Qualcomm® AI Hub](https://app.aihub.qualcomm.com/) with your
121
  Qualcomm® ID. Once signed in navigate to `Account -> Settings -> API Token`.
122
 
123
  With this API token, you can configure your client to run models on the cloud
@@ -125,7 +128,7 @@ hosted devices.
125
  ```bash
126
  qai-hub configure --api_token API_TOKEN
127
  ```
128
- Navigate to [docs](https://app.aihub.qualcomm.com/docs/) for more information.
129
 
130
 
131
 
@@ -236,7 +239,7 @@ With the output of the model, you can compute like PSNR, relative errors or
236
  spot check the output with expected output.
237
 
238
  **Note**: This on-device profiling and inference requires access to Qualcomm®
239
- AI Hub. [Sign up for access](https://myaccount.qualcomm.com/signup).
240
 
241
 
242
 
 
37
 
38
  | Model | Precision | Device | Chipset | Target Runtime | Inference Time (ms) | Peak Memory Range (MB) | Primary Compute Unit | Target Model
39
  |---|---|---|---|---|---|---|---|---|
40
+ | WideResNet50 | float | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | TFLITE | 24.051 ms | 0 - 93 MB | NPU | [WideResNet50.tflite](https://huggingface.co/qualcomm/WideResNet50/blob/main/WideResNet50.tflite) |
41
+ | WideResNet50 | float | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | QNN_DLC | 24.352 ms | 1 - 42 MB | NPU | [WideResNet50.dlc](https://huggingface.co/qualcomm/WideResNet50/blob/main/WideResNet50.dlc) |
42
+ | WideResNet50 | float | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | TFLITE | 6.869 ms | 0 - 172 MB | NPU | [WideResNet50.tflite](https://huggingface.co/qualcomm/WideResNet50/blob/main/WideResNet50.tflite) |
43
+ | WideResNet50 | float | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | QNN_DLC | 9.031 ms | 0 - 37 MB | NPU | [WideResNet50.dlc](https://huggingface.co/qualcomm/WideResNet50/blob/main/WideResNet50.dlc) |
44
+ | WideResNet50 | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | TFLITE | 4.862 ms | 0 - 857 MB | NPU | [WideResNet50.tflite](https://huggingface.co/qualcomm/WideResNet50/blob/main/WideResNet50.tflite) |
45
+ | WideResNet50 | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | QNN_DLC | 4.779 ms | 1 - 12 MB | NPU | [WideResNet50.dlc](https://huggingface.co/qualcomm/WideResNet50/blob/main/WideResNet50.dlc) |
46
+ | WideResNet50 | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | ONNX | 4.767 ms | 0 - 168 MB | NPU | [WideResNet50.onnx.zip](https://huggingface.co/qualcomm/WideResNet50/blob/main/WideResNet50.onnx.zip) |
47
+ | WideResNet50 | float | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | TFLITE | 7.287 ms | 0 - 93 MB | NPU | [WideResNet50.tflite](https://huggingface.co/qualcomm/WideResNet50/blob/main/WideResNet50.tflite) |
48
+ | WideResNet50 | float | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | QNN_DLC | 7.149 ms | 1 - 43 MB | NPU | [WideResNet50.dlc](https://huggingface.co/qualcomm/WideResNet50/blob/main/WideResNet50.dlc) |
49
+ | WideResNet50 | float | SA7255P ADP | Qualcomm® SA7255P | TFLITE | 24.051 ms | 0 - 93 MB | NPU | [WideResNet50.tflite](https://huggingface.co/qualcomm/WideResNet50/blob/main/WideResNet50.tflite) |
50
+ | WideResNet50 | float | SA7255P ADP | Qualcomm® SA7255P | QNN_DLC | 24.352 ms | 1 - 42 MB | NPU | [WideResNet50.dlc](https://huggingface.co/qualcomm/WideResNet50/blob/main/WideResNet50.dlc) |
51
+ | WideResNet50 | float | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | TFLITE | 4.858 ms | 0 - 866 MB | NPU | [WideResNet50.tflite](https://huggingface.co/qualcomm/WideResNet50/blob/main/WideResNet50.tflite) |
52
+ | WideResNet50 | float | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | QNN_DLC | 4.791 ms | 1 - 12 MB | NPU | [WideResNet50.dlc](https://huggingface.co/qualcomm/WideResNet50/blob/main/WideResNet50.dlc) |
53
+ | WideResNet50 | float | SA8295P ADP | Qualcomm® SA8295P | TFLITE | 7.926 ms | 0 - 87 MB | NPU | [WideResNet50.tflite](https://huggingface.co/qualcomm/WideResNet50/blob/main/WideResNet50.tflite) |
54
+ | WideResNet50 | float | SA8295P ADP | Qualcomm® SA8295P | QNN_DLC | 7.798 ms | 1 - 33 MB | NPU | [WideResNet50.dlc](https://huggingface.co/qualcomm/WideResNet50/blob/main/WideResNet50.dlc) |
55
+ | WideResNet50 | float | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | TFLITE | 4.871 ms | 0 - 450 MB | NPU | [WideResNet50.tflite](https://huggingface.co/qualcomm/WideResNet50/blob/main/WideResNet50.tflite) |
56
+ | WideResNet50 | float | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | QNN_DLC | 4.768 ms | 1 - 12 MB | NPU | [WideResNet50.dlc](https://huggingface.co/qualcomm/WideResNet50/blob/main/WideResNet50.dlc) |
57
+ | WideResNet50 | float | SA8775P ADP | Qualcomm® SA8775P | TFLITE | 7.287 ms | 0 - 93 MB | NPU | [WideResNet50.tflite](https://huggingface.co/qualcomm/WideResNet50/blob/main/WideResNet50.tflite) |
58
+ | WideResNet50 | float | SA8775P ADP | Qualcomm® SA8775P | QNN_DLC | 7.149 ms | 1 - 43 MB | NPU | [WideResNet50.dlc](https://huggingface.co/qualcomm/WideResNet50/blob/main/WideResNet50.dlc) |
59
+ | WideResNet50 | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | TFLITE | 3.559 ms | 0 - 185 MB | NPU | [WideResNet50.tflite](https://huggingface.co/qualcomm/WideResNet50/blob/main/WideResNet50.tflite) |
60
+ | WideResNet50 | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN_DLC | 3.615 ms | 1 - 51 MB | NPU | [WideResNet50.dlc](https://huggingface.co/qualcomm/WideResNet50/blob/main/WideResNet50.dlc) |
61
+ | WideResNet50 | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | ONNX | 3.617 ms | 0 - 50 MB | NPU | [WideResNet50.onnx.zip](https://huggingface.co/qualcomm/WideResNet50/blob/main/WideResNet50.onnx.zip) |
62
+ | WideResNet50 | float | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | TFLITE | 3.022 ms | 0 - 98 MB | NPU | [WideResNet50.tflite](https://huggingface.co/qualcomm/WideResNet50/blob/main/WideResNet50.tflite) |
63
+ | WideResNet50 | float | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | QNN_DLC | 3.077 ms | 1 - 50 MB | NPU | [WideResNet50.dlc](https://huggingface.co/qualcomm/WideResNet50/blob/main/WideResNet50.dlc) |
64
+ | WideResNet50 | float | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | ONNX | 3.175 ms | 0 - 42 MB | NPU | [WideResNet50.onnx.zip](https://huggingface.co/qualcomm/WideResNet50/blob/main/WideResNet50.onnx.zip) |
65
+ | WideResNet50 | float | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | TFLITE | 2.787 ms | 0 - 96 MB | NPU | [WideResNet50.tflite](https://huggingface.co/qualcomm/WideResNet50/blob/main/WideResNet50.tflite) |
66
+ | WideResNet50 | float | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | QNN_DLC | 2.536 ms | 1 - 46 MB | NPU | [WideResNet50.dlc](https://huggingface.co/qualcomm/WideResNet50/blob/main/WideResNet50.dlc) |
67
+ | WideResNet50 | float | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | ONNX | 2.809 ms | 1 - 49 MB | NPU | [WideResNet50.onnx.zip](https://huggingface.co/qualcomm/WideResNet50/blob/main/WideResNet50.onnx.zip) |
68
+ | WideResNet50 | float | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN_DLC | 4.665 ms | 472 - 472 MB | NPU | [WideResNet50.dlc](https://huggingface.co/qualcomm/WideResNet50/blob/main/WideResNet50.dlc) |
69
+ | WideResNet50 | float | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 4.471 ms | 132 - 132 MB | NPU | [WideResNet50.onnx.zip](https://huggingface.co/qualcomm/WideResNet50/blob/main/WideResNet50.onnx.zip) |
70
+ | WideResNet50 | w8a8 | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | TFLITE | 3.731 ms | 0 - 43 MB | NPU | [WideResNet50.tflite](https://huggingface.co/qualcomm/WideResNet50/blob/main/WideResNet50_w8a8.tflite) |
71
+ | WideResNet50 | w8a8 | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | QNN_DLC | 4.023 ms | 0 - 46 MB | NPU | [WideResNet50.dlc](https://huggingface.co/qualcomm/WideResNet50/blob/main/WideResNet50_w8a8.dlc) |
72
+ | WideResNet50 | w8a8 | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | TFLITE | 2.128 ms | 0 - 108 MB | NPU | [WideResNet50.tflite](https://huggingface.co/qualcomm/WideResNet50/blob/main/WideResNet50_w8a8.tflite) |
73
+ | WideResNet50 | w8a8 | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | QNN_DLC | 2.517 ms | 0 - 112 MB | NPU | [WideResNet50.dlc](https://huggingface.co/qualcomm/WideResNet50/blob/main/WideResNet50_w8a8.dlc) |
74
+ | WideResNet50 | w8a8 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | TFLITE | 1.741 ms | 0 - 396 MB | NPU | [WideResNet50.tflite](https://huggingface.co/qualcomm/WideResNet50/blob/main/WideResNet50_w8a8.tflite) |
75
+ | WideResNet50 | w8a8 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | QNN_DLC | 1.881 ms | 0 - 368 MB | NPU | [WideResNet50.dlc](https://huggingface.co/qualcomm/WideResNet50/blob/main/WideResNet50_w8a8.dlc) |
76
+ | WideResNet50 | w8a8 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | ONNX | 2.197 ms | 0 - 171 MB | NPU | [WideResNet50.onnx.zip](https://huggingface.co/qualcomm/WideResNet50/blob/main/WideResNet50_w8a8.onnx.zip) |
77
+ | WideResNet50 | w8a8 | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | TFLITE | 1.889 ms | 0 - 43 MB | NPU | [WideResNet50.tflite](https://huggingface.co/qualcomm/WideResNet50/blob/main/WideResNet50_w8a8.tflite) |
78
+ | WideResNet50 | w8a8 | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | QNN_DLC | 2.006 ms | 0 - 46 MB | NPU | [WideResNet50.dlc](https://huggingface.co/qualcomm/WideResNet50/blob/main/WideResNet50_w8a8.dlc) |
79
+ | WideResNet50 | w8a8 | RB3 Gen 2 (Proxy) | Qualcomm® QCS6490 (Proxy) | TFLITE | 7.331 ms | 0 - 98 MB | NPU | [WideResNet50.tflite](https://huggingface.co/qualcomm/WideResNet50/blob/main/WideResNet50_w8a8.tflite) |
80
+ | WideResNet50 | w8a8 | RB3 Gen 2 (Proxy) | Qualcomm® QCS6490 (Proxy) | QNN_DLC | 9.925 ms | 0 - 98 MB | NPU | [WideResNet50.dlc](https://huggingface.co/qualcomm/WideResNet50/blob/main/WideResNet50_w8a8.dlc) |
81
+ | WideResNet50 | w8a8 | RB3 Gen 2 (Proxy) | Qualcomm® QCS6490 (Proxy) | ONNX | 76.425 ms | 13 - 30 MB | CPU | [WideResNet50.onnx.zip](https://huggingface.co/qualcomm/WideResNet50/blob/main/WideResNet50_w8a8.onnx.zip) |
82
+ | WideResNet50 | w8a8 | RB5 (Proxy) | Qualcomm® QCS8250 (Proxy) | TFLITE | 24.163 ms | 0 - 2 MB | NPU | [WideResNet50.tflite](https://huggingface.co/qualcomm/WideResNet50/blob/main/WideResNet50_w8a8.tflite) |
83
+ | WideResNet50 | w8a8 | RB5 (Proxy) | Qualcomm® QCS8250 (Proxy) | ONNX | 67.186 ms | 0 - 80 MB | CPU | [WideResNet50.onnx.zip](https://huggingface.co/qualcomm/WideResNet50/blob/main/WideResNet50_w8a8.onnx.zip) |
84
+ | WideResNet50 | w8a8 | SA7255P ADP | Qualcomm® SA7255P | TFLITE | 3.731 ms | 0 - 43 MB | NPU | [WideResNet50.tflite](https://huggingface.co/qualcomm/WideResNet50/blob/main/WideResNet50_w8a8.tflite) |
85
+ | WideResNet50 | w8a8 | SA7255P ADP | Qualcomm® SA7255P | QNN_DLC | 4.023 ms | 0 - 46 MB | NPU | [WideResNet50.dlc](https://huggingface.co/qualcomm/WideResNet50/blob/main/WideResNet50_w8a8.dlc) |
86
+ | WideResNet50 | w8a8 | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | TFLITE | 1.746 ms | 0 - 390 MB | NPU | [WideResNet50.tflite](https://huggingface.co/qualcomm/WideResNet50/blob/main/WideResNet50_w8a8.tflite) |
87
+ | WideResNet50 | w8a8 | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | QNN_DLC | 1.887 ms | 0 - 367 MB | NPU | [WideResNet50.dlc](https://huggingface.co/qualcomm/WideResNet50/blob/main/WideResNet50_w8a8.dlc) |
88
+ | WideResNet50 | w8a8 | SA8295P ADP | Qualcomm® SA8295P | TFLITE | 2.658 ms | 0 - 48 MB | NPU | [WideResNet50.tflite](https://huggingface.co/qualcomm/WideResNet50/blob/main/WideResNet50_w8a8.tflite) |
89
+ | WideResNet50 | w8a8 | SA8295P ADP | Qualcomm® SA8295P | QNN_DLC | 2.754 ms | 0 - 50 MB | NPU | [WideResNet50.dlc](https://huggingface.co/qualcomm/WideResNet50/blob/main/WideResNet50_w8a8.dlc) |
90
+ | WideResNet50 | w8a8 | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | TFLITE | 1.754 ms | 0 - 390 MB | NPU | [WideResNet50.tflite](https://huggingface.co/qualcomm/WideResNet50/blob/main/WideResNet50_w8a8.tflite) |
91
+ | WideResNet50 | w8a8 | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | QNN_DLC | 1.882 ms | 0 - 363 MB | NPU | [WideResNet50.dlc](https://huggingface.co/qualcomm/WideResNet50/blob/main/WideResNet50_w8a8.dlc) |
92
+ | WideResNet50 | w8a8 | SA8775P ADP | Qualcomm® SA8775P | TFLITE | 1.889 ms | 0 - 43 MB | NPU | [WideResNet50.tflite](https://huggingface.co/qualcomm/WideResNet50/blob/main/WideResNet50_w8a8.tflite) |
93
+ | WideResNet50 | w8a8 | SA8775P ADP | Qualcomm® SA8775P | QNN_DLC | 2.006 ms | 0 - 46 MB | NPU | [WideResNet50.dlc](https://huggingface.co/qualcomm/WideResNet50/blob/main/WideResNet50_w8a8.dlc) |
94
+ | WideResNet50 | w8a8 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | TFLITE | 1.32 ms | 0 - 107 MB | NPU | [WideResNet50.tflite](https://huggingface.co/qualcomm/WideResNet50/blob/main/WideResNet50_w8a8.tflite) |
95
+ | WideResNet50 | w8a8 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN_DLC | 1.423 ms | 0 - 108 MB | NPU | [WideResNet50.dlc](https://huggingface.co/qualcomm/WideResNet50/blob/main/WideResNet50_w8a8.dlc) |
96
+ | WideResNet50 | w8a8 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | ONNX | 1.576 ms | 0 - 112 MB | NPU | [WideResNet50.onnx.zip](https://huggingface.co/qualcomm/WideResNet50/blob/main/WideResNet50_w8a8.onnx.zip) |
97
+ | WideResNet50 | w8a8 | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | TFLITE | 1.159 ms | 0 - 50 MB | NPU | [WideResNet50.tflite](https://huggingface.co/qualcomm/WideResNet50/blob/main/WideResNet50_w8a8.tflite) |
98
+ | WideResNet50 | w8a8 | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | QNN_DLC | 1.172 ms | 0 - 48 MB | NPU | [WideResNet50.dlc](https://huggingface.co/qualcomm/WideResNet50/blob/main/WideResNet50_w8a8.dlc) |
99
+ | WideResNet50 | w8a8 | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | ONNX | 1.374 ms | 0 - 52 MB | NPU | [WideResNet50.onnx.zip](https://huggingface.co/qualcomm/WideResNet50/blob/main/WideResNet50_w8a8.onnx.zip) |
100
+ | WideResNet50 | w8a8 | Snapdragon 7 Gen 4 QRD | Snapdragon® 7 Gen 4 Mobile | TFLITE | 2.785 ms | 0 - 92 MB | NPU | [WideResNet50.tflite](https://huggingface.co/qualcomm/WideResNet50/blob/main/WideResNet50_w8a8.tflite) |
101
+ | WideResNet50 | w8a8 | Snapdragon 7 Gen 4 QRD | Snapdragon® 7 Gen 4 Mobile | QNN_DLC | 2.898 ms | 0 - 96 MB | NPU | [WideResNet50.dlc](https://huggingface.co/qualcomm/WideResNet50/blob/main/WideResNet50_w8a8.dlc) |
102
+ | WideResNet50 | w8a8 | Snapdragon 7 Gen 4 QRD | Snapdragon® 7 Gen 4 Mobile | ONNX | 58.309 ms | 14 - 31 MB | CPU | [WideResNet50.onnx.zip](https://huggingface.co/qualcomm/WideResNet50/blob/main/WideResNet50_w8a8.onnx.zip) |
103
+ | WideResNet50 | w8a8 | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | TFLITE | 1.088 ms | 0 - 52 MB | NPU | [WideResNet50.tflite](https://huggingface.co/qualcomm/WideResNet50/blob/main/WideResNet50_w8a8.tflite) |
104
+ | WideResNet50 | w8a8 | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | QNN_DLC | 1.09 ms | 0 - 53 MB | NPU | [WideResNet50.dlc](https://huggingface.co/qualcomm/WideResNet50/blob/main/WideResNet50_w8a8.dlc) |
105
+ | WideResNet50 | w8a8 | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | ONNX | 1.353 ms | 0 - 52 MB | NPU | [WideResNet50.onnx.zip](https://huggingface.co/qualcomm/WideResNet50/blob/main/WideResNet50_w8a8.onnx.zip) |
106
+ | WideResNet50 | w8a8 | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN_DLC | 1.819 ms | 395 - 395 MB | NPU | [WideResNet50.dlc](https://huggingface.co/qualcomm/WideResNet50/blob/main/WideResNet50_w8a8.dlc) |
107
+ | WideResNet50 | w8a8 | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 1.854 ms | 68 - 68 MB | NPU | [WideResNet50.onnx.zip](https://huggingface.co/qualcomm/WideResNet50/blob/main/WideResNet50_w8a8.onnx.zip) |
108
 
109
 
110
 
 
118
  ```
119
 
120
 
121
+ ## Configure Qualcomm® AI Hub Workbench to run this model on a cloud-hosted device
122
 
123
+ Sign-in to [Qualcomm® AI Hub Workbench](https://workbench.aihub.qualcomm.com/) with your
124
  Qualcomm® ID. Once signed in navigate to `Account -> Settings -> API Token`.
125
 
126
  With this API token, you can configure your client to run models on the cloud
 
128
  ```bash
129
  qai-hub configure --api_token API_TOKEN
130
  ```
131
+ Navigate to [docs](https://workbench.aihub.qualcomm.com/docs/) for more information.
132
 
133
 
134
 
 
239
  spot check the output with expected output.
240
 
241
  **Note**: This on-device profiling and inference requires access to Qualcomm®
242
+ AI Hub Workbench. [Sign up for access](https://myaccount.qualcomm.com/signup).
243
 
244
 
245
 
WideResNet50_float.dlc CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:0bc9317f02daeb9ccd704d58f707b154158f874009af8aa25a2676a2c185f2ab
3
- size 275535116
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9bcdc6070679b92939372c51bb5b86a2754048170e92ec32037bf8ee9c9b8a1b
3
+ size 275535220
WideResNet50_float.onnx.zip CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:c2e9c44d30293e8bb030fa05be471eb6adb664dd2a605769105ae2148bc27b41
3
  size 208910071
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:87e7423b96aa1b62d310118e03d6b908e0c59f07b53f5b8d3c96fb8f4917ee6e
3
  size 208910071
WideResNet50_w8a8.dlc CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:40b1de38ff80623ba4a896beb28817099d1d56a55933ed029a6eb701fda5af30
3
- size 71010228
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d1197c06b663c29a11b65caedadcdf8c9ff77f1d1fbef04dbbf83178a24f6a11
3
+ size 71010332
WideResNet50_w8a8.onnx.zip CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:047f9a60f72e3f45fcedc9855ad5f059b8837bd515e4318ed8ad435370731546
3
- size 111089272
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cae60dcd91934e6b52137e0d493095d7de297d0cbd51a4188cf7fafb50fa8df5
3
+ size 111089412
WideResNet50_w8a8.tflite CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:09d064094a1694616f55917d6b2d5d978b667cff09c2106d58db10680696cc07
3
  size 69825824
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8c1e0a4660f32a8154bc09b8d013807ddb1ae265202e713bbc755c639a214362
3
  size 69825824