File size: 18,129 Bytes
24f23e5
 
 
 
 
 
 
 
 
 
 
 
9419161
24f23e5
 
 
9419161
4b5a77b
9419161
 
 
 
 
 
 
 
 
 
 
 
1b0bd2c
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
9419161
 
 
 
 
 
4b5a77b
9419161
 
 
 
 
 
4b5a77b
9419161
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1b0bd2c
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
83eb61a
1b0bd2c
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
24f23e5
 
 
 
 
 
 
 
 
 
 
 
 
9419161
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
---
library_name: pytorch
license: other
tags:
- generative_ai
- android
pipeline_tag: unconditional-image-generation

---

![](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/controlnet_canny/web-assets/model_demo.png)

# ControlNet-Canny: Optimized for Qualcomm Devices

On-device, high-resolution image synthesis from text and image prompts. ControlNet guides Stable-diffusion with provided input image to generate accurate images from given input prompt.

This is based on the implementation of ControlNet-Canny found [here](https://github.com/lllyasviel/ControlNet).
This repository contains pre-exported model files optimized for Qualcomm® devices. You can use the [Qualcomm® AI Hub Models](https://github.com/qualcomm/ai-hub-models/blob/main/src/qai_hub_models/models/controlnet_canny) library to export with custom configurations. More details on model performance across various devices, can be found [here](#performance-summary).

Qualcomm AI Hub Models uses [Qualcomm AI Hub Workbench](https://workbench.aihub.qualcomm.com) to compile, profile, and evaluate this model. [Sign up](https://myaccount.qualcomm.com/signup) to run these models on a hosted Qualcomm® device.

## Getting Started
There are two ways to deploy this model on your device:

### Option 1: Download Pre-Exported Models

Below are pre-exported model assets ready for deployment.

| Runtime | Precision | Chipset | SDK Versions | Download |
|---|---|---|---|---|
| PRECOMPILED_QNN_ONNX | w8a16 | qualcomm_qcm6690 | QAIRT 2.42, ONNX Runtime 1.24.3 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/controlnet_canny/releases/v0.50.2/controlnet_canny-precompiled_qnn_onnx-w8a16-qualcomm_qcm6690.zip)
| PRECOMPILED_QNN_ONNX | w8a16 | qualcomm_qcs8550_proxy | QAIRT 2.42, ONNX Runtime 1.24.3 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/controlnet_canny/releases/v0.50.2/controlnet_canny-precompiled_qnn_onnx-w8a16-qualcomm_qcs8550_proxy.zip)
| PRECOMPILED_QNN_ONNX | w8a16 | qualcomm_qcs9075 | QAIRT 2.42, ONNX Runtime 1.24.3 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/controlnet_canny/releases/v0.50.2/controlnet_canny-precompiled_qnn_onnx-w8a16-qualcomm_qcs9075.zip)
| PRECOMPILED_QNN_ONNX | w8a16 | qualcomm_snapdragon_7gen4 | QAIRT 2.42, ONNX Runtime 1.24.3 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/controlnet_canny/releases/v0.50.2/controlnet_canny-precompiled_qnn_onnx-w8a16-qualcomm_snapdragon_7gen4.zip)
| PRECOMPILED_QNN_ONNX | w8a16 | qualcomm_snapdragon_8_elite_for_galaxy | QAIRT 2.42, ONNX Runtime 1.24.3 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/controlnet_canny/releases/v0.50.2/controlnet_canny-precompiled_qnn_onnx-w8a16-qualcomm_snapdragon_8_elite_for_galaxy.zip)
| PRECOMPILED_QNN_ONNX | w8a16 | qualcomm_snapdragon_8_elite_gen5 | QAIRT 2.42, ONNX Runtime 1.24.3 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/controlnet_canny/releases/v0.50.2/controlnet_canny-precompiled_qnn_onnx-w8a16-qualcomm_snapdragon_8_elite_gen5.zip)
| PRECOMPILED_QNN_ONNX | w8a16 | qualcomm_snapdragon_8gen3 | QAIRT 2.42, ONNX Runtime 1.24.3 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/controlnet_canny/releases/v0.50.2/controlnet_canny-precompiled_qnn_onnx-w8a16-qualcomm_snapdragon_8gen3.zip)
| PRECOMPILED_QNN_ONNX | w8a16 | qualcomm_snapdragon_x2_elite | QAIRT 2.42, ONNX Runtime 1.24.3 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/controlnet_canny/releases/v0.50.2/controlnet_canny-precompiled_qnn_onnx-w8a16-qualcomm_snapdragon_x2_elite.zip)
| PRECOMPILED_QNN_ONNX | w8a16 | qualcomm_snapdragon_x_elite | QAIRT 2.42, ONNX Runtime 1.24.3 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/controlnet_canny/releases/v0.50.2/controlnet_canny-precompiled_qnn_onnx-w8a16-qualcomm_snapdragon_x_elite.zip)
| QNN_CONTEXT_BINARY | w8a16 | qualcomm_qcm6690 | QAIRT 2.43 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/controlnet_canny/releases/v0.50.2/controlnet_canny-qnn_context_binary-w8a16-qualcomm_qcm6690.zip)
| QNN_CONTEXT_BINARY | w8a16 | qualcomm_qcs8550_proxy | QAIRT 2.43 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/controlnet_canny/releases/v0.50.2/controlnet_canny-qnn_context_binary-w8a16-qualcomm_qcs8550_proxy.zip)
| QNN_CONTEXT_BINARY | w8a16 | qualcomm_qcs9075 | QAIRT 2.43 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/controlnet_canny/releases/v0.50.2/controlnet_canny-qnn_context_binary-w8a16-qualcomm_qcs9075.zip)
| QNN_CONTEXT_BINARY | w8a16 | qualcomm_sa7255p | QAIRT 2.43 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/controlnet_canny/releases/v0.50.2/controlnet_canny-qnn_context_binary-w8a16-qualcomm_sa7255p.zip)
| QNN_CONTEXT_BINARY | w8a16 | qualcomm_sa8775p | QAIRT 2.43 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/controlnet_canny/releases/v0.50.2/controlnet_canny-qnn_context_binary-w8a16-qualcomm_sa8775p.zip)
| QNN_CONTEXT_BINARY | w8a16 | qualcomm_snapdragon_7gen4 | QAIRT 2.43 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/controlnet_canny/releases/v0.50.2/controlnet_canny-qnn_context_binary-w8a16-qualcomm_snapdragon_7gen4.zip)
| QNN_CONTEXT_BINARY | w8a16 | qualcomm_snapdragon_8_elite_for_galaxy | QAIRT 2.43 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/controlnet_canny/releases/v0.50.2/controlnet_canny-qnn_context_binary-w8a16-qualcomm_snapdragon_8_elite_for_galaxy.zip)
| QNN_CONTEXT_BINARY | w8a16 | qualcomm_snapdragon_8_elite_gen5 | QAIRT 2.43 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/controlnet_canny/releases/v0.50.2/controlnet_canny-qnn_context_binary-w8a16-qualcomm_snapdragon_8_elite_gen5.zip)
| QNN_CONTEXT_BINARY | w8a16 | qualcomm_snapdragon_8gen3 | QAIRT 2.43 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/controlnet_canny/releases/v0.50.2/controlnet_canny-qnn_context_binary-w8a16-qualcomm_snapdragon_8gen3.zip)
| QNN_CONTEXT_BINARY | w8a16 | qualcomm_snapdragon_x2_elite | QAIRT 2.43 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/controlnet_canny/releases/v0.50.2/controlnet_canny-qnn_context_binary-w8a16-qualcomm_snapdragon_x2_elite.zip)
| QNN_CONTEXT_BINARY | w8a16 | qualcomm_snapdragon_x_elite | QAIRT 2.43 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/controlnet_canny/releases/v0.50.2/controlnet_canny-qnn_context_binary-w8a16-qualcomm_snapdragon_x_elite.zip)

For more device-specific assets and performance metrics, visit **[ControlNet-Canny on Qualcomm® AI Hub](https://aihub.qualcomm.com/models/controlnet_canny)**.


### Option 2: Export with Custom Configurations

Use the [Qualcomm® AI Hub Models](https://github.com/qualcomm/ai-hub-models/blob/main/src/qai_hub_models/models/controlnet_canny) Python library to compile and export the model with your own:
- Custom weights (e.g., fine-tuned checkpoints)
- Custom input shapes
- Target device and runtime configurations

This option is ideal if you need to customize the model beyond the default configuration provided here.

See our repository for [ControlNet-Canny on GitHub](https://github.com/qualcomm/ai-hub-models/blob/main/src/qai_hub_models/models/controlnet_canny) for usage instructions.

## Model Details

**Model Type:** Model_use_case.image_generation

**Model Stats:**
- Input: Text prompt and input image as a reference
- Conditioning Input: Canny-Edge
- Text Encoder Number of parameters: 340M
- UNet Number of parameters: 865M
- VAE Decoder Number of parameters: 83M
- ControlNet Number of parameters: 361M
- Model size: 1.4GB

## Performance Summary
| Model | Runtime | Precision | Chipset | Inference Time (ms) | Peak Memory Range (MB) | Primary Compute Unit
|---|---|---|---|---|---|---
| controlnet | PRECOMPILED_QNN_ONNX | w8a16 | Snapdragon® 8 Elite Gen 5 Mobile | 28.71 ms | 32 - 43 MB | NPU
| controlnet | PRECOMPILED_QNN_ONNX | w8a16 | Snapdragon® X2 Elite | 28.6 ms | 351 - 351 MB | NPU
| controlnet | PRECOMPILED_QNN_ONNX | w8a16 | Snapdragon® X Elite | 75.995 ms | 351 - 351 MB | NPU
| controlnet | PRECOMPILED_QNN_ONNX | w8a16 | Snapdragon® 8 Gen 3 Mobile | 65.339 ms | 31 - 43 MB | NPU
| controlnet | PRECOMPILED_QNN_ONNX | w8a16 | Qualcomm® QCS8550 (Proxy) | 82.583 ms | 30 - 32 MB | NPU
| controlnet | PRECOMPILED_QNN_ONNX | w8a16 | Qualcomm® QCS9075 | 75.594 ms | 32 - 36 MB | NPU
| controlnet | PRECOMPILED_QNN_ONNX | w8a16 | Qualcomm® QCM6690 | 1252.25 ms | 15 - 25 MB | NPU
| controlnet | PRECOMPILED_QNN_ONNX | w8a16 | Snapdragon® 8 Elite For Galaxy Mobile | 48.148 ms | 32 - 45 MB | NPU
| controlnet | PRECOMPILED_QNN_ONNX | w8a16 | Snapdragon® 7 Gen 4 Mobile | 123.111 ms | 31 - 37 MB | NPU
| controlnet | QNN_CONTEXT_BINARY | w8a16 | Snapdragon® 8 Elite Gen 5 Mobile | 29.406 ms | 2 - 11 MB | NPU
| controlnet | QNN_CONTEXT_BINARY | w8a16 | Snapdragon® X2 Elite | 29.512 ms | 2 - 2 MB | NPU
| controlnet | QNN_CONTEXT_BINARY | w8a16 | Snapdragon® X Elite | 76.005 ms | 2 - 2 MB | NPU
| controlnet | QNN_CONTEXT_BINARY | w8a16 | Snapdragon® 8 Gen 3 Mobile | 60.578 ms | 2 - 9 MB | NPU
| controlnet | QNN_CONTEXT_BINARY | w8a16 | Qualcomm® QCS8275 (Proxy) | 141.014 ms | 2 - 9 MB | NPU
| controlnet | QNN_CONTEXT_BINARY | w8a16 | Qualcomm® QCS8550 (Proxy) | 81.91 ms | 2 - 3 MB | NPU
| controlnet | QNN_CONTEXT_BINARY | w8a16 | Qualcomm® SA8775P | 77.876 ms | 2 - 9 MB | NPU
| controlnet | QNN_CONTEXT_BINARY | w8a16 | Qualcomm® QCS9075 | 76.803 ms | 2 - 18 MB | NPU
| controlnet | QNN_CONTEXT_BINARY | w8a16 | Qualcomm® QCM6690 | 1185.356 ms | 2 - 8 MB | NPU
| controlnet | QNN_CONTEXT_BINARY | w8a16 | Qualcomm® SA7255P | 141.014 ms | 2 - 9 MB | NPU
| controlnet | QNN_CONTEXT_BINARY | w8a16 | Snapdragon® 8 Elite For Galaxy Mobile | 46.871 ms | 2 - 15 MB | NPU
| controlnet | QNN_CONTEXT_BINARY | w8a16 | Snapdragon® 7 Gen 4 Mobile | 121.53 ms | 2 - 8 MB | NPU
| text_encoder | PRECOMPILED_QNN_ONNX | w8a16 | Snapdragon® 8 Elite Gen 5 Mobile | 1.487 ms | 0 - 10 MB | NPU
| text_encoder | PRECOMPILED_QNN_ONNX | w8a16 | Snapdragon® X2 Elite | 1.792 ms | 156 - 156 MB | NPU
| text_encoder | PRECOMPILED_QNN_ONNX | w8a16 | Snapdragon® X Elite | 3.629 ms | 156 - 156 MB | NPU
| text_encoder | PRECOMPILED_QNN_ONNX | w8a16 | Snapdragon® 8 Gen 3 Mobile | 2.305 ms | 0 - 6 MB | NPU
| text_encoder | PRECOMPILED_QNN_ONNX | w8a16 | Qualcomm® QCS8550 (Proxy) | 3.24 ms | 0 - 161 MB | NPU
| text_encoder | PRECOMPILED_QNN_ONNX | w8a16 | Qualcomm® QCS9075 | 3.347 ms | 0 - 3 MB | NPU
| text_encoder | PRECOMPILED_QNN_ONNX | w8a16 | Qualcomm® QCM6690 | 22.477 ms | 0 - 10 MB | NPU
| text_encoder | PRECOMPILED_QNN_ONNX | w8a16 | Snapdragon® 8 Elite For Galaxy Mobile | 1.751 ms | 0 - 7 MB | NPU
| text_encoder | PRECOMPILED_QNN_ONNX | w8a16 | Snapdragon® 7 Gen 4 Mobile | 3.627 ms | 0 - 6 MB | NPU
| text_encoder | QNN_CONTEXT_BINARY | w8a16 | Snapdragon® 8 Elite Gen 5 Mobile | 1.489 ms | 0 - 10 MB | NPU
| text_encoder | QNN_CONTEXT_BINARY | w8a16 | Snapdragon® X2 Elite | 1.772 ms | 0 - 0 MB | NPU
| text_encoder | QNN_CONTEXT_BINARY | w8a16 | Snapdragon® X Elite | 3.638 ms | 0 - 0 MB | NPU
| text_encoder | QNN_CONTEXT_BINARY | w8a16 | Snapdragon® 8 Gen 3 Mobile | 2.339 ms | 0 - 7 MB | NPU
| text_encoder | QNN_CONTEXT_BINARY | w8a16 | Qualcomm® QCS8275 (Proxy) | 7.519 ms | 0 - 8 MB | NPU
| text_encoder | QNN_CONTEXT_BINARY | w8a16 | Qualcomm® QCS8550 (Proxy) | 3.262 ms | 0 - 2 MB | NPU
| text_encoder | QNN_CONTEXT_BINARY | w8a16 | Qualcomm® SA8775P | 3.548 ms | 0 - 9 MB | NPU
| text_encoder | QNN_CONTEXT_BINARY | w8a16 | Qualcomm® QCS9075 | 3.358 ms | 2 - 4 MB | NPU
| text_encoder | QNN_CONTEXT_BINARY | w8a16 | Qualcomm® QCM6690 | 21.98 ms | 0 - 6 MB | NPU
| text_encoder | QNN_CONTEXT_BINARY | w8a16 | Qualcomm® SA7255P | 7.519 ms | 0 - 8 MB | NPU
| text_encoder | QNN_CONTEXT_BINARY | w8a16 | Snapdragon® 8 Elite For Galaxy Mobile | 1.747 ms | 0 - 9 MB | NPU
| text_encoder | QNN_CONTEXT_BINARY | w8a16 | Snapdragon® 7 Gen 4 Mobile | 3.664 ms | 0 - 6 MB | NPU
| unet | PRECOMPILED_QNN_ONNX | w8a16 | Snapdragon® 8 Elite Gen 5 Mobile | 47.452 ms | 13 - 22 MB | NPU
| unet | PRECOMPILED_QNN_ONNX | w8a16 | Snapdragon® X2 Elite | 48.58 ms | 831 - 831 MB | NPU
| unet | PRECOMPILED_QNN_ONNX | w8a16 | Snapdragon® X Elite | 114.374 ms | 829 - 829 MB | NPU
| unet | PRECOMPILED_QNN_ONNX | w8a16 | Snapdragon® 8 Gen 3 Mobile | 81.993 ms | 13 - 24 MB | NPU
| unet | PRECOMPILED_QNN_ONNX | w8a16 | Qualcomm® QCS8550 (Proxy) | 112.812 ms | 0 - 883 MB | NPU
| unet | PRECOMPILED_QNN_ONNX | w8a16 | Qualcomm® QCS9075 | 106.379 ms | 13 - 29 MB | NPU
| unet | PRECOMPILED_QNN_ONNX | w8a16 | Qualcomm® QCM6690 | 2157.664 ms | 13 - 24 MB | NPU
| unet | PRECOMPILED_QNN_ONNX | w8a16 | Snapdragon® 8 Elite For Galaxy Mobile | 60.97 ms | 6 - 19 MB | NPU
| unet | PRECOMPILED_QNN_ONNX | w8a16 | Snapdragon® 7 Gen 4 Mobile | 181.557 ms | 9 - 20 MB | NPU
| unet | QNN_CONTEXT_BINARY | w8a16 | Snapdragon® 8 Elite Gen 5 Mobile | 45.813 ms | 13 - 22 MB | NPU
| unet | QNN_CONTEXT_BINARY | w8a16 | Snapdragon® X2 Elite | 46.505 ms | 13 - 13 MB | NPU
| unet | QNN_CONTEXT_BINARY | w8a16 | Snapdragon® X Elite | 113.537 ms | 13 - 13 MB | NPU
| unet | QNN_CONTEXT_BINARY | w8a16 | Snapdragon® 8 Gen 3 Mobile | 80.443 ms | 13 - 20 MB | NPU
| unet | QNN_CONTEXT_BINARY | w8a16 | Qualcomm® QCS8275 (Proxy) | 266.689 ms | 8 - 15 MB | NPU
| unet | QNN_CONTEXT_BINARY | w8a16 | Qualcomm® QCS8550 (Proxy) | 112.503 ms | 14 - 16 MB | NPU
| unet | QNN_CONTEXT_BINARY | w8a16 | Qualcomm® SA8775P | 107.709 ms | 9 - 16 MB | NPU
| unet | QNN_CONTEXT_BINARY | w8a16 | Qualcomm® QCS9075 | 107.129 ms | 11 - 25 MB | NPU
| unet | QNN_CONTEXT_BINARY | w8a16 | Qualcomm® QCM6690 | 2088.174 ms | 13 - 24 MB | NPU
| unet | QNN_CONTEXT_BINARY | w8a16 | Qualcomm® SA7255P | 266.689 ms | 8 - 15 MB | NPU
| unet | QNN_CONTEXT_BINARY | w8a16 | Snapdragon® 8 Elite For Galaxy Mobile | 63.548 ms | 6 - 19 MB | NPU
| unet | QNN_CONTEXT_BINARY | w8a16 | Snapdragon® 7 Gen 4 Mobile | 180.606 ms | 10 - 17 MB | NPU
| vae | PRECOMPILED_QNN_ONNX | w8a16 | Snapdragon® 8 Elite Gen 5 Mobile | 120.044 ms | 3 - 13 MB | NPU
| vae | PRECOMPILED_QNN_ONNX | w8a16 | Snapdragon® X2 Elite | 125.281 ms | 62 - 62 MB | NPU
| vae | PRECOMPILED_QNN_ONNX | w8a16 | Snapdragon® X Elite | 266.338 ms | 62 - 62 MB | NPU
| vae | PRECOMPILED_QNN_ONNX | w8a16 | Snapdragon® 8 Gen 3 Mobile | 202.267 ms | 3 - 10 MB | NPU
| vae | PRECOMPILED_QNN_ONNX | w8a16 | Qualcomm® QCS8550 (Proxy) | 275.287 ms | 0 - 66 MB | NPU
| vae | PRECOMPILED_QNN_ONNX | w8a16 | Qualcomm® QCS9075 | 250.024 ms | 3 - 6 MB | NPU
| vae | PRECOMPILED_QNN_ONNX | w8a16 | Qualcomm® QCM6690 | 6222.561 ms | 1 - 8 MB | NPU
| vae | PRECOMPILED_QNN_ONNX | w8a16 | Snapdragon® 8 Elite For Galaxy Mobile | 178.729 ms | 4 - 11 MB | NPU
| vae | PRECOMPILED_QNN_ONNX | w8a16 | Snapdragon® 7 Gen 4 Mobile | 512.482 ms | 2 - 8 MB | NPU
| vae | QNN_CONTEXT_BINARY | w8a16 | Snapdragon® 8 Elite Gen 5 Mobile | 127.688 ms | 0 - 10 MB | NPU
| vae | QNN_CONTEXT_BINARY | w8a16 | Snapdragon® X2 Elite | 133.676 ms | 0 - 0 MB | NPU
| vae | QNN_CONTEXT_BINARY | w8a16 | Snapdragon® X Elite | 262.783 ms | 0 - 0 MB | NPU
| vae | QNN_CONTEXT_BINARY | w8a16 | Snapdragon® 8 Gen 3 Mobile | 202.426 ms | 0 - 8 MB | NPU
| vae | QNN_CONTEXT_BINARY | w8a16 | Qualcomm® QCS8275 (Proxy) | 718.88 ms | 0 - 9 MB | NPU
| vae | QNN_CONTEXT_BINARY | w8a16 | Qualcomm® QCS8550 (Proxy) | 269.014 ms | 0 - 2 MB | NPU
| vae | QNN_CONTEXT_BINARY | w8a16 | Qualcomm® SA8775P | 250.544 ms | 0 - 8 MB | NPU
| vae | QNN_CONTEXT_BINARY | w8a16 | Qualcomm® QCS9075 | 247.561 ms | 0 - 3 MB | NPU
| vae | QNN_CONTEXT_BINARY | w8a16 | Qualcomm® QCM6690 | 6429.764 ms | 0 - 6 MB | NPU
| vae | QNN_CONTEXT_BINARY | w8a16 | Qualcomm® SA7255P | 718.88 ms | 0 - 9 MB | NPU
| vae | QNN_CONTEXT_BINARY | w8a16 | Snapdragon® 8 Elite For Galaxy Mobile | 176.151 ms | 0 - 9 MB | NPU
| vae | QNN_CONTEXT_BINARY | w8a16 | Snapdragon® 7 Gen 4 Mobile | 513.926 ms | 1 - 7 MB | NPU

## License
* The license for the original implementation of ControlNet-Canny can be found
  [here](https://github.com/lllyasviel/ControlNet/blob/main/LICENSE).

## References
* [Adding Conditional Control to Text-to-Image Diffusion Models](https://arxiv.org/abs/2302.05543)
* [Source Model Implementation](https://github.com/lllyasviel/ControlNet)

## Community
* Join [our AI Hub Slack community](https://aihub.qualcomm.com/community/slack) to collaborate, post questions and learn more about on-device AI.
* For questions or feedback please [reach out to us](mailto:ai-hub-support@qti.qualcomm.com).

## Usage and Limitations

This model may not be used for or in connection with any of the following applications:

- Accessing essential private and public services and benefits;
- Administration of justice and democratic processes;
- Assessing or recognizing the emotional state of a person;
- Biometric and biometrics-based systems, including categorization of persons based on sensitive characteristics;
- Education and vocational training;
- Employment and workers management;
- Exploitation of the vulnerabilities of persons resulting in harmful behavior;
- General purpose social scoring;
- Law enforcement;
- Management and operation of critical infrastructure;
- Migration, asylum and border control management;
- Predictive policing;
- Real-time remote biometric identification in public spaces;
- Recommender systems of social media platforms;
- Scraping of facial images (from the internet or otherwise); and/or
- Subliminal manipulation