Add model card
Browse files
README.md
CHANGED
|
@@ -1,3 +1,58 @@
|
|
| 1 |
---
|
| 2 |
license: apache-2.0
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 3 |
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
---
|
| 2 |
license: apache-2.0
|
| 3 |
+
base_model:
|
| 4 |
+
- alibaba-pai/Z-Image-Turbo-Fun-Controlnet-Union-2.1
|
| 5 |
+
- alibaba-pai/Qwen-Image-2512-Fun-Controlnet-Union
|
| 6 |
+
- InstantX/Qwen-Image-ControlNet-Union
|
| 7 |
+
base_model_relation: quantized
|
| 8 |
+
tags:
|
| 9 |
+
- comfyui
|
| 10 |
+
- controlnet
|
| 11 |
+
- int8
|
| 12 |
+
- convrot
|
| 13 |
+
- quantized
|
| 14 |
+
- z-image
|
| 15 |
+
- qwen-image
|
| 16 |
---
|
| 17 |
+
|
| 18 |
+
# ControlNet models β INT8 ConvRot
|
| 19 |
+
|
| 20 |
+
INT8 ConvRot quantized ControlNet models for **Z-Image** and **Qwen-Image**, in ComfyUI-native `.comfy_quant` format. Same quality as the bf16 originals, roughly half the VRAM and disk.
|
| 21 |
+
|
| 22 |
+
**Requires the loader patch:** stock ComfyUI cannot load INT8 ControlNet files (the ControlNet and model-patch loaders never got native INT8 support). Install
|
| 23 |
+
**https://github.com/0xBeycan/ComfyUI-ConvRot-ControlNet** β it patches the stock loader nodes, adds no new nodes, and leaves bf16 / fp8 ControlNets untouched.
|
| 24 |
+
|
| 25 |
+
## Files
|
| 26 |
+
|
| 27 |
+
| File | Put in | Load with | bf16 β INT8 | VRAM saved | PSNR vs bf16 |
|
| 28 |
+
|---|---|---|---|---|---|
|
| 29 |
+
| `Z-Image-Turbo-Fun-Controlnet-Union-2.1_int8_convrot.safetensors` | `models/model_patches/` | `ModelPatchLoader` | 6.71 β 3.36 GB | β3.0 GB | 42.0 dB |
|
| 30 |
+
| `Qwen-Image-2512-Fun-Controlnet-Union-2602_int8_convrot.safetensors` | `models/controlnet/` | `Load ControlNet Model` | 3.51 β 1.82 GB | β1.6 GB | 36.0 dB |
|
| 31 |
+
| `Qwen-Image-InstantX-ControlNet-Union_int8_convrot.safetensors` | `models/controlnet/` | `Load ControlNet Model` | 3.54 β 1.83 GB | β1.6 GB | 44.8 dB |
|
| 32 |
+
|
| 33 |
+
Each file was compared against its bf16 original at the same seed and settings. Generation speed was identical on the test hardware β the gain is memory, not time. Older GPUs (30/40 series) may see a speed-up from the INT8 kernel; not tested.
|
| 34 |
+
|
| 35 |
+
Test setup: RTX 5090, ComfyUI 0.33.1, PyTorch 2.10.0+cu130.
|
| 36 |
+
|
| 37 |
+
## Usage
|
| 38 |
+
|
| 39 |
+
1. Install [ComfyUI-ConvRot-ControlNet](https://github.com/0xBeycan/ComfyUI-ConvRot-ControlNet) into `custom_nodes/` and restart ComfyUI. Confirm the console shows `[ConvRot-ControlNet] patched 3/3 loaders`.
|
| 40 |
+
2. Drop the file into the folder from the table above.
|
| 41 |
+
3. In your existing workflow, select the `_int8_convrot` file in the same loader node you already use. Nothing else changes.
|
| 42 |
+
|
| 43 |
+
## Requirements
|
| 44 |
+
|
| 45 |
+
- ComfyUI β₯ 0.33 (native `int8_tensorwise` support in `comfy.quant_ops`)
|
| 46 |
+
- [ComfyUI-ConvRot-ControlNet](https://github.com/0xBeycan/ComfyUI-ConvRot-ControlNet)
|
| 47 |
+
|
| 48 |
+
## How they were made
|
| 49 |
+
|
| 50 |
+
Quantized with [silveroxides/convert_to_quant](https://github.com/silveroxides/convert_to_quant): INT8, ConvRot rotation (group size 256), **row-wise scaling** (`--scaling_mode row` β tensor-wise scaling breaks LoRA compatibility and softens output), `.comfy_quant` metadata. The zero-initialised / low-magnitude control-injection layers are kept in bf16 in every model, since quantizing them mutes the conditioning. The full recipe and per-model exclusion lists are in the loader repo's README.
|
| 51 |
+
|
| 52 |
+
## Sources
|
| 53 |
+
|
| 54 |
+
- [alibaba-pai/Z-Image-Turbo-Fun-Controlnet-Union-2.1](https://huggingface.co/alibaba-pai/Z-Image-Turbo-Fun-Controlnet-Union-2.1)
|
| 55 |
+
- [alibaba-pai/Qwen-Image-2512-Fun-Controlnet-Union](https://huggingface.co/alibaba-pai/Qwen-Image-2512-Fun-Controlnet-Union) (2602 release)
|
| 56 |
+
- [InstantX/Qwen-Image-ControlNet-Union](https://huggingface.co/InstantX/Qwen-Image-ControlNet-Union)
|
| 57 |
+
|
| 58 |
+
All three originals are Apache-2.0; these quantized files carry the same license.
|