beycanai commited on
Commit
69049f5
Β·
verified Β·
1 Parent(s): 4dfb78d

Add model card

Browse files
Files changed (1) hide show
  1. README.md +55 -0
README.md CHANGED
@@ -1,3 +1,58 @@
1
  ---
2
  license: apache-2.0
 
 
 
 
 
 
 
 
 
 
 
 
 
3
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
  license: apache-2.0
3
+ base_model:
4
+ - alibaba-pai/Z-Image-Turbo-Fun-Controlnet-Union-2.1
5
+ - alibaba-pai/Qwen-Image-2512-Fun-Controlnet-Union
6
+ - InstantX/Qwen-Image-ControlNet-Union
7
+ base_model_relation: quantized
8
+ tags:
9
+ - comfyui
10
+ - controlnet
11
+ - int8
12
+ - convrot
13
+ - quantized
14
+ - z-image
15
+ - qwen-image
16
  ---
17
+
18
+ # ControlNet models β€” INT8 ConvRot
19
+
20
+ INT8 ConvRot quantized ControlNet models for **Z-Image** and **Qwen-Image**, in ComfyUI-native `.comfy_quant` format. Same quality as the bf16 originals, roughly half the VRAM and disk.
21
+
22
+ **Requires the loader patch:** stock ComfyUI cannot load INT8 ControlNet files (the ControlNet and model-patch loaders never got native INT8 support). Install
23
+ **https://github.com/0xBeycan/ComfyUI-ConvRot-ControlNet** β€” it patches the stock loader nodes, adds no new nodes, and leaves bf16 / fp8 ControlNets untouched.
24
+
25
+ ## Files
26
+
27
+ | File | Put in | Load with | bf16 β†’ INT8 | VRAM saved | PSNR vs bf16 |
28
+ |---|---|---|---|---|---|
29
+ | `Z-Image-Turbo-Fun-Controlnet-Union-2.1_int8_convrot.safetensors` | `models/model_patches/` | `ModelPatchLoader` | 6.71 β†’ 3.36 GB | βˆ’3.0 GB | 42.0 dB |
30
+ | `Qwen-Image-2512-Fun-Controlnet-Union-2602_int8_convrot.safetensors` | `models/controlnet/` | `Load ControlNet Model` | 3.51 β†’ 1.82 GB | βˆ’1.6 GB | 36.0 dB |
31
+ | `Qwen-Image-InstantX-ControlNet-Union_int8_convrot.safetensors` | `models/controlnet/` | `Load ControlNet Model` | 3.54 β†’ 1.83 GB | βˆ’1.6 GB | 44.8 dB |
32
+
33
+ Each file was compared against its bf16 original at the same seed and settings. Generation speed was identical on the test hardware β€” the gain is memory, not time. Older GPUs (30/40 series) may see a speed-up from the INT8 kernel; not tested.
34
+
35
+ Test setup: RTX 5090, ComfyUI 0.33.1, PyTorch 2.10.0+cu130.
36
+
37
+ ## Usage
38
+
39
+ 1. Install [ComfyUI-ConvRot-ControlNet](https://github.com/0xBeycan/ComfyUI-ConvRot-ControlNet) into `custom_nodes/` and restart ComfyUI. Confirm the console shows `[ConvRot-ControlNet] patched 3/3 loaders`.
40
+ 2. Drop the file into the folder from the table above.
41
+ 3. In your existing workflow, select the `_int8_convrot` file in the same loader node you already use. Nothing else changes.
42
+
43
+ ## Requirements
44
+
45
+ - ComfyUI β‰₯ 0.33 (native `int8_tensorwise` support in `comfy.quant_ops`)
46
+ - [ComfyUI-ConvRot-ControlNet](https://github.com/0xBeycan/ComfyUI-ConvRot-ControlNet)
47
+
48
+ ## How they were made
49
+
50
+ Quantized with [silveroxides/convert_to_quant](https://github.com/silveroxides/convert_to_quant): INT8, ConvRot rotation (group size 256), **row-wise scaling** (`--scaling_mode row` β€” tensor-wise scaling breaks LoRA compatibility and softens output), `.comfy_quant` metadata. The zero-initialised / low-magnitude control-injection layers are kept in bf16 in every model, since quantizing them mutes the conditioning. The full recipe and per-model exclusion lists are in the loader repo's README.
51
+
52
+ ## Sources
53
+
54
+ - [alibaba-pai/Z-Image-Turbo-Fun-Controlnet-Union-2.1](https://huggingface.co/alibaba-pai/Z-Image-Turbo-Fun-Controlnet-Union-2.1)
55
+ - [alibaba-pai/Qwen-Image-2512-Fun-Controlnet-Union](https://huggingface.co/alibaba-pai/Qwen-Image-2512-Fun-Controlnet-Union) (2602 release)
56
+ - [InstantX/Qwen-Image-ControlNet-Union](https://huggingface.co/InstantX/Qwen-Image-ControlNet-Union)
57
+
58
+ All three originals are Apache-2.0; these quantized files carry the same license.