# Looking for: Controlnets reference\_only model

**URL:** <https://discuss.huggingface.co/t/looking-for-controlnets-reference-only-model/156169>\
**Category:** Models\
**Created:** [May 21, 2025, 11:56am UTC](https://discuss.huggingface.co/t/looking-for-controlnets-reference-only-model/156169 "2025-05-21T11:56:45Z")\
**Posts on this page:** 4\
**Page:** 1

<div class="post-metadata">

**Author:** ![ABGA](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/abga/32/47978_2.png) [@ABGA](https://discuss.huggingface.co/u/ABGA)\
**Post date:** [May 21, 2025, 11:56am UTC](https://discuss.huggingface.co/t/looking-for-controlnets-reference-only-model/156169/1 "2025-05-21T11:56:45Z")

</div>

I am looking for **Controlnets reference\_only model** but it doesnt seem to be available out there anymore. Does anyone have it to share? thanks 🙂

---

<div class="post-metadata">

**Author:** ![John6666](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/john6666/32/27664_2.png) [@John6666](https://discuss.huggingface.co/u/John6666)\
**Post date:** [May 21, 2025, 12:13pm UTC](https://discuss.huggingface.co/t/looking-for-controlnets-reference-only-model/156169/2 "2025-05-21T12:13:15Z")

</div>

An IP adapter may be a substitute.

> **[Intel/sd-reference-only · Hugging Face](https://huggingface.co/Intel/sd-reference-only)**
>
> We’re on a journey to advance and democratize artificial intelligence through open source and open science.

> **[IP-Adapter](https://huggingface.co/docs/diffusers/main/en/using-diffusers/ip_adapter)**
>
> We’re on a journey to advance and democratize artificial intelligence through open source and open science.

> <https://github.com/huggingface/diffusers/issues/3701>
>
> sd-webui-controlnet now supports reference-only control, which does not require …any control models. it guides diffusion directly using images as references. It would be nice to have it on diffusers.
> 
> https://github.com/Mikubill/sd-webui-controlnet/pull/1235/files
> 
> I think the method for reference-only is continually added + updated which requires flexible implementation. Is there anything you want me to give you a hand?
> 
> https://github.com/Mikubill/sd-webui-controlnet/discussions/1280

> <https://github.com/huggingface/diffusers/issues/4675>
>
> \*\*Is your feature request related to a problem? Please describe.\*\*
> 
> There is c…urrently a Diffusers \[example for using "Reference Only" with ControlNet.\](https://github.com/huggingface/diffusers/blob/main/examples/community/stable\_diffusion\_controlnet\_reference.py) But there is not yet one for XL.
> 
> \*\*Describe the solution you'd like\*\*
> 
> It would be great to have an example for SD XL. 
> 
> Please and thanks!

---

<div class="post-metadata">

**Author:** ![ABGA](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/abga/32/47978_2.png) [@ABGA](https://discuss.huggingface.co/u/ABGA)\
**Post date:** [May 21, 2025, 12:58pm UTC](https://discuss.huggingface.co/t/looking-for-controlnets-reference-only-model/156169/3 "2025-05-21T12:58:43Z")

</div>

thanks alot for you reply. I a m just now trying out ip2p , but it still does gives me what I am aiming for which is control of a reference image in a new setting

---

<div class="post-metadata">

**Author:** ![ABGA](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/abga/32/47978_2.png) [@ABGA](https://discuss.huggingface.co/u/ABGA)\
**Post date:** [May 21, 2025, 1:14pm UTC](https://discuss.huggingface.co/t/looking-for-controlnets-reference-only-model/156169/4 "2025-05-21T13:14:10Z")

</div>

trying to see if this solves it. Under controlnet in control type if you mark reference then reference\_only can be chosen as pre-processor
