Please add Controlnet for Flux models

[ivaxsirc]

Flux in Forge without controlnet it's like a cake missing an essential ingredient

Thanks

[Deonix59]

What's also missing is that the weights in the promt don't work.

[jajajajajajajajajajajajajajajajajajajaj]

that only works if you cntrl+up arrow key AND add brackets. it doesnt register the number you enter from the cntrl+up but it does register the number of brackets that you choose to use. you still need to do the cntrl+up otherwise it wont register the brackets at all

[wzwow]

please please please add controlnet for flux

[nitinmukesh]

And these are the available controlnet for FLUX that I know

Xlabs v3 controlnets: https://huggingface.co/XLabs-AI/flux-controlnet-collections
InstantX + Shakkerlabs union pro controlnet: https://huggingface.co/Shakker-Labs/FLUX.1-dev-ControlNet-Union-Pro
Mistoline: https://huggingface.co/TheMistoAI/MistoLine_Flux.dev

[ZeroCool22]

And these are the available controlnet for FLUX that I know

Xlabs v3 controlnets: https://huggingface.co/XLabs-AI/flux-controlnet-collections InstantX + Shakkerlabs union pro controlnet: https://huggingface.co/Shakker-Labs/FLUX.1-dev-ControlNet-Union-Pro Mistoline: https://huggingface.co/TheMistoAI/MistoLine_Flux.dev

But it has support now or not yet?

[nitinmukesh]

I don't know. I just mentioned the ones I found for Flux. Are these supported in Forge is only Devs can confirm.

[nitinmukesh]

Implementation is WiP as per the comment in following thread
#1685

[JohnneyTexas]

Line art (Es. realistic)
Depth (Es. dsine)
Normal map

[ZeroCool22]

We have support now?

[imago10]

Still nothing it will be so cool if we can please have some estimation is it gonna be after 1 week from now, month or never?

[GabrielSampol]

For me this is the only important thing missing. Still no news on when will Forge support Controlnet? Other platfoms like ComfyUI are already supporting it, but I wouldn't like to change to them unless it is really necessary.

[nitinmukesh]

I am also surprised. Earlier they were updating frequently but now they are just not updating.

[gabrielxcom]

Are we there yet?

[ZeroCool22]

Are we there yet?

[SunGreen777]

Perhaps work is underway on the internal part, which we cannot evaluate now, I really look forward to it and believe it

[juspar]

Following this. Really looking forward to controlnet for flux in Forge, don't wanna learn Comfy

[gabrielxcom]

Following this. Really looking forward to controlnet for flux in Forge, don't wanna learn Comfy

I'm on the same boat, Comfy nodes and workflow look like NASA stuff

[imago10]

I learned Comfy just for this. And for some reason it is about 10x slower and the results look even worse than SD 1.5 with Controlnet in Forge. I asked people on forums to share their workflows. I got a lot of bugs, spent many days fixing them and sometimes I randomly got some strange bug during iterations. So for me it is not worth it...

[mperez96]

I agree ControlNet in ComfyUI is not working propertly, is a hit or miss, in some cases it works fine, in others it doesn't. So I am not so sure, but I believe the reason it is still not in Forge is because there is not even a way to make it work better in Comfy, is a wip still.

[juspar]

Note from #932 (comment) Flux Controlnet rewrite start has been delayed several times and is currently not slated to start until Nov 20

[gabrielxcom]

Are we there yet? 👀