sebastiankamph
patreon
Simple sketch to image Comfy workflow
🕑 Added 2024-05-17 09:16:02 +0000 UTCI was playing around with sketch to image within Comfy and figured I'd share this simple workflow with you.
Drag & drop the .json workflow (download in bottom) or above image into Comfy.
Go into the manager and install any missing custom nodes.
Load the model you prefer.
Set your subject prompt in the top box and your style prompts in the bottom box.
Negative prompts go in the red node.
Using an LCM lora to speed up the generations, this is optional. Feel free to disable this to increase quality, but remember to change the sampler.
8 Steps in the KSampler is because we're using LCM sampler. If you disable the LCM lora you need to change the sampler_name and scheduler to dpm2m karras (or sampler of your preference) and around 20 steps.
Make sure you have the scribble controlnet. You can download it from Manager -> Models -> Scribble
Adjust controlnet strength and end_percent value if you need the image to closer resemble your sketch.
Strength 0.5-1
End_percent 0.4-1
Draw!
Remember to adjust the fill value to 1 if you want to draw shapes. This workflow will only understand black and white as a mask and will not retain colours.
Have fun!
Comments
Luis Reyes
I’ve been seeing people say this and they do load but I have to right click and click load image. Otherwise no image. Not sure what’s going on but it’s in a lot of posts. I just got your patron a few days ago and it’s great since I figured that load thing out. Thanks for your tips!
Sebastian Kamph
How do you mean images don't seem to be working? You can't see any images?
E
Images don't seem to be working on many posts my friend.
