Innovate Futures @ Benji
patreon
ComfyUI Workflow Create Animation Easy Consistent Style With Differential Diffusion Latent Noise
🕑 Added 2024-04-19 13:00:10 +0000 UTC
Full Workflow Creation Tutorial : https://youtu.be/alnrfN6F-lI
(Watch it before you ask any question, because things might covered already)
We'll be exploring different methods create ComfyUI Workflow to generate AI Animation Using Differential Diffusion, SEGs Mask, IPAdapter only.
Throughout the video, we'll be discussing the various techniques involved in the Differential Diffusion workflow. From IPAdapters to segmentation masking, we'll cover it all. I've done extensive research on this topic and have been experimenting with different methods to achieve stunning results.
a-person-mask-generator: https://github.com/djbielejeski/a-person-mask-generator
Differential Diffusion: https://differential-diffusion.github.io/
Workflow for Patreon Supporters : https://www.patreon.com/posts/102610598/
In this video, I'll be sharing some of my findings and demonstrating how you can use diffusions to transform the appearance of characters, specifically focusing on outfit changes. Imagine being able to alter the style of a dancer or a character without affecting their movements. It's truly fascinating!
I'll also be showcasing the use of different tools like COCO segmenter, Segment Anything, and the Person Mask Generator from Automatic 1111 extension to achieve accurate and efficient masking. These tools, combined with the powerful Comfy UI nodes, allow for precise control over the masking, growth, and shape of the character's outfit.
Additionally, I'll be introducing you to the concept of Differential Diffusion, a feature that's readily available in Comfy UI itself. I'll guide you through the process of using Differential Diffusion for image mapping, and how it can enhance your creations.
If you're interested in learning more about diffusions and how they can elevate your creative projects, this video is a must-watch. I'll be sharing some insider tips and tricks along the way, so make sure to stick around till the end.
Don't forget to hit that like button if you find this video helpful, and don't hesitate to leave a comment if you have any questions or suggestions. And of course, make sure to subscribe to my channel for more exciting content like this!
Discord : https://discord.gg/BTXWX4vVTS
Comments
Benjamin Law
Looks like there's a conflict on checkpoint type
Josephine Miller
Do you know what is causing this issue: "Error occurred when executing CheckpointLoaderSimple: 'model.diffusion_model.input_blocks.0.0.weight'"
ζ¨ θ
I have watched your videos many times. The workflow is the same as the settings in the video. The model uses realDream_turboLCM6. How can I upload the video I made for you to take a look at.
Benjamin Law
Show us your generate result, the input you use and setting. Also , know that you are in join, you created your own workflow. So I don't know what is your workflow's nodes that are using.
ζ¨ θ
Why is the video I generated so unclear?
Benjamin Law
Just don't need it, since IPAdaptor is smart enough to do it now.
Finn Negrello
Im recieving the error " Error occurred when executing RemBGSession+: [WinError 267] The directory name is invalid: 'E:\\AI_Advantage\\Data\\Packages\\ComfyUI\\venv\\lib\\site-packages\\jsonschema_specifications\\schemas\\desktop.ini'" I think it's because my comfy env is running in python 3.10.11 and Rembf requires either "python: >3.7, <3.13". I can't change the python version as I use Stability Matrix to manage my workflows, etc. Could you pretty please advise me to another bg removal node you'd reccomend and how I should change the current workflow to allow for it to work.
Benjamin Law
π π bro, that is very difficult in Patreon. Let me think how to build 1 community for China.π
ζ¨ θ
How can I pay using Alipay
Benjamin Law
enjoy it :)
Mauricio Tonon
Ooooh i was waiting for this! You are a genious
