Innovate Futures @ Benji
patreon
RAVE AnimateDiff Animation Workflow Available in OpenArt
🕑 Added 2024-01-26 17:09:07 +0000 UTC
For anyone who are join as free members here, you can try this workflow in OpenArt:
https://openart.ai/workflows/AaH6b9J8oDPHmYenNJtS
This workflow use RAVE , AnimateDiff
RAVE: https://rave-video.github.io/
RAVE allows you to unleash your imagination and bring your wildest ideas to life. With just a few simple text prompts, you can completely change the style, theme, and even the characters in your videos. Imagine transforming a girl doing exercise into a firefighter or morphing a car into a truck, train, or fire truck.
By combining the power of RAVE and Animate Diff, you can achieve stunning visual effects and enhance the overall impact of your videos.
Wolkthrough Of This Workflow : https://www.youtube.com/watch?v=2kCs6MglK70
----------------------------------------------------------------------------
Also you need , AnimateDiff : https://animatediff.github.io/
----------------------------------------------------------------------------
ComfyUI RAVE Required Nodes:
https://github.com/spacepxl/ComfyUI-RAVE/tree/main
https://github.com/BlenderNeko/ComfyUI_Noise
----------------------------------------------------------------------------
Other Nodes We need:
ComfyUI-KJNodes(For Get Set Nodes)
***You need this to connection each nodes , you have to search "KJNodes" in ComfyUI Manager to download it
or get it in here : https://github.com/kijai/ComfyUI-KJNodes
----------------------------------------------------------------------------
ControlNet (copy in models/controlnet folder)
Depth: can be downloaded from ComfyUI manager
AnimateDiff Motion ControlNet : https://huggingface.co/crishhh/animatediff_controlnet/tree/main
Animatediff Motion Models: https://huggingface.co/guoyww/animatediff/tree/main
----------------------------------------------------------------------------
System Requirement
Min. Requirement : 15GB VRAM
Best number of frame range: 60-200 frames per each generation
Suggestted Frames Width And Height : 512, 560 , 980, 960, 920 px. (Do not try to run HD or 4K resolution in the LoadVideo. It will burn your computer memory in a second)
Suggestted ControlNet : Depth , DWPose, LineArt, Animate ControlNet.
----------------------------------------------------------------------------
If you do not have high end graphic card, I suggest you run this in OpenArt A10 cloud server.
I have not try other ComfyUI supported cloud server, so I cannot answer you about other company cloud servers.
----------------------------------------------------------------------------
P.S: Thank you for some supporters join into my Patreon. But some people are trying to game the system subscribe and cancel at the same day, and that cause the Patreon fraud detection system mark your action as suspicious activity. Their fraud detection system are going to block this automatically. When you try something shady on a system, then don't come here to blame me , try to leave a comment to bad mouth about it. I am just try to focus on making workflow, improve things and publish on public share with like minded people. I have no time to see every people joining in my Patreon activities.
Comments
ryanontheinside
would love if you did more on this
Benjamin Law
(high ceiling), (Gothic style) ,dark mansion, candle, (Windows frame)
Peter C
What were the prompts you used for the other backgrounds (besides the beach one that's included in the current .json)?
