Innovate Futures @ Benji patreon

Stable Diffusion Animation Create Consistnace Character Youtube Dance Video (Tutorial Guide)

🕑 Added 2024-01-22 14:06:35 +0000 UTC

Comments

Benjamin Law

Select the motion model that you have. The one that I use is a finetuned motion model from v3 Motion model. From this question, i think you should back to the fundamental learn the file structure and how to load custome node in ComfyUI first.

Jack Mayer

pls help to solve this problem, Loading motion module v3_sd15_mm-kpop_dance200-finetuned.ckpt via Gen2 !!! Exception during processing!!! 'NoneType' object has no attribute 'lower' Error occurred when executing ADE_LoadAnimateDiffModel: 'NoneType' object has no attribute 'lower'

Benjamin Law

AnimateDiff Motion ControlNet : https://huggingface.co/crishhh/animatediff_controlnet/tree/main

ANNAY SIMS

Hello Benji Where can I find this Animate_controlnet_checkpoint.ckpt model with the same name?

Benjamin Law

That's weird, I never have that happen in Comfyui. Have you check the config file?

yohance modeste

I made my first video but it's not in the output folder. i found it in C:\ComfyUI_windows_portable\ComfyUI/temp how do i fix this so the final video after face swap goes to output folder?

Benjamin Law

Oh wow, I want to get one A100 too. Yes, it does have the frames limitation. That is the coding level of this Python. I think the developer have not handle momories caching.

karel svoboda

ok, let me answer to myself > no, you are not

Terry Craddock

The question I have for you Benji is this. How do you get around memory issues when using a control net for face poses? I am trying to make my new videos lip sync the audio. It works very well for short videos. Anything over a few hundred frames and I hit issues. My GPU has 45 gigs of vram. (Some times I have a A100 80gigs). I need to set up some sort of batch processing...... I would love to hear your thoughts on that.

yohance modeste

im on https://huggingface.co/laion/CLIP-ViT-H-14-laion2B-s32B-b79K/tree/main is it this? open_clip_pytorch_model.safetensors also where to find sd1.5/model.safetensors

yohance modeste

Hi, I'm trying to set up workflow correctly. where to find CLIP-ViT-H-14-laion2B-s32B-b79K.safetensors Is there a video that goes over this?

Benjamin Law

Let me know if you gen. some cool results.

Nelson

Thanks Benji. I run through the whole json script. Hope we can have a pipeline like cloth images to video + RAVE + Mesh Graphormer. (<- sounds like ultimate solution)

Benjamin Law

LOL I am not Kenji . the Lora here : https://civitai.com/models/58390

Yu Mu

Hi kengi. I have a question. I can't find it in the tutorial. where can i download >> Load LoRa file "add_detail_safetensors" ?

Benjamin Law

It's in here : Model Link and resource: https://thefuturethinker.org/stable-diffusion-animation-unleashing-the-power-of-rave-technology-for-video-editing/ then scroll down find the list everything is in there.

Nelson

HI Kengi. Such a great work. I have a question. Where can I download Animate_controlnet_checkpoint.ckpt?

Terry Craddock

It works fine for me. I am making videos right now as we speak. I just wish he would have release the rave with ip adapters. I am waiting for that one.

karel svoboda

are you willing to help with debugging? I ran into an error that I wasn't able to debugg, it seems to me like I'm the only one on this planet experience this... Both nodes installed via manager, animate diff and other workflows run without problems (until this happened, now they don't), but this.... when I load just the original example workflow - it occurs in both of them, i get : When loading the graph, the following node types were not found: BNK_DuplicateBatchIndex and in the cmd : [Errno 2] No such file or directory: 'D:\\ComfyUI_windows_portable\\ComfyUI\\custom_nodes\\ComfyUI-Advanced-ControlNet\\control/control.py\\__init__.py' Could not find AnimateDiff nodes so I un/re-install advanced control net - no change, un/re-install animatediff evolved - no change >>> do you have any suggestions or should I just try one custom node by one... ?