Innovate Futures @ Benji
patreon
Stable Diffusion Animation Create Unique Outfits For YT Shorts Dance AI Video
🕑 Added 2024-01-15 15:20:20 +0000 UTC
Tutorial Video : https://youtu.be/Sg3KgA3_fPU
tutorial on using Stable Diffusion Animation to effortlessly change background and character outfit colors! In this video, we will walk you through the step-by-step process using the ComfyUI workflow.
Workflow (Supporters Early Access) : https://www.patreon.com/posts/96537203
OpenArt Workflow List : https://openart.ai/workflows/profile/futurebenji
Series Of Tutorial Videos About This AnimateDiff Workflow:
Comments
Benjamin Law
No, I am just passionate on tech stuffs, not no innovator. LOL. anyway thanks for support , and keep inspiring.
Chick
Benji - you are no1 innovator in this space - thank you for all your efforts helping people.
Benjamin Law
Lip sync never do good , I know a guy did a workflow for that but it took 3 workflow to create 1 little animation, not worth it for business honestly. I suggest after finish you dance or movement motion, use Facefusion for lipsync with audio.
Chick
How do i get the face lips to move in sync with my video. I find the dwpose is very inaccurate - I want 100% match to my videos face mouth and eye movements.
Benjamin Law
You do AI influencer like Lopez?
Chick
hi Benji - you do amazing work. Question: How do I ensure to maintain the face and body shape 100% of my Influencer. When I load a video in - the output always seems to adjust the characters body and face shape the source video. i.e. want to ensure consistent Influencer body & face in all videos generated and do not want them to change each time I use a different video. Example: The dance and faceposes should change but not the physical shape of my character. i.e. consistent influencer look for all videos.
Benjamin Law
Looks like you need to update your IPA custom node. Haven't you?
Benjamin Law
I guess you have no watch the tutorial follow the install steps.😉
Mario
I have a problem, neither the setnode nor the getnode loads.
polaraju p
what i do
polaraju p
Error occurred when executing IPAdapterApply: Error(s) in loading state_dict for Resampler: size mismatch for proj_in.weight: copying a param with shape torch.Size([768, 1280]) from checkpoint, the shape in current model is torch.Size([768, 1024]). File "D:\AI\ComfyUI\ComfyUI\execution.py", line 155, in recursive_execute output_data, output_ui = get_output_data(obj, input_data_all) File "D:\AI\ComfyUI\ComfyUI\execution.py", line 85, in get_output_data return_values = map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True) File "D:\AI\ComfyUI\ComfyUI\execution.py", line 78, in map_node_over_list results.append(getattr(obj, func)(**slice_dict(input_data_all, i))) File "D:\AI\ComfyUI\ComfyUI\custom_nodes\ComfyUI_IPAdapter_plus\IPAdapterPlus.py", line 653, in apply_ipadapter self.ipadapter = IPAdapter( File "D:\AI\ComfyUI\ComfyUI\custom_nodes\ComfyUI_IPAdapter_plus\IPAdapterPlus.py", line 279, in __init__ self.image_proj_model.load_state_dict(ipadapter_model["image_proj"]) File "C:\Users\RAJU\AppData\Roaming\Python\Python310\site-packages\torch\nn\modules\module.py", line 2152, in load_state_dict raise RuntimeError('Error(s) in loading state_dict for {}:\n\t{}'.format(
Benjamin Law
In Comfyui manager download it, by click the Install Missing Custom Node. I have show previous video. Try it and the list will show you what to install.
polaraju p
i have error When loading the graph, the following node types were not found: SetNode GetNode Image Resize ReActorFaceSwap Nodes that have failed to load will show as red on the graph.
