Innovate Futures @ Benji
patreon
RAVE AnimateDiff V2V LCM 2IPA - Version 20240331
🕑 Added 2024-04-01 13:00:13 +0000 UTCFor new IPAdapter V2 you need to following models in your ComfyUI.
Some highlighted things you need in order to get started.
/ComfyUI/models/clip_vision
CLIP-ViT-H-14-laion2B-s32B-b79K.safetensors, download and rename
CLIP-ViT-bigG-14-laion2B-39B-b160k.safetensors, download and rename
/ComfyUI/models/ipadapter, create it if not present
ip-adapter_sd15.safetensors, Basic model, average strength
ip-adapter_sd15_light_v11.bin, Light impact model
ip-adapter-plus_sd15.safetensors, Plus model, very strong
ip-adapter-plus-face_sd15.safetensors, Face model, portraits
ip-adapter-full-face_sd15.safetensors, Stronger face model, not necessarily better
ip-adapter_sd15_vit-G.safetensors, Base model, requires bigG clip vision encoder
ip-adapter_sdxl_vit-h.safetensors, SDXL model
ip-adapter-plus_sdxl_vit-h.safetensors, SDXL plus model
ip-adapter-plus-face_sdxl_vit-h.safetensors, SDXL face model
ip-adapter_sdxl.safetensors, vit-G SDXL model, requires bigG clip vision encoder
Deprecated ip-adapter_sd15_light.safetensors, v1.0 Light impact model
Update , please remember to check out the previous post for Essential Models and Custom Nodes You Need : https://www.patreon.com/posts/rave-animatediff-98757420
IPAdapter Unified Loader
Loads the full stack of models needed for IPAdapter to function. The returned object will contain information regarding the ipadapter and clip vision models.
------------------------------------------------------------------------------------------------
This workflow version named Version 20240331.
We have listed of collection in here : https://www.patreon.com/collection/393434
Comments
Benjamin Law
You mean the zip file?
John C
I tried downloading RAVE_AnimateDiff_V2V LCM 2IPA Version 20240331.zip but it keeps having an error saving, is this workflow still available?
Blaze Origin
I fixed it, I renamed controlnet_checkpoint.ckpt into Animate_controlnet_checkpoint.ckpt
Blaze Origin
I'm very close, at the end of the process, this error message would come up. I will experiment to see if I can fix it
Blaze Origin
Requested to load CLIPVisionModelProjection Loading 1 new model [AnimateDiffEvo] - INFO - Loading motion module v3_sd15_mm.ckpt via Gen2 Requested to load AutoencoderKL Loading 1 new model [AnimateDiffEvo] - INFO - Sliding context window activated - latents passed in (50) greater than context_length 16. [AnimateDiffEvo] - INFO - Using motion module v3_sd15_mm.ckpt:v3. Requested to load ControlNet Requested to load ControlNet Requested to load BaseModel Requested to load AnimateDiffModel Loading 4 new models !!! Exception during processing !!! Traceback (most recent call last): File "C:\Users\adria\Desktop\ComfyUI_windows_portable\ComfyUI\execution.py", line 151, in recursive_execute output_data, output_ui = get_output_data(obj, input_data_all)
Benjamin Law
Try comfyui primitive or any other that allow your to set an Integer value
Blaze Origin
Thanks a lot! I have installed and It is still red, was there any other nodes relating to this?
Benjamin Law
Derfuu_ComfyUI_ModdedNodes : https://github.com/Derfuu/Derfuu_ComfyUI_ModdedNodes
Blaze Origin
Amazing workflow! I have the "integer" Node but I don't have "Integer Width, Integer Height and NumofFrames - Integer" can you let me know where to get this please?
DoctorSpongefoot
I couldn't find the Integer node and so I replaced it with the DF_Integer and it seems happy now. Would be interested to know is there a specific Integer node you prefer or recommend?
Benjamin Law
this post is for RAVE AnimateDiff V2V LCM 2IPA - Version 20240331. Please post the related question on the APersonMaskGenerator next time. For your error : https://github.com/google/mediapipe/issues/5188 you can try this : pip install mediapipe==0.10.9
Samuel Ericksen
Can you help to solve this error? Error occurred when executing APersonMaskGenerator: 'FieldDescriptor' object has no attribute '_default_constructor'
Benjamin Law
What?! You are not input your own image?
Neon Square
I need help, please! I keep getting this error: Error occurred when executing LoadImage: [Errno 2] No such file or directory: 'C:\\Users\\user\\ComfyUI_windows_portable\\ComfyUI\\input\\nancy-profile-pic.png'
Benjamin Law
How many image frames you set for 600 seconds?
Tarun Rishi
Hi Benji, finding that KSampler in AnimateDiff group is very slow (600s/it) on Windows 11 RTX3080 - what setup are you using and are there any optimisations?
