Innovate Futures @ Benji
patreon
SDXL Lightning And AnimateDiff In ComfyUI Workflow
🕑 Added 2024-03-07 13:24:41 +0000 UTCTutorial Video : https://youtu.be/0A8fWcjyAAg
It document detailly how to create this workflow.
Feel free to ask if you have any question.
*** For use hsxl Temp. Motion model, remember to set the Context Option to 8, by default it is 16.
Update :
Since Stable Diffusion never release a official set of ControlNet, and all CN models are trained by helpful individuals.
So here's a list of SDXL ControlNet that you can try it out. SDXL ControlNet: https://huggingface.co/collections/diffusers/sdxl-controlnets-64f9c35846f3f06f5abe351f https://huggingface.co/TTPlanet/TTPLanet_SDXL_Controlnet_Tile_Realistic_V1/tree/main https://huggingface.co/thibaud https://huggingface.co/lllyasviel https://huggingface.co/bdsqlsz/qinglong_controlnet-lllite
Comments
Benjamin Law
It doesn't support SDXL, unfortunately. The author just train in SD 1.5.
Flavio
Hi! Nice workflow, I don't find the detph anything model for xl, can you please share the link?
Benjamin Law
Hi, https://i.imgur.com/PqA1YtD.png This one show you need to put the right values in the Reactor node. As I saw the second one which is a failed update. Thats why it is missing some values from the lastest update version of ReActor. Please check the Comand Prompt Windows error message, it show the detail whats wrong with it.
Andres Eduardo Damonte
Can you help me, I'm having these errors and I can't fix them. https://i.imgur.com/PqA1YtD.png https://i.imgur.com/82eqheq.png
Benjamin Law
Hi, I have face this issue before. What I did , I was lower the image resolution down 512 x 960 or 960 x 512px. Then the sampler run normal. Therefore , I put an upscaler at the end .
Andreas Stegemann
Thank you for your very good workflows and explanations about this. But same issue here. 1. Sampler frozen. No green progress bar visible. VRAM 98%, GPU 100%, CPU 3%.
Benjamin Law
no problem :) But when I saw that, it feels like really weird because A100 man, it shouldn't take that long. Maybe you can test it step by step, try 1 Sampling group , and disable other Sampling and Detailer first. And also see if the ControlNet model you are using.
bw
I think I'm making a mistake somewhere but I haven't figured it out yet. I will watch the video again and try to find it. Thank you for the fast response.
Benjamin Law
CPU ? using SDXL Lightning take too much time ? you see my command prompt, I use a 4090 , about 1 -2 mins for 60 frames only. See the video.
bw
Hi Benji, I was trying this workflow, it looks great. You've done great job one more time. But, it is using too much CPU on 1st Sampling and 0 GPU usage. Also, it takes about 30 minutes to complete with single A100. I couldn't find where I made a mistake. Do you have any advice? Thanks a lot.
