Instructions to use ByteDance/AnimateDiff-Lightning with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusers
How to use ByteDance/AnimateDiff-Lightning with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("ByteDance/AnimateDiff-Lightning", dtype=torch.bfloat16, device_map="cuda") prompt = "Astronaut in a jungle, cold color palette, muted colors, detailed, 8k" image = pipe(prompt).images[0] - Notebooks
- Google Colab
- Kaggle
Reproducing ComfyUI examples
#6
by badayvedat - opened
Hey team, amazing work on lightning models and sharing the code/tutorial for the most popular execution backends ❤️
Can you also share the video (Download.mp4) used on the AnimateDiff Lightning V2VOpenPose ComfyUI workflow for reproducing the generated videos?
Unfortunately we can't share the source video because we don't own it and it has personal identifiable information.
Tips: you can search "dancing" on TikTok and should easily find a bunch of videos of this kind.
badayvedat changed discussion status to closed