Instructions to use weifeng-chen/controlavideo-depth with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusers
How to use weifeng-chen/controlavideo-depth with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("weifeng-chen/controlavideo-depth", dtype=torch.bfloat16, device_map="cuda") prompt = "Astronaut in a jungle, cold color palette, muted colors, detailed, 8k" image = pipe(prompt).images[0] - Notebooks
- Google Colab
- Kaggle
| license: gpl-3.0 | |
| - Depth Control Pretrained model for [control-a-video](https://arxiv.org/abs/2305.13840) | |
| - Project page: https://controlavideo.github.io/ | |
| - Code: https://github.com/Weifeng-Chen/control-a-video | |
| # Citation | |
| ``` | |
| @misc{chen2023controlavideo, | |
| title={Control-A-Video: Controllable Text-to-Video Generation with Diffusion Models}, | |
| author={Weifeng Chen and Jie Wu and Pan Xie and Hefeng Wu and Jiashi Li and Xin Xia and Xuefeng Xiao and Liang Lin}, | |
| year={2023}, | |
| eprint={2305.13840}, | |
| archivePrefix={arXiv}, | |
| primaryClass={cs.CV} | |
| } | |
| ``` |