European Open Source AI Index
DatabaseNewsGuidesAboutContribute

DreamVideo

by Tongyi Lab

Video-generation model with customized subject and motion.
Video
Limited
https://dreamvideo-t2v.github.io/
ModelScopeT2V-V1.5
DreamVideo
Unknown
Tonyi Lab, a lab under Alibaba.
https://careers-tongyi.alibaba.com/home
April 2024
Availability
Base Model Data
ModelScopeT2V's data sources are not traceable for V1.5, its underlying model Stable Diffusion is also slightly problematic.
https://arxiv.org/abs/2210.08402https://arxiv.org/pdf/2308.06571
End User Model Data
For subject customization, we select subjects from image customization papers for a total of 20 customized subjects, including 9 pets and 11 objects. For motion customization, we collect a dataset of 30 motion patterns from the Internet, the UCF101 dataset, the UCF Sports Action dataset, and the DAVIS dataset. We also provide 42 text prompts used for extensive experimental validation, where the prompts are designed to generate new motions of subjects, new contexts of subjects and motions, and etc.
https://arxiv.org/pdf/2312.04433
Base Model Weights
Model made available through ModelScope.
https://modelscope.cn/models/iic/text-to-video-synthesis/summary
End User Model Weights
Model made available through ModelScope.
https://modelscope.cn/models/iic/dreamvideo-t2v/summary
Training Code
Code made available on GitHub.
https://github.com/ali-vilab/VGen
Documentation
Code Documentation
Repo thoroughly documented.
https://github.com/ali-vilab/VGen
Hardware Architecture
Training setup disclosed in paper, config published on GitHub.
https://arxiv.org/pdf/2312.04433https://github.com/ali-vilab/VGen/blob/main/configs/t2v_train.yaml
Preprint
Preprint published on arXiv.
https://arxiv.org/pdf/2312.04433
Paper
No peer-reviewed paper found.
https://cvpr.thecvf.com/Conferences/2024/AcceptedPapers
Modelcard
Model card gives limited information.
https://modelscope.cn/models/iic/dreamvideo-t2v/summary
Datasheet
No datasheet found.
Access
Licenses
No license found.
Is this information not up to date?
Contribute here ->
Supported by the Centre for Language Studies and the Dutch Research Council. Website design & development © 2024 by BSTN. This version of the index generated 09 April 2026, website content last updated 11 March 2026.