ModelScopeT2V

by Tongyi Lab

About the model:

Video-generation model based on Stable Diffusion.

Model type:

Video

Model performance class:

Limited

Link to the model:

https://modelscope.cn/models/iic/text-to-video-synthesis/summary

Base models:

Stable Diffusion (version unknown)

End model:

ModelScopeT2V-V1.5

End model license:

CC-BY-NC-ND

About the organisation:

Tonyi Lab, a lab under Alibaba.

Link to the organisation:

https://careers-tongyi.alibaba.com/home

Model release date:

February 2023

Availability

Base Model Data

Originally trained on LAION-5B, which is ostensibly open. In general the language used is not very clear, however.

https://arxiv.org/abs/2210.08402

End User Model Data

Trained on LAION-5B, WebVid, and MSR-VTT. Unclear what data was used to train V1.5.

https://arxiv.org/pdf/2308.06571

Base Model Weights

Available through HuggingFace, however requires providing contact information and agreeing to a license agreement. Version is also unknown.

https://huggingface.co/stabilityai/stable-diffusion-3.5-large

End User Model Weights

Model made available through ModelScope.

https://modelscope.cn/models/iic/text-to-video-synthesis/summary

Training Code

Code made available on GitHub.

https://github.com/ali-vilab/VGen

Documentation

Code Documentation

Repo thoroughly documented.

https://github.com/ali-vilab/VGen

Hardware Architecture

Training setup disclosed in paper, config published on GitHub.

https://arxiv.org/pdf/2308.06571 https://github.com/ali-vilab/VGen/blob/main/configs/t2v_train.yaml

Preprint

Preprint available on arXiv.

https://arxiv.org/pdf/2308.06571

Paper

No peer-reviewed paper found.

Modelcard

Model card primarily contain information about inference, with some description of training data.

https://modelscope.cn/models/iic/text-to-video-synthesis/summary

Datasheet

No datasheet found.

Access

Licenses

CC-BY-NC-ND

https://modelscope.cn/models/iic/text-to-video-synthesis/summary

Is this information not up to date?

Contribute here ->

Supported by the Centre for Language Studies and the Dutch Research Council. Website design & development © 2024 by BSTN. This version of the index generated 09 April 2026, website content last updated 11 March 2026.