BELLE

by KE Technologies

About the model:

Llama-2 fine-tuned on a small amount of Chinese data. Earlier variants exist based on BLOOMZ.

Model type:

Text

Model performance class:

Limited

Link to the model:

https://huggingface.co/BELLE-2/BELLE-Llama2-13B-chat-0.4M

Base models:

Llama-2-13B

End model:

BELLE-Llama2-13B-Chat-0.4M

End model license:

Llama 2 Community License Agreement

About the organisation:

Company specializing in advanced technology solutions.

Link to the organisation:

https://www.ke.com

Model release date:

March 2023

Availability

Base Model Data

Data nowhere disclosed or documented, and described only in the vaguest terms in a corporate preprint released by Meta.

https://ai.meta.com/research/publications/llama-2-open-foundation-and-fine-tuned-chat-models/

End User Model Data

Synthetic BELLE training data in Chinese released in batches

https://github.com/LianjiaTech/BELLE/tree/main/data/1.5M

Base Model Weights

Download only after requesting access; requires signing a consent form

https://ai.meta.com/resources/models-and-libraries/llama-downloads/

End User Model Weights

Some models available, most only as delta weights requiring separate access to LLaMA

https://github.com/LianjiaTech/BELLE/tree/main/models

Training Code

Repository contains a fair bit of code

https://github.com/LianjiaTech/BELLE

Documentation

Code Documentation

Quite some documentation on Github, though not all well-organized

https://github.com/LianjiaTech/BELLE/blob/main/README_en.md

Hardware Architecture

Specified in a fair bit of detail on GitHub.

https://github.com/LianjiaTech/BELLE/blob/main/README_en.md

Preprint

https://arxiv.org/abs/2303.14742

Paper

No peer-reviewed paper found

Modelcard

Provide model cards for various BELLE models on their Huggingface page; most are not fully detailed and are missing certain aspects e.g. hyperparameters.

https://huggingface.co/BelleGroup

Datasheet

No datasheet found.

Access

Licenses

Lowest common denominator is non-OSI approved LLaMA licence agreement

Is this information not up to date?

Contribute here ->

Supported by the Centre for Language Studies and the Dutch Research Council. Website design & development © 2024 by BSTN. This version of the index generated 09 April 2026, website content last updated 11 March 2026.