European Open Source AI Index
Menu
Database
News
Guides
About
Contribute
BLOOMZ
by BigScience Workshop
Find this model in our guide:
Llama and BloomZ: shades of openness
12 October 2024
About the model:
Large open multilingual language model.
Model type:
Text
Model performance class:
Full
Link to the model:
https://huggingface.co/bigscience/bloomz-p3
Base models:
BLOOM
End model:
BLOOMZ-P3
End model license:
Apache-2.0 and BigScience RAIL License v1.0
About the organisation:
Research workshop on large multilingual models.
Link to the organisation:
https://huggingface.co/bigscience/
Model release date:
September 2022
Availability
Base Model Data
Data made available & documented in detail in repo and preprint.
https://github.com/bigscience-workshop/xmtf#data
End User Model Data
From the documentation 'xP3 (Crosslingual Public Pool of Prompts) is a collection of prompts & datasets across 46 of languages & 16 NLP tasks.'
https://huggingface.co/datasets/bigscience/xP3all
Base Model Weights
Weights made available on HuggingFace.
https://huggingface.co/bigscience/bloom
End User Model Weights
Weights made available on HuggingFace.
https://huggingface.co/bigscience/bloomz-p3
Training Code
Repository provides a guided overview to all components.
https://github.com/bigscience-workshop/xmtf
Documentation
Code Documentation
Code well-documented.
https://github.com/bigscience-workshop/xmtf
Hardware Architecture
Architecture described in preprint, code available in github repo, recipe on HuggingFace.
https://arxiv.org/pdf/2211.05100
https://github.com/bigscience-workshop/xmtf#create-xp3x
Preprint
Preprints for base and fine-tuned models available on arXiv.
https://arxiv.org/abs/2211.05100
https://arxiv.org/pdf/2211.01786
Paper
Peer-reviewed paper of 9 pages + 114 page appendix describes the multitask finetuning (instruction tuning) of BLOOM (see preprint) to form BLOOMZ.
https://aclanthology.org/2023.acl-long.891/
Modelcard
Model card provides the requisite detail.
https://huggingface.co/bigscience/bloomz-p3
Datasheet
Dataset documented in dataset card at HuggingFace.
https://huggingface.co/datasets/bigscience/xP3
Access
Licenses
Code licensed under Apache 2.0, model under bespoke 'Responsible AI License' which imposes some limitations. Blog post taken down.
https://bigscience.huggingface.co/blog/the-bigscience-rail-license
Last updated 08 April 2026
Is this information not up to date?
Contribute here ->
Supported by the Centre for Language Studies and the Dutch Research Council. Website design & development © 2024 by
BSTN
. This version of the index generated
09 April 2026
, website content last updated
11 March 2026
.