The IndexGuidesNews
AboutContribute

Parameter descriptions:

Base Model Data
Are datasources for training the base model comprehensively documented and made available? In case a distinction between base (foundation) and end (user) model is not applicable, this mirrors the end model data entries.
End User Model Data
Are datasources for training the model that the end user interacts with comprehensively documented and made available?
Base Model Weights
Are the weights of the base models made freely available? In case a distinction between base (foundation) and end (user) model is not applicable, this mirrors the end model data entries.
End User Model Weights
Are the weights of the model that the end user interacts with made freely available?
Training Code
Is the source code of dataset processing, model training and tuning comprehensively made available?
Code Documentation
Is the source code of datasource processing, model training and tuning comprehensively documented?
Hardware Architecture
Is the hardware architecture used for datasource processing and model training comprehensively documented?
Preprint
Are archived preprint(s) are available that detail all major parts of the system including datasource processing, model training and tuning steps?
Paper
Are peer-reviewed scientific publications available that detail all major parts of the system including datasource processing, model training and tuning steps?
Modelcard
Is a model card available in standardized format that provides comprehensive insight on model architecture, training, fine-tuning, and evaluation?
Datasheet
Is a datasheet as defined in "Datasheets for Datasets" (Gebru et al. 2021) available?
Package
Is a packaged release of the model available on a software repository (e.g. a Python Package Index, Homebrew)?
API and Meta Prompts
Is an API available that provides unrestricted access to the model (other than security and CDN restrictions)? If applicable, this entry also collects information on the use and availability of meta prompts.
Licenses
Is the project fully covered by Open Source Initiative (OSI)-approved licenses, including all data sources and training pipeline code?

Stable Beluga

by StabilityAI

Llama-based model fine-tuned on Orca.
Text
Full
https://huggingface.co/stabilityai/StableBeluga2
Llama-2-70B
StableBeluga2
Stable Beluga Non-Commercial Community License
UK-based AI company known for its diffusion models.
https://stability.ai/
July 2023
Availability
Base Model Data
Data nowhere disclosed or documented, and described only in the vaguest terms in a corporate preprint released by Meta
https://ai.meta.com/research/publications/llama-2-open-foundation-and-fine-tuned-chat-models/
End User Model Data
Says: 'Stable Beluga 2 is trained on our internal Orca-style dataset', 'created synthetically using high-quality instructions' from COT Submix Original, NIV2 Submix Original, FLAN 2021 Submix Original, T0 Submix Original.
Base Model Weights
Download only after requesting access; requires signing a consent form
https://ai.meta.com/resources/models-and-libraries/llama-downloads/
End User Model Weights
Instruction-tuned model weights provided as binary
https://huggingface.co/stabilityai/StableBeluga2/tree/main
Training Code
No repository with open code related to training, fine-tuning or evaluation found
Documentation
Code Documentation
Code on HuggingFace only covers minimal examples; no documentation available.
Hardware Architecture
Hyperparameters provided, but no hardware.
https://huggingface.co/stabilityai/StableBeluga2#model-details
Preprint
Preprint from Microsoft describes Orca method of finetuning using GPT4-derived synthetic data, but no details of this particular architecture
https://huggingface.co/papers/2306.02707
Paper
No peer-reviewed paper found
Modelcard
There is a model card, but it provides only a minimum of detail
https://huggingface.co/stabilityai/StableBeluga2
Datasheet
Datasheet not provided.
Access
Package
Model available on Ollama.
https://ollama.com/library/stable-beluga
API and Meta Prompts
model too large to run on HuggingFace free inference API
Licenses
Usage requires signing StabilityAI's bespoke 'Stable Beluga Non-Commercial Community License', not an OSI recognised open license
https://huggingface.co/stabilityai/StableBeluga2/blob/main/LICENSE.txt
Is this information not up to date?
Contribute here ->

Supported by the Centre for Language Studies and the Dutch Research Council. Website design & development © 2024 by BSTN. This version of the index generated 25 Jun 2025, website content last updated 18 Jun 2025.