The IndexGuidesNews
AboutContribute

Parameter descriptions:

Base Model Data
Are datasources for training the base model comprehensively documented and freely made available? In case a distinction between base (foundation) and end (user) model is not applicable, this mirrors the end model data entries.
End User Model Data
Are datasources for training the model that the enduser interacts with comprehensively documented and freely made available?
Base Model Weights
Are the weights of the base models made freely available? In case a distinction between base (foundation) and end (user) model is not applicable, this mirrors the end model data entries.
End User Model Weights
Are the weights of the model that the enduser interacts with made freely available?
Training Code
Is the source code of datasource processing, model training and tuining comprehensively and freely made available?
Code Documentation
Is the source code of datasource processing, model training and tuning comprehensively documented?
Hardware Architecture
Is the hardware architecture used for datasource processing and model training comprehensively documented?
Preprint
Are archived preprint(s) are available that detail all major parts of the system including datasource processing, model training and tuning steps?
Paper
Are peer-reviewed scientific publications available that detail all major parts of the system including datasource processing, model training and tuning steps?
Modelcard
Is a model card in standardized format available that provides comprehensive insight on model architecture, training, fine-tuning, and evaluation are available?
Datasheet
Is a datasheet as defined in "Datasheets for Datasets" (Gebru et al. 2021) available?
Package
Is a packaged release of the model available on a software repository (e.g. a Python Package Index, Homebrew)?
API and Meta Prompts
Is an API available that provides unrestricted access to the model (other than security and CDN restrictions)? If applicable, this entry also collects information on the use and availability of meta prompts.
Licenses
Is the project fully covered by Open Source Initiative (OSI)-approved licenses, including all data sources and training pipeline code?

UltraLM

by OpenBMB

Model trained using high-quality feedback.
Text
Full
https://huggingface.co/openbmb/UltraLM-13b-v2.0
LLaMA2
UltraFeedback (part synthetic)
Meta Community License
OpenBMB (Open Lab for Big Model Base), founded by TsinghuaNLP & ModelBest Inc (面壁智能), aims to build foundation models and systems towards AGI.
https://www.openbmb.org/
September 2023
Availability
Training Code
Base Model Data
Based on Llama2, which means pretraining data is nowhere disclosed or documented, and described only in the vaguest terms in a corporate preprint released by Meta
End User Model Data
UltraFeedback dataset made available along with model release
https://huggingface.co/datasets/openbmb/UltraFeedback
Base Model Weights
Download only after requesting access; requires signing a consent form
https://ai.meta.com/resources/models-and-libraries/llama-downloads/
End User Model Weights
Online materials appear to be in flux and several HuggingFace links generate 404 errors, hence partial
https://huggingface.co/openbmb/UltraLM-13b-v2.0
Documentation
Code Documentation
Code only covers minimal examples; no documentation available.
Hardware Architecture
Architecture sketched in online materials.
https://arxiv.org/pdf/2310.01377
Preprint
Preprint describes creation of UltraFeedback dataset but also offers some detail on training and architecture of UltraRM models
https://arxiv.org/abs/2310.01377
Paper
No peer-reviewed paper found
Modelcard
Model card on HuggingFace available for 13b (Llama1) model, but not for newer releases, hence partial
https://huggingface.co/openbmb/UltraLM-13b
Datasheet
Datasheet available for RLHF portion, but not for Llama2-based pretraining data, hence partial
https://huggingface.co/datasets/openbmb/UltraFeedback
Access
Package
Package not provided
API and Meta Prompts
API not provided and model too big for HuggingFace inference API
Licenses
Usage requires signing Meta's bespoke 'community license', not an OSI recognised open license
https://huggingface.co/openbmb/UltraLM-13b
Is this information not up to date?
Contribute here ->

Supported by the Centre for Language Studies and the Dutch Research Council. Website design & development © 2024 by BSTN. This version of the index generated 09 Apr 2025, website content last updated 23 Apr 2025.