The IndexGuidesNews
AboutContribute

Parameter descriptions:

Base Model Data
Are datasources for training the base model comprehensively documented and freely made available? In case a distinction between base (foundation) and end (user) model is not applicable, this mirrors the end model data entries.
End User Model Data
Are datasources for training the model that the enduser interacts with comprehensively documented and freely made available?
Base Model Weights
Are the weights of the base models made freely available? In case a distinction between base (foundation) and end (user) model is not applicable, this mirrors the end model data entries.
End User Model Weights
Are the weights of the model that the enduser interacts with made freely available?
Training Code
Is the source code of datasource processing, model training and tuining comprehensively and freely made available?
Code Documentation
Is the source code of datasource processing, model training and tuning comprehensively documented?
Hardware Architecture
Is the hardware architecture used for datasource processing and model training comprehensively documented?
Preprint
Are archived preprint(s) are available that detail all major parts of the system including datasource processing, model training and tuning steps?
Paper
Are peer-reviewed scientific publications available that detail all major parts of the system including datasource processing, model training and tuning steps?
Modelcard
Is a model card in standardized format available that provides comprehensive insight on model architecture, training, fine-tuning, and evaluation are available?
Datasheet
Is a datasheet as defined in "Datasheets for Datasets" (Gebru et al. 2021) available?
Package
Is a packaged release of the model available on a software repository (e.g. a Python Package Index, Homebrew)?
API and Meta Prompts
Is an API available that provides unrestricted access to the model (other than security and CDN restrictions)? If applicable, this entry also collects information on the use and availability of meta prompts.
Licenses
Is the project fully covered by Open Source Initiative (OSI)-approved licenses, including all data sources and training pipeline code?

OpenChat

by OpenChat

Model trained with mixed-quality data.
Text,code
Full
https://huggingface.co/openchat/openchat-3.6-8b-20240522
Meta-Llama-3-8B
OpenChat-3.6-8B-20240522
Llama 3 Community License Agreement
Student team from Tsinghua University.
https://github.com/imoneoi
May 2023
Availability
Training Code
Repository offers a large amount of fairly well-organized code for data curation and model.
https://github.com/imoneoi/openchat/tree/master/ochat
Base Model Data
Data nowhere disclosed or documented.
End User Model Data
Model trained on publicly available ShareGPT dataset.
https://huggingface.co/datasets/openchat/openchat_sharegpt_v3
Base Model Weights
Inspecting the training weights requires signing Meta Llama 3.1's bespoke 'community license', not an OSI recognised open license.
https://huggingface.co/meta-llama/Meta-Llama-3-8B
End User Model Weights
Weights made available via HuggingFace.
https://huggingface.co/openchat/openchat-3.6-8b-20240522
Documentation
Code Documentation
There is plenty of code in the github repository but only some of it is documented.
https://github.com/imoneoi/openchat/tree/master/ochat
Hardware Architecture
Architecture quite well described in preprint.
https://arxiv.org/abs/2309.11235
Preprint
Preprint describes the model architecture and instruction tuning approach, though is hampered by building on notoriously closed Llama2.
https://arxiv.org/abs/2309.11235
Paper
Paper reviewed and accepted for ICLR 2024.
https://openreview.net/forum?id=AOJyfhWYHf
Modelcard
Model card exists, however primarily provides evaluation information.
https://huggingface.co/openchat/openchat-3.6-8b-20240522
Datasheet
Datasheet is provided, however contain minimal information.
https://huggingface.co/datasets/openchat/openchat_sharegpt_v3
Access
Package
Python package 'ochat' provided through PyPi.
https://pypi.org/project/ochat/
API and Meta Prompts
Model only available through inference endpoints, local API, or package.
Licenses
Model licensed under Llama 3 Community License Agreement.
https://huggingface.co/openchat/openchat-3.6-8b-20240522
Is this information not up to date?
Contribute here ->

Supported by the Centre for Language Studies and the Dutch Research Council. Website design & development © 2024 by BSTN. This version of the index generated 09 Apr 2025, website content last updated 23 Apr 2025.