The IndexGuidesNews
AboutContribute

Parameter descriptions:

Base Model Data
Are datasources for training the base model comprehensively documented and made available? In case a distinction between base (foundation) and end (user) model is not applicable, this mirrors the end model data entries.
End User Model Data
Are datasources for training the model that the end user interacts with comprehensively documented and made available?
Base Model Weights
Are the weights of the base models made freely available? In case a distinction between base (foundation) and end (user) model is not applicable, this mirrors the end model data entries.
End User Model Weights
Are the weights of the model that the end user interacts with made freely available?
Training Code
Is the source code of dataset processing, model training and tuning comprehensively made available?
Code Documentation
Is the source code of datasource processing, model training and tuning comprehensively documented?
Hardware Architecture
Is the hardware architecture used for datasource processing and model training comprehensively documented?
Preprint
Are archived preprint(s) are available that detail all major parts of the system including datasource processing, model training and tuning steps?
Paper
Are peer-reviewed scientific publications available that detail all major parts of the system including datasource processing, model training and tuning steps?
Modelcard
Is a model card available in standardized format that provides comprehensive insight on model architecture, training, fine-tuning, and evaluation?
Datasheet
Is a datasheet as defined in "Datasheets for Datasets" (Gebru et al. 2021) available?
Package
Is a packaged release of the model available on a software repository (e.g. a Python Package Index, Homebrew)?
API and Meta Prompts
Is an API available that provides unrestricted access to the model (other than security and CDN restrictions)? If applicable, this entry also collects information on the use and availability of meta prompts.
Licenses
Is the project fully covered by Open Source Initiative (OSI)-approved licenses, including all data sources and training pipeline code?

Pythia

by EleutherAI and Together Computer

Open-source model and open-source tool for building chatbots.
Text
Full
https://huggingface.co/togethercomputer/Pythia-Chat-Base-7B
Pythia-6.9B
Pythia-Chat-Base-7B
Apache-2.0
Base model developed by EleutherAI, a major player in the open-source space. Fine-tune by Together Computer, a cloud platform for generative AI.
[ "https://huggingface.co/EleutherAI", "https://together.ai/" ]
March 2023
Availability
Base Model Data
Training data published on HuggingFace.
https://huggingface.co/datasets/EleutherAI/the_pile_deduplicated
End User Model Data
End model data shared on GitHub.
https://github.com/togethercomputer/OpenDataHub
Base Model Weights
Model weights available via HuggingFace.
https://huggingface.co/EleutherAI/pythia-6.9b
End User Model Weights
Model weights available via HuggingFace.
https://huggingface.co/togethercomputer/Pythia-Chat-Base-7B
Training Code
Training code is made available through GitHub.
https://github.com/togethercomputer/OpenChatKit/tree/main/training
Documentation
Code Documentation
Well-documented repository.
https://github.com/togethercomputer/OpenChatKit
Hardware Architecture
Architecture and full recipe for reproducing model provided.
https://github.com/togethercomputer/OpenChatKit#reproducing-pythia-chat-base-7b
Preprint
Preprint describes LM base (Pythia) but not instruction tuning details.
https://arxiv.org/abs/2304.01373
Paper
Foundational paper has been peer-reviewed.
https://arxiv.org/abs/2304.01373
Modelcard
Model card partially available but does not go into much detail about model specifics.
https://huggingface.co/togethercomputer/Pythia-Chat-Base-7B
Datasheet
Only end model dataset documented.
https://huggingface.co/datasets/EleutherAI/the_pile_deduplicatedhttps://github.com/togethercomputer/OpenDataHub
Access
Package
Package is available on PyPi.
https://pypi.org/project/openchatkit/
API and Meta Prompts
Reference seems to be made to a feedback app on HuggingFace, however the link redirects to a 404 page.
Licenses
Apache 2.0
https://huggingface.co/togethercomputer/Pythia-Chat-Base-7B#model-details
Is this information not up to date?
Contribute here ->

Supported by the Centre for Language Studies and the Dutch Research Council. Website design & development © 2024 by BSTN. This version of the index generated 25 Jun 2025, website content last updated 18 Jun 2025.