European Open Source AI Index
DatabaseNewsGuidesAboutContribute

Pythia

by EleutherAI and Together Computer

Open-source model and open-source tool for building chatbots.
Text
Full
https://huggingface.co/togethercomputer/Pythia-Chat-Base-7B
Pythia-6.9B
Pythia-Chat-Base-7B
Apache-2.0
Base model developed by EleutherAI, a major player in the open-source space. Fine-tune by Together Computer, a cloud platform for generative AI.
[ "https://huggingface.co/EleutherAI", "https://together.ai/" ]
March 2023
Availability
Base Model Data
Training data published on HuggingFace.
https://huggingface.co/datasets/EleutherAI/the_pile_deduplicated
End User Model Data
End model data shared on GitHub.
https://github.com/togethercomputer/OpenDataHub
Base Model Weights
Model weights available via HuggingFace.
https://huggingface.co/EleutherAI/pythia-6.9b
End User Model Weights
Model weights available via HuggingFace.
https://huggingface.co/togethercomputer/Pythia-Chat-Base-7B
Training Code
Training code is made available through GitHub.
https://github.com/togethercomputer/OpenChatKit/tree/main/training
Documentation
Code Documentation
Well-documented repository.
https://github.com/togethercomputer/OpenChatKit
Hardware Architecture
Architecture and full recipe for reproducing model provided.
https://github.com/togethercomputer/OpenChatKit#reproducing-pythia-chat-base-7b
Preprint
Preprint describes LM base (Pythia) but not instruction tuning details.
https://arxiv.org/abs/2304.01373
Paper
Paper published in Proceedings of Machine Learning Research.
https://proceedings.mlr.press/v202/biderman23a.html
Modelcard
Model card partially available but does not go into much detail about model specifics.
https://huggingface.co/togethercomputer/Pythia-Chat-Base-7B
Datasheet
Only end model dataset documented.
https://huggingface.co/datasets/EleutherAI/the_pile_deduplicatedhttps://github.com/togethercomputer/OpenDataHub
Access
Package
Package is available on PyPi.
https://pypi.org/project/openchatkit/
API and Meta Prompts
Reference seems to be made to a feedback app on HuggingFace, however the link redirects to a 404 page.
Licenses
Apache 2.0
https://huggingface.co/togethercomputer/Pythia-Chat-Base-7B#model-details
Is this information not up to date?
Contribute here ->
Supported by the Centre for Language Studies and the Dutch Research Council. Website design & development © 2024 by BSTN. This version of the index generated 10 March 2026, website content last updated 11 March 2026.