Tülu

by Ai2

About the model:

Tülu, a Llama-based model from AllenAI with a relatively open post-training recipe.

Model type:

Text

Model performance class:

Full

Link to the model:

https://huggingface.co/allenai/Llama-3.1-Tulu-3-405B-DPO

Base models:

Llama-3.1-405B

End model:

Llama-3.1-Tulu-3-405B

End model license:

Llama 3.1 Community License Agreement

About the organisation:

Allen Institute for AI (non-profit research institute)

Link to the organisation:

https://allenai.org

Model release date:

June 2023

Availability

Base Model Data

Based on Llama3.1 so nothing known about pre-training data of base mode.

End User Model Data

Data sources outlined in paper.

https://arxiv.org/pdf/2411.15124

Base Model Weights

Gated model available through HuggingFace.

https://huggingface.co/meta-llama/Llama-3.1-405B

End User Model Weights

Model weights available through HuggingFace.

https://huggingface.co/allenai/Llama-3.1-Tulu-3-405B-DPO

Training Code

Important effort to make available fine-tuning procedure and source code.

https://github.com/allenai/open-instruct

Documentation

Code Documentation

OpenInstruct code well-documented.

https://github.com/allenai/open-instruct

Hardware Architecture

Fine-tuning hardware architecture well-documented, but base model is irrevocably closed.

https://huggingface.co/allenai/Llama-3.1-Tulu-3-405B-DPO

Preprint

Preprint available through arXiv.

https://arxiv.org/pdf/2411.15124

Paper

Paper published in COLM.

https://openreview.net/forum?id=QdWhj0QZFw

Modelcard

Model card provides the requisite detail.

https://huggingface.co/allenai/Llama-3.1-Tulu-3-405B-DPO

Datasheet

Some datasheets available (for instruction tuning), but base model entirely undocumented.

https://arxiv.org/pdf/2411.15124

Access

Package

Model available on Ollama.

https://ollama.com/library/tulu3

API and Meta Prompts

Available via various APIs.

https://playground.allenai.org/

Licenses

Llama 3.1 Community License Agreement, not an OSI-approved license.

https://huggingface.co/allenai/Llama-3.1-Tulu-3-405B-DPO#model-description

Is this information not up to date?

Contribute here ->

Supported by the Centre for Language Studies and the Dutch Research Council. Website design & development © 2024 by BSTN. This version of the index generated 10 March 2026, website content last updated 11 March 2026.