Poro

by AMD Silo AI and TurkuNLP and High Performance Language Technologies (HPLT)

About the model:

Bilingual model trained on Finnish and English.

Model type:

Text

Model performance class:

Full

Link to the model:

https://huggingface.co/LumiOpen/Llama-Poro-2-70B-Instruct

Base models:

Llama-Poro-2-70B-Base

End model:

Llama-Poro-2-70B-Instruct

End model license:

Llama 3.3 Community License Agreement

About the organisation:

Silo AI was acquired by AMD in August 2024

Link to the organisation:

[ "https://www.silo.ai", "https://turkunlp.org", "https://hplt-project.org" ]

Model release date:

March 2025

Availability

Base Model Data

Model based on Llama, whose data is nowhere disclosed or documented.

End User Model Data

Finetuning data published on HuggingFace.

https://huggingface.co/datasets/LumiOpen/poro2-instruction-collection

Base Model Weights

Weights made available on HuggingFace.

https://huggingface.co/LumiOpen/Llama-Poro-2-70B-Instruct

End User Model Weights

Weights made available on HuggingFace.

https://huggingface.co/LumiOpen/Llama-Poro-2-70B-Instruct

Training Code

Custom fork of the Megatron-Deepspeed framework used for training Poro-34B.

https://github.com/LumiOpen/Megatron-LM-lumi

Documentation

Code Documentation

Training code and related scripts are publicly available.

https://github.com/LumiOpen/Megatron-LM-lumi/tree/main

Hardware Architecture

Hardware architecture described in blog post.

https://rocm.blogs.amd.com/artificial-intelligence/multilingual-continued-pretraining/README.html

Preprint

No preprint found. Release-by-blogpost.

https://rocm.blogs.amd.com/artificial-intelligence/multilingual-continued-pretraining/README.html

Paper

No peer-reviewed paper found.

Modelcard

Model card provides broad overview and links to full details.

https://huggingface.co/LumiOpen/Llama-Poro-2-70B-Instruct

Datasheet

Datasheet describes sourcing.

https://huggingface.co/datasets/LumiOpen/poro2-instruction-collection

Access

Licenses

Llama 3.3 Community License Agreement, not an OSI recognised open license

https://huggingface.co/LumiOpen/Llama-Poro-2-70B-Instruct#license

Is this information not up to date?

Contribute here ->

Supported by the Centre for Language Studies and the Dutch Research Council. Website design & development © 2024 by BSTN. This version of the index generated 09 April 2026, website content last updated 11 March 2026.