The IndexGuidesNews
AboutContribute

Parameter descriptions:

Base Model Data
Are datasources for training the base model comprehensively documented and freely made available? In case a distinction between base (foundation) and end (user) model is not applicable, this mirrors the end model data entries.
End User Model Data
Are datasources for training the model that the enduser interacts with comprehensively documented and freely made available?
Base Model Weights
Are the weights of the base models made freely available? In case a distinction between base (foundation) and end (user) model is not applicable, this mirrors the end model data entries.
End User Model Weights
Are the weights of the model that the enduser interacts with made freely available?
Training Code
Is the source code of datasource processing, model training and tuining comprehensively and freely made available?
Code Documentation
Is the source code of datasource processing, model training and tuning comprehensively documented?
Hardware Architecture
Is the hardware architecture used for datasource processing and model training comprehensively documented?
Preprint
Are archived preprint(s) are available that detail all major parts of the system including datasource processing, model training and tuning steps?
Paper
Are peer-reviewed scientific publications available that detail all major parts of the system including datasource processing, model training and tuning steps?
Modelcard
Is a model card in standardized format available that provides comprehensive insight on model architecture, training, fine-tuning, and evaluation are available?
Datasheet
Is a datasheet as defined in "Datasheets for Datasets" (Gebru et al. 2021) available?
Package
Is a packaged release of the model available on a software repository (e.g. a Python Package Index, Homebrew)?
API and Meta Prompts
Is an API available that provides unrestricted access to the model (other than security and CDN restrictions)? If applicable, this entry also collects information on the use and availability of meta prompts.
Licenses
Is the project fully covered by Open Source Initiative (OSI)-approved licenses, including all data sources and training pipeline code?

Geitje

by Bram Vanroy

Dutch instruction-tuned model based on Mistral 7B
Text
Limited
https://huggingface.co/BramVanroy/GEITje-7B-ultra
Mistral 7B
Ultrafeedback Dutch (synthetic)
CC-BY-ND
Independent model creator.
https://bramvanroy.github.io/
January 2024
Availability
Training Code
Mistral has limited source code available. No training code for Geitje found apart from the recipe used with the alignment handbook.
https://huggingface.co/BramVanroy/GEITje-7B-ultra#training-procedure
Base Model Data
Mistral provides no documentation of any of its pretraining data. Geitje Ultra 7B is based on Geitje 7B, which does disclose that Dutch pretraining data includes Gigacorpus and MADLAD.
https://huggingface.co/Rijgersberg/GEITje-7B#geitje--trained-further-on-dutch-texts
End User Model Data
Ultrafeedback Dutch (synthetic)
https://huggingface.co/datasets/BramVanroy/ultra_feedback_dutch
Base Model Weights
Mistral base model is available for downloading
https://github.com/mistralai/mistral-src#download-the-model
End User Model Weights
Instruction-tuned model formerly made available through HuggingFace, now taken down
https://huggingface.co/BramVanroy/GEITje-7B-ultra/tree/main
Documentation
Code Documentation
collection of code on github repository, although not very clearly documented and commented.
https://github.com/mistralai/mistral-inference/tree/main/src/mistral_inference
Hardware Architecture
Some information on architecture provided in github repo and HF model card. Training was done using alignment handbook.
https://huggingface.co/BramVanroy/GEITje-7B-ultra
Preprint
Preprint documents Dutch language resources but architecture and scientific documentation otherwise lacking due to Mistral base
https://arxiv.org/abs/2312.12852v1
Paper
No peer-reviewed paper found
Modelcard
Modelcard on HF provides information on fine-tuning but nothing for the Mistral base LLM
https://huggingface.co/BramVanroy/GEITje-7B-ultra
Datasheet
Datasheet available for DPO and for the Dutch portions of pretraining data, but not for original Mistral pretraining data, hence partial.
https://huggingface.co/datasets/BramVanroy/ultra_feedback_dutch
Access
Package
No package available
API and Meta Prompts
Model available through HuggingFace API
Licenses
Licensed as CC-BY-ND-4.0 on HuggingFace, though no specific license file or statement found
https://huggingface.co/BramVanroy/GEITje-7B-ultra
Is this information not up to date?
Contribute here ->

Supported by the Centre for Language Studies and the Dutch Research Council. Website design & development © 2024 by BSTN. This version of the index generated 09 Apr 2025, website content last updated 23 Apr 2025.