Aleph Alpha released Kolibri, a 78B-parameter, 3.46B active, MoE open-weight model with 1M context window, distributed under the Apache 2.0 license.

Aleph Alpha is a German AI lab, and it is probably the first general-purpose model from the EU, apart from Mistral, to achieve this level of performance!

"The model supports an explicit reasoning mode and tool calling. It is optimized for long-context and inference efficiency."

"The Aleph Alpha team developed a bilingual German/English tokenizer and focused on including organic German data throughout the training process of the model, so that 21.3% of the pre-training tokens are German."

"Kolibri was built with the EU AI Act, the General-Purpose AI Code of Practice and the GDPR in mind from the ground up, with copyright law being a focus of our work to trustworthy technology."

More EU labs are joining the party 👀