Soofi Consortium Releases Soofi S 30B-A3B: An Open Hybrid Mamba-Transformer MoE Foundation Model For German And English
A German analysis consortium has printed the pretraining report for Soofi S 30B-A3B. It is an open base mannequin for German and English. Training ran finish to finish on Deutsche Telekom’s Industrial AI Cloud in Munich. Preview weights are on Hugging Face. It is value noting that amongst among the totally open base fashions examined,…
