A Sovereign, Open-Source Foundation Model for German and English

Benchmark Model Rank Results
question-answering-on-piqaSoofi S 30B-A3B Base#12Accuracy: 85.7
code-generation-on-mbppSoofi S 30B-A3B Base#57Accuracy: 70.2
code-generation-on-humanevalSoofi S 30B-A3B Base#77Pass@1: 73.8
arithmetic-reasoning-on-gsm8kSoofi S 30B-A3B Base#106Accuracy: 86.1
multi-task-language-understanding-on-mmlu-proSoofi S 30B-A3B Base#113Accuracy: 51.4
multiple-choice-question-answering-mcqa-on-gpqa-diamondSoofi S 30B-A3B Base#121Accuracy: 43.4
sentence-completion-on-hellaswagSoofi S 30B-A3B Base#135Accuracy: 64.1