Apertus: Democratizing Open and Compliant LLMs for Global Language Environments

Benchmark Model Rank Results
multi-task-language-understanding-on-includeApertus-70B-Instruct#10Accuracy: 58.2
common-sense-reasoning-on-winograndeApertus-70B#65Accuracy: 73.3
code-generation-on-mbppApertus-70B-Instruct#120Accuracy: 47
math-word-problem-solving-on-mathApertus-70B-Instruct#134Accuracy: 30.8
sentence-completion-on-hellaswagApertus-70B#136Accuracy: 64.0
arithmetic-reasoning-on-gsm8kApertus-70B-Instruct#168Accuracy: 77.6