dots.llm1 Technical Report

Benchmark Model Rank Results
multi-task-language-understanding-on-c-evaldots.llm1.inst#3Accuracy: 92.2
question-answering-on-c-simpleqadots.llm1.inst#7Accuracy: 56.7
math-word-problem-solving-on-mathdots.llm1.inst#8Accuracy: 85.0
question-answering-on-simpleqadots.llm1.inst#9Accuracy: 9.3
code-generation-on-livecodebench-v5dots.llm1.inst#18Pass@1: 32.0
multi-task-language-understanding-on-mmlu-reduxdots.llm1.inst#25Accuracy: 85.1
code-generation-on-humanevaldots.llm1.inst#35Pass@1: 88.4
mathematical-reasoning-on-math-500dots.llm1.inst#72Accuracy: 84.8
multi-task-language-understanding-on-mmlu-prodots.llm1.inst#73Accuracy: 70.4
multiple-choice-question-answering-mcqa-on-gpqa-diamonddots.llm1.inst#110Accuracy: 52.6