daVinci-LLM:Towards the Science of Pretraining

Benchmark Model Rank Results
reading-comprehension-on-racedaVinci-LLM (3B)#29Accuracy: 38.56
math-word-problem-solving-on-mathdaVinci-LLM-3B#45Accuracy: 62.8
multi-task-language-understanding-on-mmludaVinci-LLM-3B#47Average (%): 62.53
question-answering-on-piqadaVinci-LLM-3B#85Accuracy: 77.26
common-sense-reasoning-on-winograndedaVinci-LLM-3B#90Accuracy: 66.77
code-generation-on-humanevaldaVinci-LLM-3B#93Pass@1: 61.64
sentence-completion-on-hellaswagdaVinci-LLM-3B#104Accuracy: 71.17
code-generation-on-mbppdaVinci-LLM-3B#111Accuracy: 49
multi-task-language-understanding-on-mmlu-prodaVinci-LLM-3B#123Accuracy: 43.5
arithmetic-reasoning-on-gsm8kdaVinci-LLM-3B#185Accuracy: 72.86