| answerability-prediction-on-peerqa | Mistral-IT-v02-7B-32k | #1 | Macro F1: 0.4703 |
| arithmetic-reasoning-on-gsm8k | Mistral 7B (maj@8) | #94 | Accuracy: 52.2Parameters (Billion): 7 |
| code-generation-on-mbpp | Mistral 7B (3-shot) | #57 | Accuracy: 47.5 |
| common-sense-reasoning-on-arc-challenge | Mistral 7B (0-shot) | #19 | Accuracy: 55.5 |
| common-sense-reasoning-on-arc-easy | Mistral 7B (0-shot) | #14 | Accuracy: 80.0 |
| common-sense-reasoning-on-winogrande | Mistral 7B (0-shot) | #25 | Accuracy: 75.3 |
| math-word-problem-solving-on-math | Mistral 7B (maj@4) | #97 | Accuracy: 13.1Parameters (Billions): 7 |
| multi-task-language-understanding-on-mmlu | Mistral 7B (5-shot) | #13 | Average (%): 60.1 |
| question-answering-on-natural-questions | Mistral 7B (5-shot) | #29 | EM: 28.8 |
| question-answering-on-peerqa | Mistral-v02-7B-32k | #2 | Prometheus-2 Answer Correctness: 3.4245Rouge-L: 0.1922… |
| question-answering-on-piqa | Mistral 7B (0-shot) | #15 | Accuracy: 83.0 |
| question-answering-on-triviaqa | Mistral 7B (5-shot) | #18 | EM: 69.9 |
| sentence-completion-on-hellaswag | Mistral 7B (0-shot) | #32 | Accuracy: 81.3 |
| zero-shot-video-question-answer-on-intentqa | Mistral (7B) | #11 | Accuracy: 50.4 |
| zero-shot-video-question-answer-on-next-gqa | Mistral (7B) | #8 | Acc@GQA: 9.2 |
| zero-shot-video-question-answer-on-next-qa | Mistral (7B) | #23 | Accuracy: 51.1 |