OpenCodePapers

multiple-choice-question-answering-mcqa-on-agieval-english-3-5-shot

Question AnsweringMultiple Choice Question Answering (MCQA)
Dataset Link
Results over time
Click legend items to toggle metrics. Hover points for model names.
Leaderboard
PaperCodeAccuracyModelNameReleaseDate
Gemma 2: Improving Open Language Models at a Practical Size✓ Link55.1Gemma 2 27B (3-5-shot)2024-07-31
Llama 2: Open Foundation and Fine-Tuned Chat Models✓ Link54.2Llama 2 70B (3-5 shot)2023-07-18
Encoder-Decoder Gemma: Improving the Quality-Efficiency Trade-Off via Adaptation✓ Link53.1T5Gemma 9B-9B PrefixLM2025-04-08
Gemma: Open Models Based on Gemini Research and Technology✓ Link41.7Gemma 7B (3-5-shot)2024-03-13
RecurrentGemma: Moving Past Transformers for Efficient Open Language Models✓ Link39.3RecurrentGemma-9B2024-04-11
RecurrentGemma: Moving Past Transformers for Efficient Open Language Models✓ Link23.8RecurrentGemma-2B2024-04-11