OpenCodePapers

multiple-choice-question-answering-mcqa-on-28

Question AnsweringMultiple Choice Question Answering (MCQA)
Dataset Link
Results over time
Click legend items to toggle metrics. Hover points for model names.
Leaderboard
PaperCodeAccuracyModelNameReleaseDate
PaLM 2 Technical Report✓ Link94.4PaLM 2 (few-shot, k=3, CoT)2023-05-17
PaLM 2 Technical Report✓ Link93.6PaLM 2 (few-shot, k=3, Direct)2023-05-17
BloombergGPT: A Large Language Model for Finance✓ Link91.2BLOOM 176B (few-shot, k=3)2023-03-30
BloombergGPT: A Large Language Model for Finance✓ Link91.2OPT 66B (few-shot, k=3)2023-03-30
BloombergGPT: A Large Language Model for Finance✓ Link90.4Bloomberg GPT (few-shot, k=3)2023-03-30
BloombergGPT: A Large Language Model for Finance✓ Link87.2PaLM 540B (few-shot, k=3)2023-03-30
BloombergGPT: A Large Language Model for Finance✓ Link86.4GPT-NeoX (few-shot, k=3)2023-03-30
Training Compute-Optimal Large Language Models✓ Link75.6Chinchilla-70B (few-shot, k=5)2022-03-29
Scaling Language Models: Methods, Analysis & Insights from Training Gopher✓ Link50.5Gopher-280B (few-shot, k=5)2021-12-08