STaR: Bootstrapping Reasoning With Reasoning

Benchmark Model Rank Results
common-sense-reasoning-on-commonsenseqaSTaR (on GPT-J)#16Accuracy: 72.3
common-sense-reasoning-on-commonsenseqaSTaR without Rationalization (on GPT-J)#18Accuracy: 68.8
common-sense-reasoning-on-commonsenseqaGPT-J Direct Finetuned#26Accuracy: 60.0
common-sense-reasoning-on-commonsenseqaFew-shot CoT LaMDA 137B#30Accuracy: 55.6
common-sense-reasoning-on-commonsenseqaFew-shot CoT GPT-J#32Accuracy: 36.6
common-sense-reasoning-on-commonsenseqaFew-shot Direct GPT-J#35Accuracy: 20.9