Textbooks Are All You Need II: phi-1.5 technical report

Benchmark Model Rank Results
question-answering-on-social-iqaphi-1.5-web 1.3B (zero-shot)#16Accuracy: 53.0
question-answering-on-social-iqaphi-1.5 1.3B (zero-shot)#17Accuracy: 52.6
common-sense-reasoning-on-arc-challengephi-1.5-web 1.3B (zero-shot)#30Accuracy: 44.9
common-sense-reasoning-on-arc-easyphi-1.5-web 1.3B (0-shot)#31Accuracy: 76.1
common-sense-reasoning-on-winograndephi-1.5-web 1.3B (zero-shot)#59Accuracy: 74.0
multi-task-language-understanding-on-mmluphi-1.5-web 1.3B#77Average (%): 37.9
question-answering-on-piqaphi-1.5-web (1.3B)#95Accuracy: 77
code-generation-on-mbppphi-1.5-web 1.3B#129Accuracy: 43.5