SmolLM - blazingly fast and remarkably powerful

Benchmark Model Rank Results
instruction-following-on-ifevalSmolLM 1.7B Instruct#14Prompt-level strict-accuracy: 18.48
question-answering-on-piqaSmolLM 1.7B#89Accuracy: 77.3
sentence-completion-on-hellaswagSmolLM 1.7B#134Accuracy: 64.1
code-generation-on-humanevalSmolLM 1.7B#135Pass@1: 20.76
common-sense-reasoning-on-winograndeSmolLM 1.7B#146Accuracy: 56.0