SonicMoE: Accelerating MoE with IO and Tile-aware Optimizations

Benchmark Model Rank Results
social-commonsense-reasoning-on-siqaToken Rounding (1.8B MoE)#11Accuracy: 42.1
common-sense-reasoning-on-arc-easyToken Rounding (1.8B MoE)#74Accuracy: 63.0
question-answering-on-boolqToken Rounding (1.8B MoE)#93Accuracy: 61.4
question-answering-on-piqaToken Rounding (1.8B MoE)#147Accuracy: 69.6