The Other Half of the Memory Wall: Serving 35B MoEs from SSD with Trained Routing Prediction

Benchmark Model Rank Results
code-generation-on-humanevalEdge0-8B#26Pass@1: 91.5
mathematical-reasoning-on-aime-2026Edge0-35B-A3B-preview#27Accuracy: 86.6
multi-task-language-understanding-on-mmlu-proEdge0-35B-A3B-preview#40Accuracy: 81.0
multiple-choice-question-answering-mcqa-on-gpqa-diamondEdge0-35B-A3B-preview#56Accuracy: 79.8