BEAM: Binary Expert Activation Masking for Dynamic Routing in MoE

Benchmark Model Rank Results
arithmetic-reasoning-on-gsm8kQwen3-30B-A3B (BEAM, beta=0.01)–Accuracy: 85.52
math-word-problem-solving-on-mathQwen3-30B-A3B (BEAM, beta=0.01)–Accuracy: 55.16
question-answering-on-boolqQwen3-30B-A3B (BEAM, beta=0.01)–Accuracy: 88.07