ARC: Fair Relative Advantage Comparison in Open-Ended Real-World Interaction

Benchmark Model Rank Results
agents-on-benchGRPO + ARC (Qwen3-8B)–Accuracy: 38.22
agents-on-bench-telecomGRPO+ARC (Qwen3-4B)–Accuracy: 30.03
agents-on-taubench-airlineGRPO + ARC (Qwen3-8B)–Accuracy: 44.0
agents-on-taubench-retailGRPO + ARC (Qwen3-8B)–Accuracy: 50.0
instruction-following-on-ifbenchDAPO + ARC (Qwen3-8B)–Accuracy: 17.35
mathematical-reasoning-on-aime-2026DAPO + ARC (Qwen3-8B)–Accuracy: 41.25