The StarCraft Multi-Agent Challenge

Benchmark Model Rank Results
smac-on-smac-27m-vs-30mQMIX#7Median Win Rate: 49
smac-on-smac-27m-vs-30mHeuristic#11Median Win Rate: 0
smac-on-smac-3s5z-vs-3s6zVDN#10Median Win Rate: 2
smac-on-smac-3s5z-vs-3s6zIQL#12Median Win Rate: 0
smac-on-smac-3s5z-vs-3s6zHeuristic#13Median Win Rate: 0
smac-on-smac-6h-vs-8zQMIX#6Median Win Rate: 3
smac-on-smac-6h-vs-8zIQL#8Median Win Rate: 0
smac-on-smac-6h-vs-8zVDN#9Median Win Rate: 0
smac-on-smac-6h-vs-8zHeuristic#10Median Win Rate: 0
smac-on-smac-corridorQMIX#10Median Win Rate: 1
smac-on-smac-corridorIQL#12Median Win Rate: 0
smac-on-smac-corridorHeuristic#13Median Win Rate: 0
smac-on-smac-mmm2QMIX#9Median Win Rate: 69
smac-on-smac-mmm2VDN#12Median Win Rate: 1
smac-on-smac-mmm2IQL#13Median Win Rate: 0
smac-on-smac-mmm2Heuristic#14Median Win Rate: 0