The Llama 4 herd

Open paper

Benchmark	Model	Rank	Results
code-generation-on-humaneval	Llama 4 Maverick	#25	Pass@1: 84.8
code-generation-on-humaneval	Llama 4 Scout	#30	Pass@1: 81.1
code-generation-on-swe-bench-pro	llama4-maverick-17b-instruct	#22	Resolved: 5.24