Claude 2
Open paper
Benchmark
Model
Rank
Results
arithmetic-reasoning-on-gsm8k
Claude 2
–
Accuracy: 88.0
code-generation-on-humaneval
Claude 2
–
Pass@1: 71.2
Rank counts only results with a code link.