ACES: Who Tests the Tests? Leave-One-Out AUC Consistency for Code Generation
Open paper
Benchmark
Model
Rank
Results
code-generation-on-humaneval
ACES-O
–
Pass@1: 84.15
code-generation-on-mbpp
ACES-O
–
Accuracy: 72.37
Rank counts only results with a code link.