| Paper | Code | Pass Rate | w/o Intact | w/o PE | ModelName | ReleaseDate |
|---|---|---|---|---|---|---|
| []() | 57.5 | 57.5 | 70.0 | Jupyter-AI | ||
| []() | 45.0 | 45.0 | 60.0 | Chapyter | ||
| []() | 45.0 | 45.0 | 55.0 | Code Interpreter API | ||
| MLCopilot: Unleashing the Power of Large Language Models in Solving Machine Learning Tasks | ✓ Link | 42.5 | 42.5 | 62.5 | CoML | 2023-04-28 |
| []() | 32.5 | 32.5 | 50.0 | ChatDev |