| Paper | Code | Element Accuracy | Step Success Rate | Operation F1 | ModelName | ReleaseDate |
|---|---|---|---|---|---|---|
| UI-TARS: Pioneering Automated GUI Interaction with Native Agents | ✓ Link | 72.4 | 63.5 | 91.2 | UI-TARS-72B-SFT | 2025-01-21 |
| Aguvis: Unified Pure Vision Agents for Autonomous GUI Interaction | ✓ Link | 62.6 | 56.5 | 88.6 | AGUVIS-72B | 2024-12-05 |
| STEVE: A Step Verification Pipeline for Computer-use Agent Training | ✓ Link | 44.4 | 37.7 | STEVE UI-Grounding + GPT-4o (extra data) | 2025-03-16 | |
| GUICourse: From General Vision Language Models to Versatile GUI Agents | ✓ Link | 34.7 | 29.7 | MiniCPM-GUI + Larger LM (extra data) | 2024-06-17 | |
| SeeClick: Harnessing GUI Grounding for Advanced Visual GUI Agents | ✓ Link | 21.4 | 16.4 | 80.6 | SeeClick | 2024-01-17 |
| CogAgent: A Visual Language Model for GUI Agents | ✓ Link | 54.0 | CogAgent-18B | 2023-12-14 |