OpenCodePapers

computer-use-agents-on-screenspot-v2

AgentsComputer Use Agents
Dataset Link
Results over time
Click legend items to toggle metrics. Hover points for model names.
Leaderboard
PaperCodeAccuracyModelNameReleaseDate
Qwen-UI-Agent Technical Report: Toward Next-Generation Real-World Centric Foundation GUI Agents97.5Qwen-UI-Agent (27B)2026-07-30
MAI-UI Technical Report: Real-World Centric Foundation GUI Agents✓ Link96.5MAI-UI-32B2025-12-26
OmegaUse: Building a General-Purpose GUI Agent for Autonomous Task Execution96.3OmegaUse-G2026-01-28
UI-Venus-1.5 Technical Report✓ Link96.2UI-Venus-1.5-30B-A3B2026-02-09
GroundingPI: A Grounding Foundation Model towards Physical Intelligence with Visual Primitives✓ Link96.15GroundingPI2026-09-30
Holo2: Foundational Models for Navigation and Computer Use Agents95.9Holo2-235B-A22B2026-02-03
POINTS-GUI-G: GUI-Grounding Journey✓ Link95.7POINTS-GUI-G-8B2026-02-06
Trust the Right Teacher: Quality-Aware Self-Distillation for GUI Grounding95.68Quality-Aware Self-Distillation2026-06-16
GroundAnything: Reconciling Parallel Decoding with Precise Visual Grounding at Flash Speed✓ Link95.6GroundAnything2026-09-30
Mobile-Agent-v3.5: Multi-platform Fundamental GUI Agents✓ Link95.3GUI-Owl-1.5-32B-Instruct2026-02-15
Seed1.5-VL Technical Report✓ Link95.2Seed1.5-VL (thinking)2025-05-11
GTA1: GUI Test-time Scaling Agent✓ Link95.2GTA1-32B2025-07-08
GroundGUI: GUI Grounding by High-Quality Data and Distillation-to-Reinforcement Learning✓ Link95.2GroundGUI-8B2026-10-13
Step-GUI Technical Report✓ Link95.1Step-GUI-8B2025-12-17
GUI-Libra: Training Native GUI Agents to Reason and Act with Action-aware Supervision and Partially Verifiable RL✓ Link94.8GUI-Libra-8B + Mix Grounding 20K (extra data)2026-02-25
ScaleCUA: Scaling Open-Source Computer Use Agents with Cross-Platform Data✓ Link94.7ScaleCUA-32B2025-09-18
Fara-1.5: Scalable Learning Environments for Computer Use Agents✓ Link94.4Fara1.5-27B2026-06-18
UI-TARS: Pioneering Automated GUI Interaction with Native Agents✓ Link94.2UI-TARS-1.5 (early access)2025-01-21
MolmoPoint: Better Pointing for VLMs with Grounding Tokens✓ Link93.9MolmoPoint-GUI-8B (64crops)2026-03-30
Intern-S1-Pro: Scientific Multimodal Foundation Model at Trillion Scale93.6Intern-S1-Pro2026-03-26
InfiGUI-G1: Advancing GUI Grounding with Adaptive Exploration Policy Optimization✓ Link93.5InfiGUI-G1-7B (extra data)2025-08-07
EvoCUA: Evolving Computer Use Agents via Learning from Scalable Synthetic Experience✓ Link93.47EvoCUA-OpenCUA-72B2026-01-22
OpenCUA: Open Foundations for Computer-Use Agents✓ Link93.4OpenCUA-32B2025-08-12
Nemotron 3 Nano Omni: Efficient and Open Multimodal Intelligence✓ Link93.4Nemotron 3 Nano Omni2026-04-27
GUI-G$^2$: Gaussian Reward Modeling for GUI Grounding✓ Link93.3GUI-G²-7B2025-07-21
Mobile-Agent-v3: Fundamental Agents for GUI Automation✓ Link93.2GUI-Owl-32B2025-08-21
FocusUI: Efficient UI Grounding via Position-Preserving Visual Token Selection✓ Link93.1FocusUI-7B (r=100%)2026-01-07
Kimi-VL Technical Report✓ Link92.8Kimi-VL-A3B-Instruct2025-04-10
STEP3-VL-10B Technical Report✓ Link92.61Step3-VL-10B2026-01-14
UItron: Foundational GUI Agent with Advanced Perception and Planning✓ Link92.0UItron-72B2025-08-29
MolmoWeb: Open Visual Web Agent and Open Data for the Open Web✓ Link91.8MolmoWeb-Ground (8B)2026-04-09
Scaling Computer-Use Grounding via User Interface Decomposition and Synthesis✓ Link91.7Jedi-7B2025-05-19
GAIA: A Data Flywheel System for Training GUI Test-Time Scaling Critic Models✓ Link91.0UI-TARS 1.5* + ICM-r22026-01-26
UI-MOPD: Multi-Platform On-Policy Distillation for Continual GUI Agent Learning✓ Link90.88UI-MOPD2026-07-05
LLaDA-UI: Bringing Block-wise Diffusion to Vision-Language GUI Agents✓ Link90.7LLaDA-UI2026-09-09
PixelPrune: Pixel-Level Adaptive Visual Token Reduction via Predictive Coding✓ Link90.6Qwen3-VL (2B) with PixelPrune (+KD)2026-04-01
MiMo-VL Technical Report✓ Link90.5MiMo-VL-7B-RL2025-06-04
Grounding Computer Use Agents on Human Demonstrations✓ Link90.4GroundNext-7B (RL)2025-11-10
DeskForge: Dense Supervision from Desktop Environments for Computer-Use Agents✓ Link90.33DeskForge-Qwen3.5-4B2026-10-01
Enhancing Visual Grounding for GUI Agents via Self-Evolutionary Reinforcement Learning✓ Link90.3SE-GUI-7B (extra data)2025-05-18
UI-Copilot: Advancing Long-Horizon GUI Automation via Tool-Integrated Policy Optimization✓ Link90.0UI-Copilot-7B2026-04-15
UI-R1: Enhancing Efficient Action Prediction of GUI Agents by Reinforcement Learning✓ Link89.5UI-R1-E-3B2025-03-27
Fara-7B: An Efficient Agentic Model for Computer Use✓ Link89.3Fara-7B2025-11-24
BTL-UI: Blink-Think-Link Reasoning Model for GUI Agent✓ Link89.1BTL-UI 7B2025-09-19
Detect Anything via Next Point Prediction✓ Link88.4Rex-Omni2025-10-14
LongCat-Next: Lexicalizing Modalities as Discrete Tokens✓ Link88.3LongCat-Next (A3B, 68.5B)2026-03-29
Phi-4-reasoning-vision-15B Technical Report✓ Link88.2Phi-4-reasoning-vision-15B2026-03-04
AutoWebWorld: Synthesizing Infinite Verifiable Web Environments via Finite State Machines✓ Link86.16AutoWebWorld 7B2026-02-15
Vision as Unified Multimodal Generation✓ Link85.9SenseNova-Vision2026-07-07
OS-ATLAS: A Foundation Action Model for Generalist GUI Agents✓ Link84.12OS-Atlas-Base-7B2024-10-30
Continual GUI Agents✓ Link81.2GUI-AiF (Qwen2.5VL-3B)2026-01-28
GoClick: Lightweight Element Grounding Model for Autonomous GUI Interaction✓ Link81.1GoClick-L (0.8B)2026-04-27