Overview

Computer-use agents study how AI systems can interpret screens or structured interface data and act through clicks, typing, gestures, and software tools. Common approaches combine vision-language models with action planning, feedback and verification, reusable skills or memory, and training through demonstrations or reinforcement learning in real or synthetic environments. Benchmarks increasingly test long-horizon, cross-application work and measure task outcomes alongside efficiency, reliability, and safety. Agents can handle many routine interactions, but complex workflows remain difficult, and performance depends strongly on the interface, task design, and safeguards against errors or misuse.

Latest papers

CardsList

171 papers25 papers in the last four weeks, level with the four weeks before. 0.2% of all new papers.

  1. Computer-Use Agents Are Embodied Generalists

    Nov 6, 2026Pranjal Aggarwal, Sean WelleckEmbodied AIComputer-Use Agents

  2. Visual Token Routing: Learning to keep tokens that matter

    Nov 4, 2026Pranjal Aggarwal, Sean WelleckVisual Token PruningVisual Token Compression

  3. ScienceCUA: Resource-to-Skill Construction and Execution-Guided Skill Evolution for Scientific Computer Use Agents

    Nov 2, 2026Daiqiang Li, Jingyi Peng, Rui Hu +7Computer-Use AgentsAgent Skill Learning

  4. NorthCUA Technical Report: Turbocharging Computer-Use Agents through Experience at Scale

    Nov 1, 2026Chaoyun Zhang, Bingxuan Li, Pinxue Guo +27Computer-Use AgentsLLM Agent Training

  5. Hybrid Computer Use: A Unified Programmatic, Semantic, and Visual Interface for General Agents

    Oct 30, 2026Haoqing Wang, Xiaoyi Zhang, Sicheng Fan +5Computer-Use AgentsHuman-Computer Interaction

  6. Cross-Interface Authorization for AI Computer-Use Agents

    Oct 30, 2026Genliang Zhu, Chu WangAI Agent SecurityRuntime Enforcement for AI Agents

  7. What Does "Now" Mean to Your Computer-Use Agent? Stale Screenshots, Page Loads, and Which Check to Run Before a Click

    Oct 29, 2026Vasundra SrinivasanComputer-Use AgentsComputer-Use Agent Evaluation

  8. OS-Wizard: Scaling Computer-Using Agents to Specialized Software via Knowledge-Guided Exploration

    Oct 24, 2026Zhoumianze Liu, Zichen Ding, Bowen Yang +8Computer-Use AgentsGUI Automation

  9. Evolving Agent Interfaces

    Oct 20, 2026Saaket Agashe, Yuzhe Yang, Gonzalo Gonzalez-Pumariega +5Computer-Use AgentsSelf-Evolving Agents

  10. CUA-Recovery: Benchmarking Error Recovery in Long-Horizon Computer-Use Agents

    Oct 20, 2026Xu Hu, Haoming Li, Yuxiang Wang +11Computer-Use AgentsComputer-Use Agent Benchmarks

  11. Agent World Model in the Wild: Computer-Use Agent Environment Synthesis

    Oct 19, 2026Zhaoyang Wang, Qianhui Wu, Haorui Wang +9Computer-Use AgentsSynthetic Data Generation for LLM Agents

  12. Adaptation of Computer Use Agents to New Software with User Manuals

    Oct 16, 2026Chulhoon Yoon, Kyungri Park, Jinyeong Yun +3Computer-Use AgentsLLM Agent Training

  13. PersonaCUABench: Benchmarking Computer-Use Agents Serving Diverse Personas

    Oct 16, 2026Haoming Li, Defu Cao, Xu Hu +23Computer-Use Agent EvaluationComputer-Use Agent Benchmarks

  14. LEASH: Uncertainty-Aware Weak-to-Strong Escalation and Oversight for Computer-Use Agents

    Oct 15, 2026Qingni Wang, Changdae Oh, Yuzhe Yang +4Computer-Use AgentsAI Agent Monitoring

  15. OS-Helix: Unifying GUI Interaction and Code Execution in Native Computer-Using Agents

    Oct 15, 2026Bowen Yang, Kaiming Jin, Zichen Ding +8Computer-Use AgentsGUI Automation

  16. OpenGCUA: Toward a Fully Open Stack for Generalist Computer Use

    Oct 15, 2026Hanzhang Zhou, Long Li, Quyu Kong +12Computer-Use AgentsLLM Agent Harnesses

  17. Probe-and-Resume: When and How to Evaluate Agent Execution

    Oct 15, 2026Jiakai Xu, Tiancheng Ge, Tujie Guan +4Computer-Use AgentsInference-Time Search

  18. CLASHarness: Benchmarking Multi-Agent Conflict in Computer Use via a Controllable and Verifiable Generation Pipeline

    Oct 13, 2026Yuxiang Lai, Jike Zhong, Chengzhi Liu +6Computer-Use AgentsAI Agent Benchmarks

  19. Interaction-as-a-Judge

    Oct 13, 2026Wayne Chi, I-Hung Hsu, Li Chen +6AI Agent EvaluationAI Coding Agents

  20. Work2Skill: Capturing Human GUI Experience for Reusable Agent Skill Induction

    Oct 9, 2026Yuqi Huang, Hui Li, Yifei Cao +9GUI AgentsAgent Skill Learning

  21. SoftwareGym: Scaling Computer-Use Agent Training with Diverse Synthesized Software Environments

    Oct 8, 2026Tian Jin, Wenhao Wang, Jing Kang +4Computer-Use AgentsLLM Agent Training

  22. Secure-CUA: Controlling Untrusted Influence in Computer-Use Agents

    Oct 7, 2026Sarthak Choudhary, Mihai Christodorescu, Ashish Hooda +3Computer-Use AgentsAI Agent Security

  23. nanoMuse: An Open-Source Personal Agent for Every Device You Own

    Oct 6, 2026Guangyi Liu, Yong Liu, Jiangning ZhangPersonal AI AgentsComputer-Use Agents