Computer-use agent
An agent designed to perceive and act on user interfaces the way a person would, often by taking and interpreting screenshots, rather than through a direct data feed or application programming interface (API). Its perception method, such as reliance on screenshots, can itself be a source of testable limitations, as in the AI safety testing use case.
Defined in 3 GAGE programs, which carry 4 distinct definitions of it. The wording above is taught in Agentic AI Governance: Applied Mastery.
How each discipline defines it
The same term does different work depending on who is using it. These are the definitions as each program teaches them, unedited.
An agent designed to perceive and act on user interfaces the way a person would, often by taking and interpreting screenshots, rather than through a direct data feed or application programming interface (API). Its perception method, such as reliance on screenshots, can itself be a source of testable limitations, as in the AI safety testing use case.
An agent that operates a computer the way a person does, reading the screen and clicking and typing, so it can drive software that has no dedicated integration. Reached general availability and early production use by 2026, at benchmark success rates high enough to deploy but not to trust blindly.
An agent that operates software by controlling a computer interface (clicking, typing, navigating apps), measured by benchmarks like OSWorld; capability is rising fast while production reliability lags.
An agent that operates software the way a person does, by reading the screen and controlling the keyboard and mouse, rather than through a dedicated interface. An established production category in 2026 across multiple major providers.
Where it is taught
The exact lessons this term appears in. The first 7 topics of every program are free with a free account.
- The Year of the AI Agent: How 2026 Workplaces Are Changing · Agentic AI and Workforce Integration, AI Literacy & Professional Conduct
- Build the Test Environment Before You Trust a Single Score · Testing and Red-Teaming, Agentic AI Governance: Applied Mastery
- The AI Technology Stack Decoded · AI Literacy for Decision Makers, Business AI Transformation
- Frontier AI, Autonomous Agents and Emerging Paradigms · Risk, Resilience and Frontier AI, Business AI Transformation
Terms it appears with
Not an alphabetical neighbourhood: these are the terms taught in the same lessons, ranked by how often they appear together.