Skip to main content

Capability versus reliability

A capability is something a system can do in at least one case (what a demo shows); reliability is how often it does it correctly across inputs you did not choose (what an eval measures). Trust depends on reliability, and mistaking a demonstrated capability for reliability is the central error of the module.

Defined in 2 GAGE programs, which carry 3 distinct definitions of it. The wording above is taught in Certified AI Governance Professional (CAIGP).

How each discipline defines it

The same term does different work depending on who is using it. These are the definitions as each program teaches them, unedited.

Certified AI Governance Professional (CAIGP)

A capability is something a system can do in at least one case (what a demo shows); reliability is how often it does it correctly across inputs you did not choose (what an eval measures). Trust depends on reliability, and mistaking a demonstrated capability for reliability is the central error of the module.

Certified AI Practitioner: Workplace Foundations

The distinction between what an agent can attempt (almost anything phrased as a goal) and what it can reliably do on the real, messy version of a task (a separate, usually lower, empirically-measured number). Delegation depends on the reliability, not the attempt.

Certified AI Practitioner: Workplace Foundations

The core distinction of this topic. Capability is what an agent can do in its best moment (often shown in a demo); reliability is how consistently it does the task correctly, unsupervised, across varied real conditions. The gap between them is large in 2026.

Where it is taught

The exact lessons this term appears in. The first module of every program is free with a free account.

Where it shows up at work

A definition is where Capability versus reliability starts. The lessons above teach it inside the competencies below, which are what job descriptions ask for and what the GAGE credential records. Every link here is drawn from the same careers map that builds a role's readiness check.

Human oversight designGovernance and Oversight

Defines who reviews AI outputs, what they check, when they can override, and how to keep review from becoming a rubber stamp.

One lesson on this page teach it as a primary outcome.

Knows when to trust, verify, escalate or override an AI recommendation, and stays accountable for the decision.

One lesson on this page teach it as a primary outcome.

Briefs a model like a good manager: context, constraints, examples, verification, and knows when to stop delegating.

One lesson on this page teach it as a primary outcome.

Roles that hire for it

Each role page shows the full competency set, what the seat decides, and a readiness check against your own evidence.

How job descriptions say it

Postings rarely use the textbook word. These are the phrases the careers map reads as asking for the competencies above.

“human oversight”“human in the loop”“human review”“automation bias”“meaningful review”“decision support”

Where the frameworks place it: EU AI Act Article 14; ISO/IEC 42001 Annex A; NIST AI RMF GOVERN.

One interview question about it

Design the human oversight for an AI system that approves refunds. What does the reviewer see, and what stops rubber-stamping?

Asked of candidates for human oversight design. Answering it in your own words is exactly how a GAGE topic is passed, and the credential records the pass where an employer can check it.

If you come from another field

Some backgrounds already carry this competency, and the readiness check gives credit for it.

Terms it appears with

Not an alphabetical neighbourhood: these are the terms taught in the same lessons, ranked by how often they appear together.