Inference
The capacity that distinguishes AI systems from other types of systems: the process of deriving outputs through learning, reasoning, or modeling, which transcends basic data processing. Recital 12 identifies two modalities: machine learning approaches (learning from data) and logic-and-knowledge-based approaches (inferring from encoded knowledge or symbolic representation). (Recital 12; Commission Guidelines, 2025-02-06)
Defined in 4 GAGE programs, which carry 8 distinct definitions of it. The wording above is taught in EU AI Act Implementation Expert.
How each discipline defines it
The same term does different work depending on who is using it. These are the definitions as each program teaches them, unedited.
The capacity that distinguishes AI systems from other types of systems: the process of deriving outputs through learning, reasoning, or modeling, which transcends basic data processing. Recital 12 identifies two modalities: machine learning approaches (learning from data) and logic-and-knowledge-based approaches (inferring from encoded knowledge or symbolic representation). (Recital 12; Commission Guidelines, 2025-02-06)
The process of using an already-trained AI model to generate a response to a specific input, such as a prompt. Inference is comparatively cheap and happens continuously across every deployed AI product; it is what most end users actually experience.
The act of running a trained model to produce an output for a request. Small per event but recurring at usage volume, making it the dominant carbon source over a deployed feature's life for most buyers.
The act of using a trained model on new input to produce an output; the model applies already-learned patterns without learning anything new from that interaction, in contrast to training.
The stage at which an already-trained model is actually used: a prompt goes in, and the model generates a response in real time, without permanently updating its underlying training from that specific interaction in most current deployed systems.
Where it is taught
The exact lessons this term appears in. The first module of every program is free with a free account.
- How AI Actually Works: Algorithms, Data, and Training · AI Fundamentals, Certified AI Practitioner: Workplace Foundations
- The Only Ten Things About AI That Matter in Policy · The Point Person Mandate, The AI Lobbyist: Certified AI Policy Strategist
- What AI Really Is: No Hype, No Myths, No Fear · Foundations of AI for Lobbyists, The AI Lobbyist: Certified AI Policy Strategist
- AI Investment Categories and Cost Structures · The Economics and the Business Case, Certified AI Transformation Professional (CATP)
- AI Platform Architecture · Technology, Platforms and Vendors, Certified AI Transformation Professional (CATP)
- Sustainability, ESG and the Carbon Cost of AI · Governance and Responsible AI, Certified AI Transformation Professional (CATP)
- Is It an AI System? Article 3 Definition and Guidelines · Act Foundations and Current Timeline, EU AI Act Implementation Expert
- AI Act and GDPR: FRIA vs DPIA · Regulatory Interplay and Liability, EU AI Act Implementation Expert
Where it shows up at work
A definition is where Inference starts. The lessons above teach it inside the competencies below, which are what job descriptions ask for and what the GAGE credential records. Every link here is drawn from the same careers map that builds a role's readiness check.
Explains training, tokens, context windows, embeddings, retrieval and fine-tuning well enough to ask an engineer a precise question and spot weak evidence.
2 lessons on this page teach it as a primary outcome.
Classifies a system by role and risk tier, knows which obligations bind on which date after the Digital Omnibus, and what evidence conformity needs.
One lesson on this page teach it as a primary outcome.
Builds an honest value model: baseline, measured change, cost, risk, and the projects that should be stopped.
One lesson on this page teach it as a primary outcome.
Roles that hire for it
Each role page shows the full competency set, what the seat decides, and a readiness check against your own evidence.
- AI Regulatory Counselneeds it at depth · 14 open postings this week
- Chief AI Officerneeds it at depth
- AI Policy Analystneeds working knowledge · 7 open postings this week
- Chief Technology Officer, AI engineering editionneeds it at depth
- AI Security Architectneeds it at depth · 8 open postings this week
- AI Evaluation Specialistneeds it at depth · 6 open postings this week
How job descriptions say it
Postings rarely use the textbook word. These are the phrases the careers map reads as asking for the competencies above.
Where the frameworks place it: Regulation (EU) 2024/1689; Regulation (EU) 2026/1744.
One interview question about it
Explain how a large language model produces an answer, at the depth a governance decision needs and no deeper.
Asked of candidates for how models work, at a governance depth. Answering it in your own words is exactly how a GAGE topic is passed, and the credential records the pass where an employer can check it.
If you come from another field
Some backgrounds already carry this competency, and the readiness check gives credit for it.
- Data analysis, stewardship and business intelligence carries it as a claim to back up: SQL and analytical fluency make the technical layer approachable.
- Model risk, credit risk and quantitative analysis carries it as work you can show: Quantitative fluency is demonstrated in your work.
- A computer science or software engineering degree carries it as work you can show: You have trained or integrated a model in coursework or a project.
Terms it appears with
Not an alphabetical neighbourhood: these are the terms taught in the same lessons, ranked by how often they appear together.