AI evaluation
What does AI evaluation cover in AI governance?
1 competency is filed under it: AI evaluation and testing design. Each has its own page saying what it means in practice.
The competencies filed under it
- AI evaluation and testing design
Designs tests for factuality, robustness, fairness, safety and abuse resistance with rubrics, baselines and thresholds, and says what a score misses.
Technical Evaluation
Roles that ask for it
- AI Engineer, production systems edition1 of 1 competency
- AI Evaluation Specialist1 of 1 competency
- AI Governance Engineer1 of 1 competency
- AI Model Validator1 of 1 competency
- AI Product Manager, responsible product edition1 of 1 competency
- Ethical AI Specialist1 of 1 competency
- Agentic AI Engineer, orchestration edition1 of 1 competency
- AI Security Architect1 of 1 competency
- Model Risk Manager1 of 1 competency
- Physical AI Safety Engineer, autonomous systems edition1 of 1 competency
- Robotics AI Engineer, embodied systems edition1 of 1 competency
- Chief Technology Officer, AI engineering edition1 of 1 competency
Where it is taught and graded
19 graded topics, each passed by explaining it back. The first module of every program is free with a free account.
- Module 3: Failure Analysis, Learning From How Robots Break (1)
- Module 6: Human Factors and Human-Robot Interaction (1)
- Module 7: Research, Benchmarking, and Staying at the Frontier (2)
- Module 10: Responsible Physical AI in Practice (2)
- Module 6: Testing and Red-Teaming (4)
- Module 11: The Capstone: Deploy and Defend (1)
- Module 4: Practical AI Workflow Design and Prompt Engineering (1)
- Module 6: AI in the Workplace and Team Leadership (1)
- Module 13: Bonus: AI for Educators (1)
- Module 4: Evaluation and Trust (1)
- Module 10: Evidence Engineering (1)
- Module 17: AI Governance, AI Risk, AI Security, and AI Assurance (1)
- Module 18: Governance, Risk and Compliance Technology, Automation, and Evidence Engineering (1)
- Module 9: Risk, Resilience and Frontier AI (1)
Questions
- What does AI evaluation cover in AI governance?
- 1 competency is filed under it: AI evaluation and testing design. Each has its own page saying what it means in practice.
- Which roles ask for AI evaluation?
- 12 roles on the map name at least one of its competencies, from analyst seats to executive ones. Each role page lists the depth expected.
- Where is AI evaluation taught and graded?
- 19 graded topics teach it across 6 programs. Each topic is graded by explaining it back against its own transcript, so a pass is evidence, not attendance. The first module of every program is free with a free account.