Preprint
A research paper posted publicly, commonly on a server such as arXiv (Cornell University, operating since 1991), before or instead of formal peer review at a conference or journal. Widely used in fast-moving fields including robotics, and not equivalent to a peer-reviewed publication in terms of independent scrutiny received.
Defined in 2 GAGE programs, which carry 3 distinct definitions of it. The wording above is taught in Engineering Judgment and Professional Formation.
How each discipline defines it
The same term does different work depending on who is using it. These are the definitions as each program teaches them, unedited.
A research paper posted publicly, commonly on a server such as arXiv (Cornell University, operating since 1991), before or instead of formal peer review at a conference or journal. Widely used in fast-moving fields including robotics, and not equivalent to a peer-reviewed publication in terms of independent scrutiny received.
A research paper shared publicly before completing formal peer review; useful for tracking emerging findings early, but treated with more caution than a peer-reviewed publication until independent review and, ideally, replication confirm the result.
A research paper posted to a server such as arXiv before, or sometimes without ever completing, formal peer review. Useful for finding the newest ideas quickly; treated as a lead to verify, not settled evidence, until reviewed, replicated, or supported by released code.
Where it is taught
The exact lessons this term appears in. The first module of every program is free with a free account.
- What the Evidence Really Says About AI and Learning · Bonus: AI for Educators, Certified AI Practitioner: Workplace Foundations
- Reading a research paper and extracting what matters · Research, Benchmarking, and Staying at the Frontier, Engineering Judgment and Professional Formation
- Running a literature review on a hard problem · Research, Benchmarking, and Staying at the Frontier, Engineering Judgment and Professional Formation
Where it shows up at work
A definition is where Preprint starts. The lessons above teach it inside the competencies below, which are what job descriptions ask for and what the GAGE credential records. Every link here is drawn from the same careers map that builds a role's readiness check.
Designs tests for factuality, robustness, fairness, safety and abuse resistance with rubrics, baselines and thresholds, and says what a score misses.
One lesson on this page teach it as a primary outcome.
Explains training, tokens, context windows, embeddings, retrieval and fine-tuning well enough to ask an engineer a precise question and spot weak evidence.
One lesson on this page teach it as a primary outcome.
Reads bills and rules like a practitioner, compares options with costs and unintended effects, and writes briefs a decision-maker can act on.
One lesson on this page teach it as a primary outcome.
Roles that hire for it
Each role page shows the full competency set, what the seat decides, and a readiness check against your own evidence.
- Chief Technology Officer, AI engineering editionneeds it at depth
- AI Evaluation Specialistneeds it at depth · 6 open postings this week
- AI Model Validatorneeds it at depth
- Model Risk Managerneeds it at depth
- AI Product Manager, responsible product editionneeds it at depth · 3 open postings this week
- AI Security Architectneeds it at depth · 8 open postings this week
How job descriptions say it
Postings rarely use the textbook word. These are the phrases the careers map reads as asking for the competencies above.
Where the frameworks place it: NIST AI RMF MEASURE 1 and 2; NIST AI 600-1.
One interview question about it
Design the evaluation for a customer-service model before launch. What do you test, against what data, and what result blocks the release?
Asked of candidates for ai evaluation and testing design. Answering it in your own words is exactly how a GAGE topic is passed, and the credential records the pass where an employer can check it.
If you come from another field
Some backgrounds already carry this competency, and the readiness check gives credit for it.
- Model risk, credit risk and quantitative analysis carries it as work you can show: Test design and benchmark selection are the craft.
- A computer science or software engineering degree carries it as a claim to back up: Testing is second nature; AI evaluation design is a new shape of it.
- A data science, statistics or analytics degree carries it as a claim to back up: Evaluation design for a governance decision is a new frame for a known skill.
Terms it appears with
Not an alphabetical neighbourhood: these are the terms taught in the same lessons, ranked by how often they appear together.