A term of the Frontier Risk Lane
What is recursive self-improvement in AI?
Recursive self-improvement is a hypothesised process in which an AI system improves its own capabilities, and those improvements enable further improvements, so that progress compounds faster than human oversight can follow. It is the concern the Pacing the Frontier statement of July 2026 names, and the one Dario Amodei's September essay argues justifies a slower pace.
Term: Recursive self-improvement. Verified September 16, 2026.
In detail
The idea is older than the labs that now discuss it, but 2026 gave it a concrete form: frontier labs using their own models to do AI research, and the question of what happens when the models doing the research are the ones being improved. The Pacing the Frontier statement does not claim this is happening at a dangerous rate now. Its argument is that if it did, the tools to notice and to slow it would need to exist already, and they do not.
The term is often used loosely for any model that writes code, which it is not. A coding agent improving a product is automation. Recursive self-improvement, in the sense the statement uses, is the model improving the process that produces the next model. Whether the distinction can be measured from outside a lab is one of the questions the Slowdown Docket keeps open, and one reason the Amodei essay's commitment to give evaluators standing access matters more than any single number.
Sanders and Casar's Ban Artificial Superintelligence Act reaches the same concern from the other end, by defining superintelligence in terms of capability and proposing to ban it. The three documents disagree about what to do and agree about what they are worried about.
Rests on
The records this term is grounded in
- VerifiedDKT-2026-0001 Pacing the Frontier, a statement by employees of frontier AI companies(Slowdown Docket)
- VerifiedDKT-2026-0005 Dario Amodei's essay We Must Pace the Frontier and Anthropic's evaluator commitment(Slowdown Docket)
- VerifiedDKT-2026-0004 The Ban Artificial Superintelligence Act, Sanders and Casar(Slowdown Docket)
Related terms
Read next
- What does pacing the frontier mean?
- What is p(doom)?
- What is the Ban Artificial Superintelligence Act?
All 12 terms, the six instruments and the threads across them: the Frontier Risk Lane.