03 · How Models Learn
CAI
Constitutional AI
Anthropic's method: the model critiques and revises its own outputs against a written set of principles (a “constitution”), reducing reliance on human feedback for safety. Conceptually a flavour of RLAIF.
Concrete example
Rather than a person flagging a bad answer, the model checks its own reply against stated rules and rewrites it.