03 · How Models Learn
RLAIF
Reinforcement Learning from AI Feedback
Same idea as RLHF, but an AI provides the preference judgments instead of (or alongside) humans — scaling cheaper and faster.
Concrete example
A capable model rates thousands of answers overnight, work that would take human raters weeks.