07 · Measuring Models

BLEU / ROUGE

Translation / summarization metrics

Older metrics for translation (BLEU) and summarization (ROUGE) quality, based on overlap with reference text. Still seen, though they correlate imperfectly with human judgment.

Concrete example

Used to auto-score a translation against a human reference, without a person reading it.