Glossary
Preference data
Model outputs annotated with human judgments of which response is better, gathered as pairs or rankings. The raw material for alignment methods such as RLHF.
Glossary
Model outputs annotated with human judgments of which response is better, gathered as pairs or rankings. The raw material for alignment methods such as RLHF.