Glossary
Pretraining
The first, large-scale stage of training, in which a model learns general patterns from broad data before any task-specific tuning. Pretraining consumes the bulk of a training corpus.
Glossary
The first, large-scale stage of training, in which a model learns general patterns from broad data before any task-specific tuning. Pretraining consumes the bulk of a training corpus.