Lesson60 seconds
What is Pretraining?
The huge first training stage that teaches general language skill.
Step 1 of 9
Simple Definition
Pretraining is large-scale self-supervised training on broad data that produces a base model before or .
Explanation level
Tap a persona to hear the same idea in a totally different voice.
Try “Like I'm 5™” for a picture-book version - not the grown-up wording above.
Notebook
Your notes
Notes save automatically on this device
Knowledge graph
Done Here Next