Core Theoretical Milestones in LLM Development
Neural Language Models
2003
Word Embeddings
2013
Transformer Architecture
2017
Pretraining + Fine-tuning
2018
ChatGPT
2022
RLHF
2023
2000
2010
2015
2020
2025
For economics students: Note how key theoretical innovations built upon each other over 20+ years