Unit 7: Generative models and reinforcement learning

Models that create new data, and models that learn by trial and error. These ideas power image generators, and the reinforcement learning behind RLHF.

The big picture

Every model so far learned to predict a label. Generative models learn what the data itself looks like, so they can make new examples. Reinforcement learning has no labels at all, only rewards, so the model must discover good actions by trying.

Lessons in this unit