Chapter 1 · Part 1

Three ways to learn

"Supervised," "unsupervised," "reinforcement" — three intimidating words that get thrown around constantly, usually without anyone explaining what actually separates them. Here's the good news: the difference comes down to one simple questionwhat kind of feedback does the learner get? Get that, and the whole map clicks into place.

Everything in machine learning is a system trying to improve at a task. What makes the three paradigms different is what tells it whether it's doing well.

Scroll to see the one thing that sets them apart.

Supervised: every example comes with the correct answer, like flashcards with the answers on the back.

scroll

The feedback is the whole story

Three everyday analogies capture it:

  • Supervised is studying with flashcards: each card has a question and the right answer. You practice until your guesses match the answers, then face new cards. The feedback is a label — the correct output for every example.
  • Unsupervised is tidying a junk drawer nobody has sorted. No one tells you the categories; you just notice that these things go together and those don't. The feedback is… none. You work from the structure of the stuff itself.
  • Reinforcement is learning a video game with no manual. You press buttons, and all you get back is the score going up or down. The feedback is a reward — delayed, sparse, and about outcomes rather than individual right answers.

Why the distinction matters

Picking the wrong paradigm dooms a project before it starts. No labels? Supervised learning is off the table. Need a system that acts and improves over time, not just predicts once? That's reinforcement's turf. Just want to understand a big messy dataset? Unsupervised. Knowing which is which is the first real skill in machine learning.

Over the next three chapters we'll take each one in turn — starting with the most common and most intuitive: supervised learning, where the machine learns from worked answers.