Matrix multiplication

Engine preview · The maths underneath · 03 / 04 · Beginner · 10 min

Matrices as transformations, and multiplication as doing one transformation after another.

Before thisVectorsDot products

This lesson is part of a preview roadmap.

The engine around it is real — progress, notes and bookmarks all work — but the video has not been through the sourcing and review protocol a shipped lesson goes through. See the roadmap for what that means.

3Blue1Brown · 10 min

Matrix multiplication

The player loads from youtube-nocookie.com when you press play. Nothing reaches YouTube before that.

Taught by 3Blue1BrownReport a problem with this video

What you'll learn

  • A matrix is a transformation written down — its columns are where the basis vectors land.
  • Multiplying matrices composes transformations, which is why the order cannot be swapped.
  • The row-times-column rule is a consequence of composition, not the definition worth remembering.

From a rule to a reason

Most people meet matrix multiplication as a rule about rows and columns, which is memorable and explains nothing. The geometric reading — a matrix is a transformation of space, and a product is one transformation followed by another — turns the rule into something you can predict rather than recall.

What to watch for

Watch the moment the video derives the arithmetic from the geometry. Once you have seen that the entry at row i, column j is forced by where the basis vectors go, the rule stops being arbitrary. The non-commutativity falls out of the same picture for free.

Where this sits

This is the last node before the network itself. A forward pass is a stack of these transformations with a nonlinearity wedged between each pair, and the reason the nonlinearity has to be there is that without it the whole stack collapses back into one matrix.

Check yourself

  1. 01Why is AB generally not BA?

    Because composition is ordered. Rotating then stretching lands somewhere different from stretching then rotating, and the matrices record exactly that.

  2. 02What do the columns of a matrix tell you at a glance?

    Where each basis vector ends up after the transformation. Reading the columns is usually faster than computing anything.

Go deeper

The maths underneath

Notes

Private to you

Esc
↑↓ navigate↵ open? shortcuts

Keyboard shortcuts

Press Esc to close

Anywhere

⌘K
Search and commands
/
Search
?
This sheet
Esc
Close

Reading a lesson

J
Next lesson
K
Previous lesson
B
Bookmark