Engine preview

Beginner · Roadmap · 10 lessons · 3 groups · Preview

A ten-node roadmap that exercises the graph, the path, progress, bookmarks and timestamped notes end to end. The structure is ours; the videos are well-known public explainers rather than picks from the Phase 4 sourcing protocol.

This roadmap is a preview, not a finished one.

It exists so the roadmap engine — the graph, the path, progress, bookmarks and timestamped notes — can be built and reviewed against real content. The structure is ours and the videos are well-known public explainers, but they have not been through the sourcing and review protocol a shipped roadmap goes through. So it sits apart from the catalog, and search engines are told not to index it.

The formula library is finished and live; the catalog says which roadmaps are queued.

0%

Not started

Nothing saved yet. Progress is kept in this browser until you sign in.

Start the path

The maths underneath

4 lessons

  1. 01 / 04VectorsWhat a vector is from three directions at once — a list of numbers, an arrow in space, and a thing you can add and scale.10 min
  2. 02 / 04Dot productsTwo vectors in, one number out — and why that number keeps appearing wherever similarity or projection is being measured.14 min
  3. 03 / 04Matrix multiplicationMatrices as transformations, and multiplication as doing one transformation after another.10 min
  4. 04 / 04DerivativesThe derivative as a rate of change you can see, and the chain rule as the reason deep networks are trainable at all.17 min

How a network learns

4 lessons

  1. 01 / 04What is a neural network?Layers, weights, biases and activations — the whole forward pass, drawn on one handwritten digit.19 min
  2. 02 / 04Gradient descentThe cost function, the gradient as the direction of steepest ascent, and learning as repeatedly stepping the other way.21 min
  3. 03 / 04BackpropagationHow a single training example votes on every weight in the network, and why the votes are averaged rather than applied.13 min
  4. 04 / 04Backpropagation calculusThe same algorithm in symbols — partial derivatives, the chain rule, and where each term in the expression comes from.10 min

Transformers

2 lessons

  1. 01 / 02What is a transformer?Embeddings, the residual stream, and the shape of the computation that turns a prompt into a next-token distribution.27 min
  2. 02 / 02AttentionQueries, keys and values, scaled dot-product attention, and why dividing by the square root of the dimension is not cosmetic.26 min
Esc
↑↓ navigate↵ open? shortcuts

Keyboard shortcuts

Press Esc to close

Anywhere

⌘K
Search and commands
/
Search
?
This sheet
Esc
Close

Reading a lesson

J
Next lesson
K
Previous lesson
B
Bookmark