The ML workflow

Machine Learning · What learning from data means · 03 / 04 · Beginner · 5 min

Collect, explore, engineer features, split, train, evaluate, tune, deploy, monitor — and why the real version of this loop is iterative, not a straight line.

Before thisTypes of learning

IBM Technology · 5 min

The ML workflow

The player loads from youtube-nocookie.com when you press play. Nothing reaches YouTube before that.

Taught by IBM TechnologyReport a problem with this video

What you'll learn

  • The workflow has recognisable stages — collect, explore, prepare, train, evaluate, tune, deploy, monitor — but real projects move backward through them constantly rather than following them once in order.
  • A model's work does not end at deployment; data drifts, the world changes, and a model that was accurate at launch degrades without anyone touching its code.
  • Most of a real project's time is spent on the data stages before training ever starts, not on the model itself.

The stages, named plainly

Collect the data the problem actually needs. Explore it before doing anything else, covered in its own lesson. Prepare it — cleaning, engineering features, scaling, splitting into training and test sets — which is the entire next group of this roadmap. Train a model on the prepared training data. Evaluate it honestly against data it has not seen. Tune whatever did not work well enough, and often return to an earlier stage entirely. Deploy the model somewhere it actually serves predictions. Monitor it, because deployment is not the finish line.

Naming the stages in order makes the workflow sound like a straight line. Real projects almost never move through it that way.

Why it loops instead of running straight through

A model that performs poorly during evaluation rarely means “try a different model” as the first response. Far more often it means returning to feature engineering, because the signal the model needs simply is not present in the current features — no amount of a more sophisticated model will recover information that was never captured from the raw data in the first place. Discovering a labelling error during evaluation sends you back to data cleaning. A surprising result during exploratory analysis sends you back to collection, because it reveals the data gathered does not actually represent the problem at hand. The workflow is better understood as a graph with backward edges than as a pipeline with one direction, and treating it as a strict sequence is a reliable way to waste time chasing model improvements that a data fix would have solved in a fraction of the effort.

What to watch for

The video’s framing is the single most important thing to take from this lesson: it presents the workflow as a full lifecycle including ongoing monitoring and eventual retraining or retirement, rather than stopping at deployment as though the job were then finished. That framing is exactly right, and it is the reason this is the pick over two other candidates that treat the pipeline more linearly.

It moves quickly past the early data stages, which is not a real gap here — exploratory analysis, cleaning, feature engineering and scaling each get their own full lesson immediately following this one.

Why deployment is not the finish line

A model is fit to a snapshot of the world at training time. The real world keeps moving: user behaviour shifts, a product changes, a market responds to something the model never saw during training. This is usually called data drift, and its consequence is blunt — a model’s accuracy can fall steadily after launch with nobody having touched a single line of its code, simply because the data it now sees no longer resembles the data it learned from.

Monitoring a deployed model for this kind of drift, and having a plan for retraining it on fresh data when drift is detected, is as much a part of the real workflow as the training step itself — which is exactly why “monitor” is a stage in the loop and not an afterthought tacked onto the end of it.

Where most of the time actually goes

A common surprise for anyone new to this field: the model-training step itself, which gets the most attention in courses and tutorials, is frequently the smallest fraction of a real project’s total time. Collecting, exploring and preparing data reliably consumes the majority of the effort, which is exactly why this roadmap devotes an entire group, preparing data a model can learn from, to that work before a single model gets trained on any of it.

Check yourself

  1. 01Why is the ML workflow drawn as a loop rather than a straight line?

    Because a problem discovered at any stage usually sends you back to an earlier one — a model performing badly in evaluation often means returning to feature engineering, not just trying a different model.

  2. 02What happens to a model's accuracy after it is deployed, if nothing else changes?

    It can still degrade, because the real-world data the model sees in production drifts away from the data it was trained on over time — a problem monitoring exists specifically to catch.

Go deeper

Notes

Private to you

Esc
↑↓ navigate↵ open? shortcuts

Keyboard shortcuts

Press Esc to close

Anywhere

⌘K
Search and commands
/
Search
?
This sheet
Esc
Close

Reading a lesson

J
Next lesson
K
Previous lesson
B
Bookmark