Skip to content
Truth Academy.
Truth Academy
← Data Science & Statistics

Specializations · 16 min

When models memorize: machine learning and overfitting

A model that's perfect on the data it learned from can be useless on tomorrow's data. Machine learning is mostly the art of avoiding that.

Predict first

Two models predict house prices. Model A is a straight line. Model B is a wiggly curve that passes through every training point exactly. On new houses, which will usually do better?

Two models predict house prices. Model A is a straight line. Model B is a wiggly curve that passes through every training point exactly. On new houses, which will usually do better?

Concepts: Regression and prediction · Sampling and bias