Skip to content

Calculus for ML

Derivatives: The Slope at a Point

7 min+65 XPStep 1/11

Calculus asks one humble question

Forget every intimidating symbol: a derivative answers one modest question — if I nudge the input a tiny bit, how much does the output move?

On a curve, that's just the slope at a point: how steep the ground is exactly where you stand. Steep uphill → big positive derivative. Flat → zero. Downhill → negative. The entire subject is 'measure local steepness,' plus centuries of clever consequences.

Why ML cares: training means wiggling a knob (a weight) and asking how the loss responds. The derivative is that response — 'increase this weight a hair, and the loss moves this much.'

analogy

A derivative is a speedometer, not a map. It doesn't tell you where the valley is — only how fast you're climbing or descending right now.