Skip to content

Why GPUs Won

Parallelism vs Sequential

9 min+85 XPStep 1/10

Two answers to 'go faster'

A CPU is built for latency: a handful of heavyweight cores, each loaded with branch predictors, out-of-order engines, and huge caches — all to finish one complicated instruction stream as fast as physics allows. A modern flagship has tens of cores.

A GPU made the opposite bet. It packs over ten thousand tiny cores into the same silicon budget — each one slow and dumb, but all of them running at once. Raw throughput over per-thread cleverness.

analogy

A CPU is one world-class mathematician solving proofs. A GPU is a stadium of students doing long division in lockstep. For grading a million exam papers, you want the stadium.