Skip to content
AI for Business & Product

Leading AI Initiatives

Measuring ROI Honestly

7 min+65 XPStep 1/10

The counterfactual is the whole game

'AI saved 10,000 hours' means nothing until you ask: compared to what, and what did the hours become? Honest ROI is value_of_change − all_in_cost, where the change is measured against the counterfactual — what would have happened anyway.

Support volume grew 30% while headcount stayed flat? The deflection the AI absorbed is real money. 'Agents saved two hours a week' but output per agent didn't move? That's a comfort feature — a fine thing to buy, a bad thing to call savings.

insight

The honest test: did a budget line move — headcount deferred, contractors cut, revenue added, churn reduced? If the only evidence is a survey saying people 'feel' faster, you have vibes, not ROI.