Insight · Leadership

The number that moved: measuring AI honestly

Vanity metrics make AI look busy. Here is how to measure whether it actually earned its keep, with the one number that matters.

The number that moved: measuring AI honestly

AI can look busy without proving anything. The only way to tell the difference is a number you choose before you start and check honestly after.

Most AI activity produces a warm feeling and little else. Dashboards fill up. People say it is helping. Then someone asks what it actually earned this quarter, and the room goes quiet. The fix is not more enthusiasm. It is deciding, before a line of work begins, the one number you want to move and writing down where it stands today.

Vanity metrics make AI look busy

Messages sent, drafts generated, questions answered: these count activity, not value. A tool can run all day and change nothing about your costs, your revenue, or your time. Busy is not the same as better. A dashboard can glow with usage while the business itself feels exactly the same at month end.

The trap is that activity is easy to show and value is not. So we show the activity and quietly hope it stands in for the rest. It never does. Measuring busy is simply how a business fools itself with its own numbers.

Choose a number that actually counts

  • Hours saved. Pick the task, time it now, time it after. Real hours off the clock, not a vague sense of relief.
  • Conversion. More enquiries turning into paying customers, measured honestly against the quarter before.
  • Cost removed. A spend that genuinely disappears, not one that quietly reappears somewhere else on the sheet.
  • Response time. How long a customer waits before a real answer reaches them, start to finish.

Check it honestly, not hopefully

After the build, go back to the number and the baseline you wrote down. Did it move, by how much, and would it have moved anyway without the AI? These questions are uncomfortable, and that is the point. If the result is thin, you found out cheaply and early. If it is strong, you now hold proof instead of a story.

Theatre feels good in the meeting and costs you later. Honest measurement does the opposite: it stings a little now and pays for years, because it tells you exactly what to build next and what to leave well alone.

The short version

Choose the number. Mark the baseline. Check it without flinching. That one habit turns AI from something that looks impressive into something that quietly pays its way. Book a diagnosis to find the single number worth moving first.

All insights

Ready to turn this into something running?

A short diagnosis shows you where AI pays back first, and what it is worth.