All writing

Numbers don't lie, but they don't explain either

A clear chart, a confident wrong answer, and the one question that stopped us from punishing our unhappiest customers.

The chart was clear. Customers who called our support line often were far more likely to leave us within a few months.

In the meeting, someone had a quick answer. "So support calls are making people unhappy. Let's push more customers to the help center and cut the number of calls."

Heads nodded. It was data, after all.

I asked one question: "Why were they calling in the first place?"

We pulled a sample of the calls. Late deliveries. Wrong sizes. Refunds that took weeks. These customers weren't unhappy because they called us. They called us because they were already unhappy.

Making them harder to reach would have hidden the problem, not fixed it. And it would have made the people who were already upset even angrier.

Ice cream doesn't drown people

There's an old classic in statistics classes. Ice cream sales and drowning accidents rise and fall together. Does ice cream make people drown? Of course not. Summer drives both. More people buy ice cream, and more people go swimming.

It sounds silly when it's ice cream. It sounds very convincing when it's your own dashboard.

That's the trap. Two numbers moving together tell you what is happening. They don't tell you why. The "why" is where every good decision lives, and it's the part a chart can't give you.

The data was honest. Our first reading of it wasn't.

Before you act on a chart

A few questions I've learned to ask every time:

  • What else could explain this? Look for the "summer" hiding behind both numbers.
  • Which came first? Did the calls cause the leaving, or did the problem cause both?
  • Can I talk to one real person? Five real conversations will often teach you more than five thousand rows.
  • Can we test it small? Change one thing for a few customers and watch what happens before betting on it.

None of this needs a statistics degree. It needs curiosity, and a little humility about how sure we feel.

Be the one who asks why

Data is one of the best tools we have. With AI, anyone can now pull a chart in seconds and get a confident summary to go with it. That makes good questions more valuable, not less.

So use the numbers. Trust them. Just don't let them think for you.

The most useful person in the room is rarely the one with the biggest dashboard. It's the one who asks "but why?" before everyone else starts building the wrong fix.

Keep reading

More from the notebook.

Building3 min read

Praying to the servers

An index that froze the orders table, a shrine for praying while we waited, and why the best server prayer is the one nobody has to say.

Reflections3 min read

The age of personal software

In school, I built a tiny exam schedule app that almost every student on campus used for a couple of days. Then life got busy. Now AI is giving builders their weekends back.