<img height="1" width="1" style="display:none" src="https://www.facebook.com/tr?id=749646578535459&amp;ev=PageView&amp;noscript=1">

When Your Metric Is Hiding Your Improvement

Posted by Jeff Roussel

Find me on:

Jun 2, 2026 6:00:00 AM

A patient arrives in the emergency department with stroke symptoms. The clock starts. Somewhere between that arrival and the moment the right medication is injected, a window is closing on the patient's brain and potential recovery. The national standard says that window should close in under 60 minutes -- door to needle, as the metric is known.

Most hospitals report compliance with this standard. The number you'll see in a quality dashboard is the percentage of cases that came in under 60 minutes. Eighty-two percent. Ninety-one percent. Some target gets set. Improvement teams work toward it. The line on the chart moves up.

That metric is hiding most of what matters.

By Definition, 59 Minutes Is Fine 

Simon De Castro, a Lean Six Sigma Black Belt at Texas Health Resources, named this pattern in a KaiNexus webinar on DMAIC pitfalls. He put the problem plainly: by definition, the compliance metric tells us that 59 minutes is fine. If it's your family member in that bed, 59 minutes is not fine. It's certainly not ideal or optimal. Five minutes feels too long. The metric and the lived experience of waiting are not pointed at the same thing.

Two Hospitals, One Dashboard

The math is worse than that, though. Imagine a hospital where the average door-to-needle time is 58 minutes and compliance with the under-60 standard is 78 percent. An improvement team works on the process for six months. The new average is 32 minutes. Compliance is now 96 percent. Real progress. Worth celebrating.

Now imagine a second hospital. Same starting point: 58-minute average, 78 percent compliance. Their improvement team also works for six months. New average: 55 minutes. Compliance: 94 percent.

On the dashboard, those two hospitals look almost identical. They're both above 90 percent. They both improved by double-digit percentage points. The narrative writes itself. Both teams did good work, but the second one did slightly less good work.

In the actual world, the first hospital cut the average wait by 26 minutes. The second cut it by 3. The improvement work was wildly different, and the metric chose to hide that difference.

The Reporting Metric Is Not the Improvement Metric

This isn't a story about flawed measurement systems being someone else's problem. It's a story about a pattern that runs through almost every organization that tracks KPIs. The reporting metric and the improvement metric are not the same thing, and most teams don't make the distinction explicit.

The Fix Is Structural, Not Technical

The fix is structural, not technical. Keep reporting the percentage of compliance externally if that's what regulators or accreditors require. Internally, measure and act on the actual times. Break them down by step: door to triage, triage to imaging, imaging to read, read to medication. Each segment has its own variation, its own root causes, its own opportunities. When you measure them, you can improve them. When you collapse them all into a single yes-or-no against a threshold, you can't.

The Same Trap in Patient Satisfaction

The same pattern shows up in patient satisfaction. A common reporting standard is the percentage of patients who rate their experience a 9 or 10 -- the "top box" score. An organization that moves its average from 6.2 to 8.4 has done significant work. The top-box percentage may have barely moved. Patients are noticeably more satisfied. The metric refuses to say so.

What Would Change If You Measured the Actual Thing?

Simon's framing is the cleanest version of this principle I've heard: measure what you value, don't just value what you measure. The KPI on the dashboard is not a sacred object. It was chosen by someone, often for reasons that had more to do with what was easy to count than what was important to know. You can choose better metrics for your improvement work even while continuing to report the required ones externally. That's not bypassing the system. That's understanding what the system is actually telling you, and supplementing it with the data you need to do your job.

The deeper question for any leader looking at a dashboard right now: what would change in our improvement work if we measured the actual thing instead of compliance with a threshold? For many organizations, the honest answer is that we'd see opportunities we've been missing for years, hiding in the space between 5 minutes and 59.


For the full webinar on DMAIC pitfalls, including the 5 Whys mistakes that produce shallow root causes and the sponsor dynamics that derail projects, watch the recording on the KaiNexus webinar library.

Topics: Six Sigma, Healthcare, Continuous Improvement Metrics

Recent Posts