Measuring What Matters: Navigating the KPI Labyrinth in an Era of Information Overload
Issue 215, June 5, 2025
Let’s get to the bottom line up front: In a business environment drowning in data, the organizations that will thrive are those that master the art of strategic data curation instead of collection, asking “why” before “what,” and building KPI ecosystems that connect rather than isolate.
Last week we offered advice and some philosophical thought about leading and managing in today’s whiplash marketplace. We put forward the idea that steering an organization today requires a shift from reacting to proactively adapting. Navigating an organization under such external pressures includes focusing on changing customer needs, preferences and behaviors, attempting to anticipate future trends and then evolving business models in the throes of disruption.
Mastering these skills requires understanding how to measure what matters: How to determine what data has value, what data collection represents true insights, and how to understand the difference between outputs and outcomes.
The Measurement Paradox
We live in a paradox of our own making. We’ve created measurement systems so sophisticated they can track the micro-movements of customer behavior across more than seventeen touchpoints, report every staff input into a system, track down to the last financial action and then correlate all this data to prior days, months, quarters and years. Yet we still find ourselves asking the most fundamental question: Are we measuring what actually matters?
Here’s the uncomfortable truth that keeps executives awake at 3:00 in the morning: The metrics that got you to here won’t get you there. And in our data-drunk culture, where every interaction generates a measurement opportunity, we’ve confused activity with progress, outputs with outcomes, and noise with key signals.
The I3 Problem: Incessant Incoming Information
Consider the landscape leaders navigate today. Trade policies reverse within a 24-hour news cycle. Supply chains snap overnight. Consumer confidence becomes as volatile as cryptocurrency prices. In this whiplash environment, traditional KPIs—those monthly P&L reports benchmarked against last year’s forecasts—aren’t inadequate. In fact, they’re dangerous.
The most vulnerable organizations are those still measuring themselves with outdated KPIs against a market that is dynamically changing, sometimes within hours, or making decisions with dated knowledge about a world that no longer exists. They’re using Industrial Age metrics to compete in a Digital Age reality. They think they are on top of the trends but are victims of creating what we call “dashboard hypnosis”—endless analysis of irrelevant data while meaningful change remains perpetually out of reach.
The critical question isn’t whether you have enough data to guide transformation. It’s whether you have enough wisdom to know which data matters for the change, transformation or adaptation you’re trying to create and instill to navigate forward.
Four Questions That Change Everything
Before diving into new measurement frameworks, every organization must confront the hardest question—the one that’s almost never asked but always matters most: Is what we’re measuring actually important?
This inquiry triggers four questions that separate meaningful metrics from measurement theater:
What is the purpose of this measure? If the answer sounds like corporate speak or exists “because we’ve always done it,” you’ve identified measurement irrelevance.
What will this measure inform? If it doesn’t directly influence decision-making or resource allocation, it’s performance art, not performance management.
How does this measure connect to other measures? Siloed metrics create siloed thinking. True performance emerges from interconnected measurement ecosystems.
Is this measure still relevant? The half-life of business relevance has compressed dramatically. Yesterday’s critical metric may be tomorrow’s distraction.
Rewriting the Rules: A Framework for Modern Measurement
Drawing from our work with organizations navigating change and transformation in unpredictable markets, we’ve identified new operational principles that separate adaptive organizations from those trapped in measurement quicksand.
Curate Data, Don’t Collect It
The distinction between data collection and strategic data curation has become a survival skill. When information overload breeds analysis paralysis, organizations get caught in what we observe as “data hoarding”—accumulating data and resulting metrics like digital packrats while missing actionable insights. Strategic curation demands ruthless prioritization. It means saying no to interesting data that doesn’t serve your change and transformation goals. It requires the discipline not to ask, “Can we measure this?” But rather ask, “Should we measure this?” Most importantly, “Will measuring this help us become who we need and want to be?”
Control the Narrative, Don’t Let It Control You
In our hyperconnected information economy, those who control the story control the truth. Organizations that wait for others to interpret their performance data—whether customers, competitors, or industry analysts—surrender their strategic authority. Proactive narrative control requires anticipating interpretation. It means contextualizing your metrics before others contextualize them for you. When quarterly results miss projections, leading organizations already have the story of why, what it means, and how it connects to their longer-term transformation goals.
Anticipate the Future, Don’t React to It
Foresight isn’t clairvoyance, it is disciplined pattern recognition combined with scenario planning. Organizations skilled at anticipation develop metrics that function as early warning systems rather than post-mortem reports. This requires measuring leading indicators, not just lagging ones. Customer satisfaction scores tell you what happened. Customer engagement patterns predict what’s coming. Employee retention rates report the past. Employee sentiment trajectories forecast your future talent challenges.
Master Technology, Don’t Surrender to It
The seductive promise of AI-powered analytics creates a new organizational vulnerability: algorithmic abdication. When machine learning algorithms become the primary interpreters of organizational performance, the question becomes critical: Who programmed the programmer? Data interpretation is fundamentally subjective. The same dataset can support dramatically different conclusions depending on the lens applied. We can say data is objective, but humans and their interpretation of data come with bias and subjectivity. We have long promoted that any question can influence a dataset. The answer may be very wrong, but it’s an answer we wanted. What is often missing is critical thinking, the stepping back objectively to ask: What is wrong with this answer? Organizations that maintain human agency in data interpretation preserve their strategic autonomy. Those who don’t become slaves to their own tools.
Solve Systemically, Not in Silos
Traditional KPI models create departmental fiefdoms where marketing celebrates engagement metrics and sales mourn over conversion rates. Neither department recognizes they’re measuring different stages of the same customer journey. Silo thinking means sales is happy with their output, marketing is happy with monthly email opens, and finance is happy with the quantity of invoices processed. Silo after silo is focused on output without strategic system-wide meaning. We focus on accomplishment, completing the task, without questioning whether the tasks matter. Systemic measurement requires connected intelligence. It demands KPI matrices that span departments, divisions, and business lines. True performance clarity emerges when individual metrics combine to create organizational intelligence that is greater than the sum of its parts.
Put Customers Center Stage, Not in the Wings
Customer loyalty remains the miracle metric that transcends all others. It extends lifetime value, creates revenue predictability, and transforms customers into brand evangelists. Yet most organizations measure loyalty through their own lens rather than by the experiences of their customers. A positive net promoter score is the magic any organization needs for sustainability and yes, growth. Because loyalty is so powerful yet so elusive, executives often turn to all kinds of utilitarian measures to represent what they have found as the truth. Most organizations measure loyalty inappropriately and often with substantial bias. Not surprisingly, these measures typically shine the best light on the organization’s or more accurately, the chief executive’s performance. Organizations need to understand each customer and what has brought her or him to the door and then return. And how do you do this? You ask the right questions, establish KPIs that are shared across all departments, divisions and sections in your organization and rely on individual and team-based evaluations to make sure everyone is on the same page and measuring what really matters. Authentic loyalty measurement also requires uncomfortable honesty. It means asking customers what matters to them rather than confirming what matters to you. It requires metrics shared across every department and evaluated by teams committed to truth over vanity or guesswork.
Focus on Outcomes, Not Outputs
The human tendency to measure effort rather than impact creates impressive activity reports that mask mediocre results. Producing 50 events annually sounds impressive until you measure their actual influence on customer behavior and business outcomes. Output metrics stroke egos. Outcome metrics drive growth. The quality, sustainability, and customer impact of your work matter infinitely more than its volume.
Honor Human Intelligence, Don’t Reward Strategic Theater
The most sophisticated measurement systems fail when they’re implemented in cultures that punish truth-telling. KPIs become meaningful only when employees feel empowered to challenge assumptions, question methodologies, and champion improvements. Creating psychological safety for honest measurement requires leadership courage. It means rewarding the employee who questions whether a metric still matters more than the one who delivers the most polished dashboard presentation. Need a refresher on creating an environment open to honesty and criticism, not pleasing others? Revisit our most popular article: Leading with Courage.
Follow Your North Star, Not Popular Trends
Measurement fads spread through business communities like viruses. Today’s hot metric becomes tomorrow’s abandoned experiment when organizations chase industry benchmarks rather than their own strategic purpose. Sustainable measurement systems align with organizational values and operational behaviors. They reflect what you’re actually trying to become, not what industry media or academic papers suggest you should be measuring.
What Matters for the Second Half of 2025
As we navigate an environment in which traditional business assumptions crumble monthly, measurement systems must evolve from historical scorecards to transformation navigational tools. The most dangerous measurement trap is implementing metrics based on theoretical best practices unrelated to your specific business reality. When KPIs exist for measurement’s sake rather than creating valuable insights, you’re building a monument to irrelevance.
The clearest success indicator is when your measurement system generates more strategic questions than comfortable answers. Then you’re probably measuring what matters. The organizations that will thrive in our uncertain future are those that master the paradox of measuring more strategically and less broadly. They’ll curate insights rather than accumulate data. They’ll anticipate rather than react. And most importantly, they’ll remember that behind every meaningful metric is a human decision that either accelerates or impedes their transformation journey.
The ultimate measure of your KPI system is whether it makes your organization smarter about becoming what it needs to be. It is failing if it makes you busy confirming who you’ve always been.
For more exploration of how organizations navigate change and transformation in our digitally disrupted marketplace and more insights on building adaptive organizational capabilities, explore our Ideas and Innovations newsletter archive or get a copy of our guide, “The Truth About Transformation.”
Explore this issue and all 214 past issues>
Get “The Truth about Transformation”
The 2040 construct to change and transformation. What’s the biggest reason organizations fail? They don’t honor, respect, and acknowledge the human factor.
We have compiled a playbook for organizations of all sizes to consider all the elements that comprise change and we have included some provocative case studies that illustrate how transformation can quickly derail.
Now available in paperback.