What Gets Measured Gets Managed, But Not Always Improved

We were brought in to work with an organization after their HR vice president did something that takes more courage than most leaders give it credit for. She looked at her engagement data and said, “Something is off. The numbers aren’t telling me what I’m actually seeing.” She couldn’t point to a specific metric that was alarming. The scores were acceptable. But her instinct told her the data wasn’t capturing the full picture, and she trusted that instinct enough to ask for a deeper look. We did a deeper dive, including an assessment of the leadership team.

What the assessment revealed wasn’t in any of the survey results. A senior leader was not held accountable, and the impact of that failure was quietly and steadily filtering down through the organization. People were watching. They were drawing conclusions about what the culture actually valued versus what it claimed to value. And the ones with the most options, the senior performers, the people the organization could least afford to lose, were leaving. By the time we got there, the turnover among senior leaders had already done significant damage. The metrics had missed it entirely.

This is the gap that lies between measurement and understanding. It is not that the data was wrong. It is that the data was incomplete, and the assumption that a satisfactory score meant a healthy culture had allowed a serious problem to go unexamined for too long.

Engagement scores go up, and the assumption is that engagement improved. Turnover drops, and the assumption is that retention is working. Survey results come back acceptable, and the assumption is that nothing urgent needs attention. It comes back to you get what you measure. Metrics rarely tell you why, and they almost never tell you what is building underneath the surface that hasn’t shown up in the numbers yet.

The organizations we see struggle most with this are not the ones ignoring their data. They are the ones who over-rely on it and put a lot of faith in the instrument. They have confused measuring engagement with building it. As we have written before [link to When Engagement Surveys Fail], the survey is only as valuable as what you do with the results. But there is a step before that one that matters just as much: making sure you are asking the right questions in the first place, and staying curious enough to look beyond the score when something feels off.

The HR vice president in our story did exactly that. She didn’t dismiss the data, but she didn’t stop there either. She used it as a starting point rather than a final verdict, and that distinction made all the difference.

Metrics are most useful when leaders treat them as the beginning of a conversation, not the end of one. A number that confirms something is wrong without telling you what or why is an invitation to dig deeper, not a reason to close the file. The leaders who build genuinely healthy cultures are the ones who stay curious after the data comes in, who are willing to ask harder questions, and who understand that the most important things happening inside an organization often don’t show up on a dashboard.

How to use your metrics as a starting point, not a finish line.

Trust your instincts when they conflict with your data. If your scores look acceptable but something feels off, that feeling is worth taking seriously. In our experience, leaders and HR professionals who sense a disconnect between the data and the reality are usually right. The metric may not be capturing what matters most. A deeper assessment, through one-on-one conversations, focus groups, or a more comprehensive survey, often surfaces the real issue.

Look for what the metric can’t measure. Engagement scores capture sentiment at a point in time. They don’t capture the quality of accountability, the health of senior-level relationships, or the extent to which people believe the culture lives up to its stated values. Build in regular opportunities to gather qualitative insight alongside your quantitative data. The combination is far more useful than either one alone.

Follow the turnover, especially at the senior level. When high performers and senior leaders leave, they rarely do so without a reason. Exit interviews capture some of it, but not all. If you are seeing patterns in who is leaving, treat them as a signal worth investigating before the next departure.

Hold the standard at every level. The accountability issue in our opening story wasn’t invisible. People inside the organization knew it was happening. What they were watching for was whether leadership would address it. When a senior leader is allowed to operate below the standard, the message it sends travels fast and travels far. As we have explored in our work on trust [link to Trust Is Built Through Patterns Not Moments], culture is defined not by what leaders say they value, but by what they are willing to tolerate.

The HR vice president who trusted her instincts over her dashboard did her organization a significant service. She understood something that the most effective leaders we work with have learned over time: the number is not the answer. It is the question.

What your metrics are telling you matters. What they are not telling you matters more.

Dusty Tockstein is a senior consultant at Peter Barron Stark Companies. Dusty works with clients to improve their corporate culture through a variety of tools, including Employee Engagement Surveys, 360 Leadership Development Assessments, Leadership Coaching, and Organizational Assessments.