In a rapidly changing business climate, allocating resources and budgets are closely tied to a department’s ability to get short-term results.
If you are a vice president, director or team leader for a product management function, one of the biggest challenges you face today is demonstrating the team is making a significant contribution to top-line or bottom-line targets. The pressure on budgets and resources from executives has forced a tighter link between current investments and near-term results.
If you can’t measure your team’s effectiveness, or if you are focused on the wrong metrics, your headcount and budget allocation could be at risk.
In the 2008 best-selling book, Tuned-In: Uncover the Opportunities That Lead to Business Breakthroughs by Craig Stull, Phil Myers and David Meerman Scott, the authors point out that many companies force employees to measure and track the wrong thing, which leads to out of synch or “tuned-out” behaviors.
The best way a product management team can establish its value to the corporation is by using a reliable set of outcome-oriented measurements that demonstrate both performance of the product(s) and the effectiveness of the role.
The stakes are high! A product management function that demonstrates a direct contribution to the company’s income statement and uses objective measurements to gauge its effectiveness and value to the company will have more influence in shaping the product strategy and the roadmap.
Success in building high-performance teams begins with using measurements that give visibility about the overall effectiveness and efficiency of the team. The key is finding the right measurements.
What are the best measurements to monitor the effectiveness of product management teams? What are the best practices for measuring the health of products? How do you demonstrate value and alignment with larger corporate goals?
Measurements and metrics
The use of measurements and metrics seems straightforward but deserves some discussion. These terms are often used interchangeably yet have very different applications. A more formal definition of “measurement” and “metric” gives us a common language to move forward.
Metric: A measuring system that quantifies a trend, dynamic, or characteristic. Metrics encourage objectivity. They make it possible to compare; they facilitate understanding. Think benchmarks, statistics and predictive indicators.
Measurement: A way of monitoring and tracking the progress of strategic objectives. Measurements can be leading indicators of performance or lagging indicators. Common measurements such as product revenue, profits, product margin and product adoption rate are often referred to as key performance indicators or KPI’s.
But what type of measurements should you use, and how can they be used to accurately express performance and ultimately give management the ability to predict results?
Three types of measurement are necessary to create reliable performance indicators: rearview, operational and activity-based–all key to developing an effective product management organization. But the degree to which a company adopts a measurement-driven approach to drive the business depends on the company culture.
Pragmatic Institute’s 2020-2021 Annual Product Management and Marketing Survey shows performance in classical financial measurements such as product revenue, product margin and profitability are most commonly used to determine the success of product management.
These measurements are “rearview” because they are lagging indicators, meaning they cannot drive the performance of people, processes or products. Product management teams that focus solely on these measurements usually struggle to establish clear value to the company’s goals.
Why do so many companies rely on rearview measurements to assess the effectiveness of product management? Because those measurements are easy to assign and consistent with the high-level focus of the executive.
These rearview measurements are the natural tools of top-down goal setting. It is common for CEO’s to push these MBO’s (management by objective) down to product management. There is value in using rearview measurements, primarily to identify historical profit leaks such as:
- Product revenue growth
- Cost of sales
- Product margin
Rearview or financial measurements are part of the common language for companies. Product management will be ultimately judged by the financial success of the product, but there are consequences with putting too much emphasis on these measurements.
- We learn too late what is working well and what is not
- Focus on rearview measurements can drive product managers to the wrong behavior
- Product managers are held accountable for outcomes they have little or no control in achieving
A solid understanding of the key financial indicators for products is important, but it’s not enough to ensure a successful product or an effective team.
Operational measurements are the “measurements behind the measurements.”
These are leading indicators for most organizations because they can drive and create outstanding financial results. Ideally, VPs and directors of product management interpret the company strategy and align with key financial measurements by emphasizing relevant operational measurements.
These can be the key ingredients of a high-performing product management team. Clear and relevant operational measurements enable better focus on the team and increase the probability of product and market breakthroughs. If we understand the relationship between specific operational measurement and the financial measurement, they bring more predictability to the company’s financial results.
Establishing and using operational measurements to evaluate the effectiveness of product management and the health of the product is critical, because it bridges the gap between company strategy and execution.
A company’s operational measurements are how high-level goals become grounded. They become “the vital few” for the product management team.
Relevant operational measurements include:
- Market sensing—knowledge of market problems among customers, evaluators and potentials
- Speed-to-market—putting the right product in the right market segment faster than a competitor
- Product adoption—driving the uptake rate in a market at a lower cost and shorter time than a competitor
- Product launch—improving the response rate from target buyers with fewer impressions
- Customer satisfaction—increasing the “willing to recommend” percentage of existing customers
A crucial step is translating the rearview or financial measurements into appropriate operational ones. The leader of the product management team must be fluent in both the financial and operational measurement paradigms.
|Operational Drive||Financial Outcome|
|Speed-to-market||Increase product revenue|
|Product adoption||Increase product margin|
|Product launch||Lower cost of sales|
Above, we see that linking these measurements gives the product management team more context and better insight into their contribution to the company goal.
It also gives product management leaders concrete and objective measurements to track interim results and key milestones.
As an example, speed-to-market is a metric that can be tracked in several ways. How fast did we reach the market with new product releases compared to last year? How many times did we beat the competition to market with comparable product releases? Where do we rank within our industry segment?
Over time, we learn what effect improving this measurement has on increasing revenue. Every team member should understand these relationships and how their projects and key activities affect the outcome of the operational drivers.
The next step in developing predictable measurements is linking activities, performance drivers and outcomes.
Activity-based measurements are the execution side of the measurements fulcrum. While operational measurements are leading indicators to financial results, activity-based measurements are the tactical tasks that lead to the desired operational outcome.
Using these allows team leaders to identify the crucial activities that drive the desired outcomes. Activity-based measurements reduce ambiguity and establish accountability for all team members.
Activity-based measurements that a product manager should be held accountable for are:
- Onsite market interviews
- Assessing the impact on customers for existing or future products
- Positioning to buyer personas
The table below illustrates how to close the gap between specific activities, operational drivers and financial results.
|Activity-Based Targets||Operational Driver||Financial Outcome|
|On-site interviews||Speed-to-market||Increase product revenue|
|Assessing impact to customer||Product Adoption||Increase product margin|
|Positioning to buyer personas||Product Launch||Lower cost of sales|
Properly conducted onsite interviews across the total addressable market enable the discovery of unmet needs or market problems.
Validation of these market problems through surveys demonstrates what percentage of the market has these problems and the value of solving them.
The data from these activities gives product managers the facts to define the next release and a high degree of confidence that the proposed solution is the right product for the right target segment. This product development approach is fast and more efficient.
Establishing strong links between activity-based and operational measurements may not be easy, but is critical in establishing the value of product management and building credibility within the organization. The key is to develop reasonable correlation and monitor the accuracy of these relationships over time.
Here is an example of how a team could establish strong links between activity-based measurements and operational outcomes.
The annual operational goal for the product management team is to improve speed-to-market by beating competitor A to the market. What activity-based measurements must the team leader assign to each product manager to ensure this goal is achieved by the end of the year?
- Conduct Strength, Weakness, Opportunity and Threat (SWOT) analysis against Competitor A
- Complete customer impact assessment of Competitor A’s products vs. ours
- On-site customer visits to validate Competitor A’s perceived product gaps
- Complete Market Requirements Document (MRD) with Competitor A as key theme
- Deliver 100% of something ahead of Competitor A
One caution to the team leader: Make sure the sum of these activities is greater than or equal to one or more of the team goals. This linking can provide the ability to benchmark and propose metrics that have predictive value.
The key to success with this approach is to continuously review data and trends to ensure the measurement remains relevant.
Best Practice Measurements
Most product management leaders would benefit from the ability to rigorously assess existing projects and new opportunities, identifying potential risks. This approach would guide investment and allow VP’s and directors to evaluate outcomes and reinvest to maximize contribution.
The enhanced visibility would enable product management leaders to defend resource allocation with measurements tightly linked to the company’s income statement.
As a leader of a product management team, what should you measure?
Initially two things: product performance and product management effectiveness.
These are different but equally critical dimensions of the product management process. Team leaders must monitor people, processes and market success for the product life cycle.
To be successful, all three must be continually assessed.
1. Must be relevant
The most important outcome from product management is financial results, but product management leaders must translate the financial results into performance drivers that lead to the income statement outcome. Until a clear linkage between actions and outcomes is established, the measurements are theoretical.
When setting targets for individual product managers, there are best practices to follow.
Look for connections between operational and activity-based measurements that may not seem obvious initially. Question your current assumptions about the business and what drives product performance.
2. Require transparency
Initiating a performance measurement program is a commitment to changing how a team operates. The most significant change is a commitment to complete transparency.
In some companies, product management has accountability for the operational goals, which are translated into product-specific objectives and measurements. The product management leaders must defend key measurements and performance at the product line level.
3. Must impact financial results
In a down economy, CEOs are pressured to emphasize near-term results and near-term execution that impact the income statement. Product management leaders must be aware of potential shifting priorities, and if your key measurements are trending poorly, early intervention is critical.
The team leader using this measurement system must have a dashboard view of products, projects, processes and people. This is the only way to focus on what matters most and to refine key measurements continuously. It also allows the team leader to take action based on insights gained or emerging trends.
However, the proper use of measurements must go beyond driving short-term financial results. The real potential is in changing how product management thinks about its role and value to the organization.
Ultimate Goal of Measurement
The long-term benefit of Product Management becoming measurement-driven is a higher team performance, improved predictability and increased credibility. The ultimate benefit is developing the ability to create outstanding products and market breakthroughs reliably.
This “holy grail” of product management performance is doable, but often many cultural and process gaps must be addressed first. An organization fosters a measurement-driven culture by reinforcing other aspects of the process, such as tightly coupling rewards, recognition, compensation and promotions operational results. Does yours?
Improve Your Data Skills with Pragmatic’s Insight Course
Are you looking to improve your product strategies and decisions with data? If so, our Insight course can help. The course teaches you how to identify patterns in your data and uncover problems to achieve better results.