Documente Academic
Documente Profesional
Documente Cultură
I N T E R N AT I O N A L
B E N C H M A R K I N G
C L E A R I N G H O U S E
Copyright 1999 American Productivity & Quality Center. Please see disclaimer.
Project Personnel
Project Team
Carmen Clarke, Neil Peltier
American Productivity & Quality Center
Information Services
Nancy Fleshman
American Productivity & Quality Center
Study Expertise
Arthur M. Schneiderman
Arthur M. Schneiderman Consulting
Rick Martin
Best Management Practices Consulting
Contributing Authors
Carmen Clarke, Neil Peltier, Arthur Schneiderman
Editors
Susan Elliott, Paige Leavitt
Designers
Connie Choate, Victoria Wirz
MEMBERSHIP INFORMATION
For information about how to become a member of the International Benchmarking Clearinghouse,
a service of the American Productivity & Quality Center (APQC), and receive publications and other
benefits, call 800-776-9676 or 713-681-4020 or visit our Web site at www.apqc.org.
COPYRIGHT
2000 American Productivity & Quality Center, 123 North Post Oak Lane, Third Floor, Houston, Texas
77024-7797. This report cannot be reproduced or transmitted in any form or by any means electronic
or mechanical, including photocopying, faxing, recording, or information storage and retrieval.
Additional copies of this report may be purchased from the APQC Order Department at
800-776-9676 (U.S.) or 713-681-4020. Quantity discounts are available.
ISBN 1-928593-30-5
STATEMENT OF PURPOSE
The purpose of publishing this report is to provide a reference point for and insight into the processes and
practices associated with certain issues. It should be used as an educational learning tool and is not a recipe
or step-by-step procedure to be copied or duplicated in any way. This report may not represent current organizational processes, policies, or practices because changes may have occurred since the completion of the study.
Measure What Matters: Aligning Performance Measures with Business Strategy 2000 APQC
Executive Summary
A birds-eye view of the study, presenting the key findings
discovered and the methodology used throughout the course
of the study. The findings are explored in detail in
following sections.
13
Participant Highlights
A comparsion of the sponsor and partner groups across
several dimensions.
19
Key Findings
An in-depth look at the nine key findings of this study.
The findings are supported by quantitative data and
qualitative examples of practices employed by the
partner organizations.
67
75
Measure What Matters: Aligning Performance Measures with Business Strategy 2000 APQC
Sponsor Organizations
Measure What Matters: Aligning Performance Measures with Business Strategy 2000 APQC
Partner Organizations
3M
The Boeing CompanyCommercial Airplane Customer Service
Organization
CaterpillarWheel Loader and Excavator Division
* City of Charlotte, North Carolina
GTEHuman Resources Organization
* Merrill Lynch Credit Corporation
Nortel NetworksCanadian Customer Service Division
* Solvay Polymers
* USAA
* Not site visited; represented in quantitative data only.
Measure What Matters: Aligning Performance Measures with Business Strategy 2000 APQC
Executive Summary
early 15 years ago, the unspeakable was finally spoken, and members of the
accounting profession began to acknowledge what was already well known to
operating managers: Traditional financial tools alone were inadequate for
prospectively managing contemporary organizations. This recognition was triggered
by the emerging popularity in the Western Hemisphere of Total Quality Management
and its dependence on nonfinancial measures, particularly in manufacturing.
Two threads emerged from this long-awaited awakening: activity-based costing
(ABC) and what eventually became known as the balanced scorecard. ABC represents
an attempt to more realistically link costs to the underlying realities of operating
processes and their usage of what economists call the factors of production: labor,
materials, capital, andmore recentlyknowledge. The balanced scorecard attempts
to integrate critical nonfinancial performance measures into the basic management
structure of the organization.
The balanced scorecard is a tool for quantitatively defining and managing the
most effective indicators of future strategic success. It can be used to rally organizational
effort around the few activities that are most vital to this success. It therefore is a
multifaceted tool that, in principle, can be used for communication, alignment,
improvement, and control.
To guide practitioners, the traditional balanced scorecard organizes measures into
four interrelated perspectives: financial, customer, internal, and learning and growth.
The theory behind it is that to achieve financial successthe ultimate purpose of the
organization, according to scorecard advocatesorganizations must satisfy their
customers. To satisfy their customers, they must optimize their internal value-creating
processes. To optimize these processes, organizations must learn and their employees
must grow in their individual capabilities. Although this has been the dominant
balanced scorecard structure during the 1990s, other logic paths have proved
increasingly useful for some organizations.
But as appealing and simple as it appears, implementation of the balanced scorecard has proved to be a challenge for most organizations. It is the quintessential example of the phrase Its simple, but not easy. Part of this difficulty is the scorecards reliance
on logical causal linkages to relate metrics to strategic objectives. This logic breaks
down if any link in the chain is weak or ill-defined. For example, some organizations
find that they have not effectively articulated their strategy in the first place, so they lack
Measure What Matters: Aligning Performance Measures with Business Strategy 2000 APQC
S U M M A R Y
the foundation needed for a compelling story. Others find that complexity masks the
real drivers of success so that the resulting scorecard metrics are unconvincing.
A third difficulty lies in the scorecards dependence on changing the organizational
culture. Measurement affects behavior, for better or worse. Changing measurements
from a one-dimensional emphasis on financial performance to a more balanced emphasis on an appropriate mix of financial and nonfinancial measures has significant cultural implications, ranging from changes in individual compensation and career
advancement to increased dependence on teamwork. So, like any other culture change
initiative, it brings with it a set of challenges to successful implementation.
It takes a strong and convincing agent to overcome an organizations inertia or
resistance to change. In most Western organizations, the person at the top must have
the final word on the scorecard contents and the achievement of its goals. However,
leadership takes on different forms in different organizations. If theres one area in
which top managers need to get their collective hands dirty, it is the balanced scorecard,
since they are the owners of the organizations strategy and they must ensure that the
result guide the entire organization in the chosen direction.
An organizations immune system ensures stability and resists wasteful, whimsical
changes. To break down this immune system, there must be a sense of urgency and a
convincing argument that the proposed solution will, in fact, mitigate the source of
that unwanted urgency. Internal success stories, resulting from pilot implementations and told by their champions, often provide that required proof. Systemization
of the new approach, training and education, and information support systems facilitate the approachs diffusion and maintenance throughout the organization. Reward
and recognition of successful proponents reinforce the desired change.
The best-practice partners observations reflect the challenges and concerns
associated with initiating the balanced scorecard and its set of associated performance
measurements. Of our three data sources survey results, site visit reports, and debrief
findings (discussed further in the methodology section of this executive summary)
the third provides a view of the best-practice organizations through the eyes of practitioners newly embarked on the journey. Immediately following each site visit, the
study team held a one- to two-hour debrief with the site visitors. We addressed the
observed major strengths and weaknesses and identified areas for potential follow-up
questions. We used a simplified form of KJ, or affinity diagram, analysis and voted to
prioritize our observations. A similar analysis, based on the collective conclusion from
the five site visits, revealed several interesting dichotomies.
For example, the greatest observed strength was sponsorship by a single senior
executive, usually the entity leader for the unit visited. On the other hand, it was
often unclear as to whether that sponsor was simply encouraging or really driving the
scorecards implementation. Also, to outsiders often not privy to confidential
information, the linkage between the scorecard measures and the business strategy
were sometimes unclear, except in the case where a structured matrix approach was used
that not only captured the causal relationship but also quantified its strength. At all sites
the study team visited, the scorecard implementation was limited to a particular
Measure What Matters: Aligning Performance Measures with Business Strategy 2000 APQC
S U M M A R Y
business unit or functiona good starting point, but a recognized obstacle to significant strategic impact.
Does all of this sound familiar? Every major change initiative in the past 50 years
has had the same basic agenda, though most organizations have fallen short of
completing theirs. However, the balanced scorecard provides the potential to unifiy the
organization around issues central to its survival. Those who are successful will win
leadership roles in the 21st century and transfer all of the associated benefits to their
stakeholders.
KEY FINDINGS
The key findings of this study were derived from primary research performed via
five site visits to best-practice organizations and detailed survey questionnaires completed
by 18 organizations. Based on the Measure What Matters benchmarking study scope,
findings are supported with data gathered from the 18 study participants (partners
and sponsors). The findings, which are organized into three sections, address the
following dimensions of our learnings:
designing the performance measurement system,
implementing and operating the performance measurement system, and
communicating and driving behaviors.
Section 1: Designing the Performance Measurement System
1. Best-practice organizations take a simple approach to ensure that the organization understands the link between performance measures and business strategy.
2. Even the most advanced users of performance measurement do not have a fully integrated scorecard in use throughout the organization.
3. Simple structures for the balanced scorecard will yield the most effective performance
measurement systems.
Section 2: Implementing and Operating the Performance Measurement System
Measure What Matters: Aligning Performance Measures with Business Strategy 2000 APQC
S U M M A R Y
METHODOLOGY
Benchmarking is the process of identifying, understanding, and adapting outstanding practices from organizations anywhere in the world to help an organization
improve its performance. Companies participating in benchmarking activities report
breakthrough improvements due to direct and indirect improvements in cost control,
quality, cycle time, and profits.
Recognized as first among a list of 10 leading benchmarking organizations models
by the European Center for Total Quality Management in 1995, the APQC consortium methodology, developed in 1993, serves as one of the premier methods for
successful benchmarking in the world.
The APQC project team conducted the Measure What Matters: Aligning
Performance Measures with Business Strategy benchmarking study using its
established benchmarking methodology, as described below.
Phase 1: Planning
A benchmarking team was formed in June 1999 consisting of the subject matter expert, study adviser, and representatives from APQC. This team
developed a project scope and the initial data collection tool to screen
potential best-practice companies.
The planning phase was concluded by conducting secondary research
to identify companies with notable processes in each of the key process
areas. Companies identified via secondary research, subject matter expert
suggestion, and sponsor organization nomination were contacted and
invited to complete a screening survey.
The results of the contact and screening process were presented to
study sponsors at the kickoff meeting on September 30, 1999. Based on
this information, sponsors chose the organizations they wanted to study
more in depth.
PLAN
ADAPT
COLLECT
ANALYZE
Phase 2: Collecting
The main objective of this phase was to focus on learning from best-practice partners by extracting rich, process-specific information concerning innovations in the
study focus areas. In August 1999 five of the partner organizations were invited to host
site visits during the study. Each accepted APQCs invitation and agreed to continue
the sharing process by hosting a four-hour site visit and completing the detailed
questionnaire. The other partners were asked to complete the detailed questionnaire
as well. During the site visits, key personnel were asked questions from the site visit
guide to share innovative and best-practice process information.
Phase 3: Analyzing and Reporting
In this phase, the APQC project team analyzed data collected from screening
surveys, detailed questionnaires, and site visits. The team identified critical success
factors and key enablers of outstanding performance measurement initiatives.
Measure What Matters: Aligning Performance Measures with Business Strategy 2000 APQC
S U M M A R Y
10
Measure What Matters: Aligning Performance Measures with Business Strategy 2000 APQC
Order Form
Yes! Ive read the executive summary and I want to order
this benchmarking Best-Practice Report.
1. O N L I N E
PUBLICATION TITLE
www.store.apqc.org
QUANTITY
MEMBER PRICE
$295
$495
free
free
free
800-776-9676
713-681-4020
outside the U.S.
TOTAL
3. FAX
SHIP TO:
713-681-1182
Full Name
4. E-MAIL
Title
bookstore@apqc.org
5. MAIL
American Productivity &
Quality Center
Attn: Publications
123 N. Post Oak Ln., 3rd Fl.
Houston, TX 77024
Company
City/State/Country
ZIP/PC
Phone
Fax
PAYMENT OPTIONS:
SUBTOTAL
(Available 9/27/00)
through APQCs
online bookstore
2. PHONE
RETAIL PRICE
MasterCard
Card Number
Authorized Signature
American Express
Discover
Expires
M E A S U R E W HAT M AT T E R S
Participant Highlights
Measure What Matters: Aligning Performance Measures with Business Strategy 2000 APQC
13
H I G H L I G H T S
Introduction
Sponsors
Chemicals
Partners
Solvay Polymers
Diversified foods
Manufacturing
Transportation
Consumer products
Eastman Kodak
Caterpillar
The Boeing Company
3M
Public service
Telecommunication
Nortel Networks
GTE
Utilities
14
Measure What Matters: Aligning Performance Measures with Business Strategy 2000 APQC
H I G H L I G H T S
50,00099,999 0
10,00049,999
1,0009,999
0
100999
0
Number of Organizations
Sponsors (n=8)
SCORECARD CREATIONS
Partners (n=8)
Minimum:
$83.7 Million
$50,000
Maximum:
$63 Billion
15
$500,000
Mean:
$9.17 Billion
$300,000
Measure What Matters: Aligning Performance Measures with Business Strategy 2000 APQC
15
H I G H L I G H T S
CHANGES TO THE SCORECARD
Completely
22%
44%
33%
Significantly
56%
45%
Slightly
0
20
40
60
80
100
Percentage
Sponsors (n=9)
Partners (n=9)
Figure 4
Changes in the
Performance Measurement
System in Past Two Years
56%
Categories of measures
33%
89%
Individual measures
67%
67%
78%
11%
33%
0
20
40
60
80
100
Percentage
Sponsors (n=9)
Partners (n=9)
Figure 5
16
Measure What Matters: Aligning Performance Measures with Business Strategy 2000 APQC
M E A S U R E W HAT M AT T E R S
Key Findings
21
37
55
Measure What Matters: Aligning Performance Measures with Business Strategy 2000 APQC
19
M E A S U R E W HAT M AT T E R S
Section One
Measure What Matters: Aligning Performance Measures with Business Strategy 2000 APQC
21
KEY FINDINGS
Introduction
alanced scorecard literature stresses the criticality of creating clear causal linkages between scorecard metrics and the organizations strategic objectives. This
exercise, however, is more easily described than done. If the objective is to provide a
compelling story to all employees, then that story should be equally compelling to a
knowledgeable outsider, since the vast majority of employees are usually nave about
their organizations value-creating process, strategy, and tactics.
Two factors confound the job of linking metrics to strategy: 1) the potential links
vary significantly in terms of their causal impact, and 2) it is difficult to uncover the
real drivers because they are often hidden by ever-increasing complexity. Many organizations are beginning to recognize the need to understand their system of interacting internal processes as an intermediate step in identifying the true drivers of
stakeholder satisfaction. They quickly recognize that these drivers reside throughout
the organization, not just within a business unit or a single organizational function, so
that real strategic impact requires corporatewide (both horizontal and vertical) scorecard deployment.
To deal with these issues, leading organizations are developing formal quantitative
processes for identifying their internal and external strategic levers. They recognize the
dynamic nature of this effort and the need for continuous refinement of their performance measurements and balanced scorecard.
The answer to one recurring issuethe optimum number of scorecard metrics
still remains elusive. Have too few, and some critical success factors will not receive the
required attention. Have too many, and the organizations management capacity is
quickly overwhelmed. A rule of thumb, based on other management analogies,
appears to be five to seven as the maximum number of scorecard metrics that an
individual scorecard owner can manage. Erring on the low side may be a prudent
way to start.
The bottom line is that most successful organizations start small with their
performance measurement initiatives. Their initial objectives are to learn the practice
22
Measure What Matters: Aligning Performance Measures with Business Strategy 2000 APQC
KEY FINDINGS
Measure What Matters: Aligning Performance Measures with Business Strategy 2000 APQC
23
KEY FINDINGS
Finding 1:
Best-practice organizations take a simple
approach to ensure that the organization
understands the link between performance
measures and business strategy.
hat are the most important things for us to focus on? That single question
can be anticipated in any scorecard implementation. In some organizations, that question is readily verbalized. In others, it hides in the background, but its
still there. Best-practice organizations answer that question up front, in a logical and
convincing fashion. The extent to which the resulting story makes sense determines
the degree of organizational buy-in to the often-stretched goals associated with the
scorecard.
That buy-in must occur not only for employees but also for the other stakeholders in the organization: customers, suppliers, communities, and stockholders. The
common bond among these sometimes conflicting constituencies is the achievement
of the organizations strategic objectives. Best-practice organizations use a process
that will ensure the link between strategic objectives and the performance measurement
system is both clear and compelling to all.
Currently, there is no single accepted model for developing this scorecard story
and for illustrating the link between measures and strategic objectives. Some organizations first identify their core business processes and then develop the appropriate metrics for these processes. Others start with their existing set of performance measures
and map them against their strategic initiatives to eliminate unrelated metrics and to
identify gaps in their current metrics set. Often, index systems are developed for flagging under-performing metrics or as the basis for a variable compensation formula.
Most organizations recognize that indices can mask the underlying metrics and goals.
Therefore, when using indices to summarize performance, it is critical to maintain
highly visible links between the indices and their underlying metrics.
Best-practice organizations continually review and revise their scorecards with
one eye on their rapidly changing environment and the other on ever-changing goals
and objectives. Maintaining this critical balance is often more art than science, yet it
is essential to establish the credibility of the performance measurement system throughout the organization.
24
Measure What Matters: Aligning Performance Measures with Business Strategy 2000 APQC
KEY FINDINGS
The majority of our study participants maintain a highly visible and comprehensible
approach for the development and deployment of their performance measurement
systems. Nortel Networks matrix-based approach for prioritizing metrics and
identifying gaps, detailed on page 27, is particularly noteworthy.
PRIORITIZING PROCESSES
In the early 1990s, 3M established Q90s, a total quality initiative that initiated
the corporations uncompromising commitment to customer satisfaction. The
autonomous divisions at 3M identified strengths and areas for improvement
according to the Malcolm Baldrige National Quality Award criteriaand then
developed and implemented plans that focused on meeting customer requirements.
As Q90s evolved throughout the company, so did 3M Dental Products Divisions
(DPDs) commitment to numerous business processes that management established
to meet goals. Division leaders recognized how the National Quality Award process
mirrored their own, so they systematically assessed and improved using the Baldrige
criteria.
Boeing CACSO:
Measure What Matters: Aligning Performance Measures with Business Strategy 2000 APQC
25
KEY FINDINGS
Caterpillar WLED:
When asked who is responsible for identifying measures on the scorecard, nearly
all responding organizations reported that their functional management was responsible (Figure 6, page 27). A higher percentage of partners than sponsors tended to
rely on cross-functional teams and quality groups.
Another facet of identifying measures is goal setting. Sponsors and partners
responded very differently concerning the goal-setting process. Most partners
(67 percent) tend to favor the catch-ball method of goal setting, which combines the
top-down and bottom-up approach. Most sponsor organizations (63 percent)
primarily use the top-down approach.
GTE Human Resources:
To develop measures for the scorecard, GTEs work force development group formulated questions regarding its ability to achieve in the areas of five strategic thrusts,
which are tied to GTEs business strategy. The five strategic thrusts are:
1. talent,
2. leadership,
3. customer service and support,
4. organizational integration, and
5. HR capability.
The group came up with 17 questions that frame the scorecard measures:
1. Do we have the talent we need to be successful?
2. Do we have the leadership bench strength we need to be successful?
3. How is HR helping GTE position itself to meet the needs of its external customers?
26
Measure What Matters: Aligning Performance Measures with Business Strategy 2000 APQC
KEY FINDINGS
Business/functional
management
89%
33%
Cross-functional team
67%
67%
44%
33%
Quality group
11%
44%
Financial group
33%
11%
22%
Other
0
20
40
60
80
100
Percentage
Sponsors (n=9)
Partners (n=9)
Figure 6
Nortel Networks used a matrix to compare each of its top 33 metrics to each
strategic objective. Each metric was given a score (-9 to +9) that indicates that metrics correlation to each objective. Negative numbers imply an inverse relationship; the
greater the absolute value of the number, the stronger the relationship. Each metric
was given a total score by taking the sum of the correlation numbers for each strategic
objective. These scores were then used to determine the 16 most important metrics.
As a result, the balanced scorecard is aligned with Nortel Networks strategic
objectives, a list of metrics that strongly correlates with each strategic objective, and an
operational scorecard of those metrics not on the strategic scorecard that would help
Nortel Networks CCS to make data-driven business decisions.
REVISIONS
Most of the partners and sponsors review their performance measurement systems
annually (Figure 7, page 28). Partner organizations also review their systems whenever
there is a change in strategy, competitive action, or management. One organization
Measure What Matters: Aligning Performance Measures with Business Strategy 2000 APQC
27
KEY FINDINGS
Annually
Semi-annually 0%
11%
22%
In response to competitive 0%
action
33%
11%
67%
0
20
40
60
80
Percentage
Sponsors (n=9)
100
Partners (n=9)
Boeing CACSO:
Figure 7
Measure What Matters: Aligning Performance Measures with Business Strategy 2000 APQC
KEY FINDINGS
They are given the choices of monthly, quarterly, and yearly. Each of these choices has
a numerical value associated with it, which is then summed with the measures
effectiveness score. If the measure is determined to be both useful and effective, the
metric is kept on the scorecard. If it is deficient in either area, the measure is either
discarded or amended.
Measure What Matters: Aligning Performance Measures with Business Strategy 2000 APQC
29
KEY FINDINGS
Finding 2:
Even the most advanced users of performance
measurement do not have a fully integrated
scorecard in use throughout the organization.
here are two opposite scorecard deployment strategies. One starts at the top
with an overall corporate scorecard and deploys it down and across the organization so that all business units, functions, and levels have linked scorecards. Another
approach takes a less aggressive approach. It starts within a business unit and/or a
function and, through the achievement of dramatic success and a cadre of champions,
creates a demand for the scorecard approach throughout the entire organization. The
first model represents a push and the second a pull deployment strategy.
There is much debate over which of these strategies achieves the most successful
corporatewide deployment. The answer depends on the organizations culture. At
one extreme, we have what has been termed uni-minded organizations, where all
employees line up behind the person at the top and simply follow orders (i.e., military
and the prototypical Japanese organizations). At the other extreme lies the increasingly
common Western, multi-minded organization, where a directive from the top is usually met with a why? rather than the desired how? A push deployment strategy is
more likely to work in a uni-minded organization than a multi-minded one, where many
employees need to be convinced that the proposed initiative is worth their effort.
Most of our best-practice partners have chosen to use a pull deployment strategy
and are beginning to stimulate interest in performance measurement throughout
their organizations. Almost all study participants use performance measurement at most
levels of the organization. However, the measures may not be integrated into one
corporatewide balanced scorecard (Figure 8).
One of the keys to the balanced scorecard is to use the tool in an integrated fashion
at all levels of the organization. Although none of the participants were able to roll up
measures from the individual level all the way to the corporate level, they were all
attempting to do so. The ability to use consistent measures throughout an organization
is the first step to linking the performance measurement system. At each organizational
level, more partners than sponsors responded that they could aggregate their measures.
30
Measure What Matters: Aligning Performance Measures with Business Strategy 2000 APQC
KEY FINDINGS
Boeing CACSO:
How Organizational-Level
The Boeing companywide value scorecard reflects
Metrics Are Rolled Up
top-level measures and goals for the entire organization.
The Flight Deck, CACSOs balanced scorecard, supports
11%
Employee rolled up to
companywide goals and measures and reflects overall
department
44%
performance measures for the Commercial Airplane
44%
Department rolled up to
Customer Support Organization. The leaders of
business unit
CACSOs subunits soon will identify leading measures that
feed into and support the Flight Deck. Within one year,
33%
Business unit rolled up to
CACSO plans to develop scorecards for the entire
division
67%
CACSO organization, down to the work-group level.
56%
Division rolled up to
Many Boeing operating units outside of CACSO
corporate
67%
have recognized the value of the performance measure0
20
40
60
80
ment system, especially in light of the introduction of
the Boeing companywide value scorecard. Boeing
Percentage
recognizes the need to develop similar performance
Sponsors (n=9)
measurement tools across the organization. As pockets
Partners (n=9)
of performance measurement emerge at Boeing, the
Figure 8
organization will begin to identify common performance
measurement frameworks, tools, and approaches for the
entire organization.
Boeing CACSO reports performance levels for the key
measures using the BSC performance matrix. The BSC
performance matrix displays current-month and threemonth-running average performance levels relative to baseline for each key measure. Color-coding (red, yellow, green, blue) enables a quick visual assessment of
performance.
All measures within the CACSO flight deck/performance matrix system roll up,
arithmetically and/or logically, to represent overall performance across CACSO. In
addition, some CACSO measures, such as revenue and operating margins, roll up to
the Boeing-wide value scorecard. Lower-level measures, which include leading indicators, differ from top-level measures, which often represent outcomes. For example, Boeings top measures in on-time delivery, may reflect that the organization
delivered 600-plus airplanes on time this year. Measures that support this goal at
lower levels in the organization might include the on-time delivery of engineering designs
to manufacturing unit.
89%
100
Caterpillar WLED:
Caterpillar has a fully integrated measurement system. The corporate office identifies the critical success factors (CSFs) that are broad strategies that shape the future
of Caterpillar. Bold goals are then developed by each of the profit centers in support
of those critical success factors. Within the profit center, each person and team has a
set of SMART goals. SMART goals are Specific, Measurable, Action-oriented, Realistic,
Measure What Matters: Aligning Performance Measures with Business Strategy 2000 APQC
31
KEY FINDINGS
32
Measure What Matters: Aligning Performance Measures with Business Strategy 2000 APQC
KEY FINDINGS
Finding 3:
Simple structures for the balanced
scorecard will yield the most effective
performance measurement systems.
o best convey their performance through performance measures, successful organizations organize their metrics into logical groupings. The most popular set
of scorecard perspectives, for example, flows from financial to customer to internal to
learning and growth. In addition, many organizations use a visual analogy or logo, such
as an aircrafts flight deck or instrument panel, to communicate performance. Others
organize metrics to uniquely reflect their individual business.
Most companies recognize that all metrics are not created equal. In other words,
some scorecard metrics and their underlying processes will have a greater strategic
impact than others. This reality can be captured through the use of weighting factors:
The larger the numerical factor, the greater that metrics impact on achievement of the
strategic objectives. But weighting factors are difficult to determine and greatly
complicate communication of the scorecards rationale. These issues have prompted
several study participants to delay the use of weighting factors until later in their
scorecard deployment.
In structuring the performance measurement system and in depicting results,
study participants have found that scorecard users most appreciate simplicity. Most
sponsors and partners chose the five categories in Figure 9 (page 34) as the primary types
of measures in their performance measurement system. These categories conform to
the Sears model, which links employee satisfaction to customer satisfaction to financial success. Internal business processes are often measured so companies can improve
their products, processes, or services.
One of the keys to the balanced scorecard is to only focus on the measurements that
drive your current business. Subject matter expert Art Schneiderman contests that managing performance measurement is analogous to juggling. Figure 10 (page 34) charts
the number of catches per ball compared with the number of balls being juggled. As
with juggling, the more things you try to concentrate on, the less attention (catches)
you can give to each one.
Schneiderman recommends that individuals focus their efforts on up to seven
key measures. Sponsor and partner organizations track nearly the same number of
Measure What Matters: Aligning Performance Measures with Business Strategy 2000 APQC
33
KEY FINDINGS
Customer satisfaction
67%
78%
Quality
measures at the corporate, business unit, and departmental levels (Figure 11). Partner organizations track only
four to six measures for work teams and employees,
while sponsors track nine or 10.
Seventy-eight percent of study participants favor a
non-weighted system for performance measurement.
These systems are less complex and easier for employees
to understand and use.
Boeing CACSO:
100%
100%
Financial
56%
Internal business
processes
78%
78%
78%
Employee satisfaction
0
20
40
60
80
100
Percentage
Sponsors (n=9)
Partners (n=9)
Figure 9
100
90
80
70
60
50
40
30
20
10
0
0
34
10
11
12
Number of balls
Measure What Matters: Aligning Performance Measures with Business Strategy 2000 APQC
KEY FINDINGS
A critical success factor for CACSO was the development of tools and methods to populate and display
the balanced scorecard. The flight deck, the BSC performance matrix, the BSC measure definition template,
and other tools were created using simple spreadsheets.
The accessibility and portability of these simple frameworks ensure that any group can access and use the tools
of performance measurement.
Corporate
10
11
Division
8
Caterpillar WLED:
10
Business unit
11
9
Department
10
6
Project or
work teams
10
4
Employees
9
0
12
Number of Measures
Sponsors (n=9)
Partners (n=9)
Figure 11
Nortel Networks CCS currently has 16 measures on the strategic scorecard equally
weighted. The measures reflect CCS strategy and represent five focus areas: employee
performance, internal processes, customers, market share, and finance. All of the
measures on the scorecard support their strategic objectives, and all of those are
considered equal. The organization can easily weight its measures differently using the
PB Views commercial balanced scorecard software.
Measure What Matters: Aligning Performance Measures with Business Strategy 2000 APQC
35
M E A S U R E W HAT M AT T E R S
Section Two
Measure What Matters: Aligning Performance Measures with Business Strategy 2000 APQC
37
KEY FINDINGS
Introduction
ccording to the famous architect Ludwig Mies van der Rohe, God is in the
details. To Admiral Hyman Rickover, the father of the U.S. nuclear navy, it
was The devil is in the details. Either way, getting the details right is the only way
to win at implementing the balanced scorecard. Recognizing the magnitude of the organizational change associated with successful scorecard implementation quickly draws
us to the critical role top management plays. Executive lip service to performance
measurement is insufficient. Remember the popular quip about the roles of the
chicken and the pig in creating bacon and eggs: The chicken was involved, but the pig
was committed.
Although this distinction is extreme, top managements real and visible
commitment to the creation and management of the balanced scorecard process is a
primary requisite for effective and timely implementation. Delegation of the leadership
responsibilities of this job are impossible. Top managements ultimate personal
responsibility as captains of the ship and behavioral role models to the organization
will reinforce the importance of the scorecard and its priority over other competing
activities.
However, top managers cannot and should not do the job by themselves. Each
scorecard metric must be skillfully, perhaps even artfully, created and enthusiastically
owned by the person or team ultimately responsible for the achievement of the goal.
A dedicated support group, well-versed in both performance measurement and
facilitation tools and techniques, must play a critical role. The combination of top-down
commitment and direction and qualified resources enables and motivates those who
will ultimately achieve the goals to provide the bottom-up knowledge needed for the
creation of realistic scorecards and their associated goals.
These experts/facilitators often can be found within the existing organizational
structure. Strategic planning groups can be a natural match for the tasks associated with
scorecard implementation. Representatives from finance and human resources can bring
the skills required to address such issues as metrics validation and employee motivation.
38
Measure What Matters: Aligning Performance Measures with Business Strategy 2000 APQC
KEY FINDINGS
Representatives from operations can ensure that metrics definitions are meaningful and
related to real business objectives. Together, these experts constitute a core team to support top managements initiative.
Fortunately, many new information technology tools are available to aid the
performance measurement implementation effort. With the increasing use of
corporatewide access to data via intranets and other tools, the tasks of data collection
and dissemination can be effectively decentralized. Specialized software programs
can deploy the balanced scorecard throughout the organization and permit the creation
of customized reports for their timely management. Reports and displays using graphics and color-coding help managers quickly focus on areas requiring their attention.
Some systems even allow statistical analysis of performance results, enabling the user
to separate significant results from ever-present noise. But many note that manual preautomation planning efforts have significant payoff, given the substantial cost associated
with these powerful but often inflexible solutions.
Measure What Matters: Aligning Performance Measures with Business Strategy 2000 APQC
39
KEY FINDINGS
Finding 4:
Executives must be actively involved
in leading the implementation effort.
40
Measure What Matters: Aligning Performance Measures with Business Strategy 2000 APQC
KEY FINDINGS
of the effort remained unclear. Would the initiative survive the departure of one of these
key individuals?
Boeing CACSO:
The vice president and general manager of the Commercial Airplane Customer
Support Organization champions the flight deck, CACSOs balanced scorecard.
Because he has a process management/quality background, he is accustomed to
approaching the business from a process perspective. He encourages CACSOs leaders to follow this approach as well. His leadership team consists of all of CACSOs functional and support group leaders. This leadership team drives the development and
improvement of the performance measurement system by communicating to the
organization about measures and results, by modeling the use of the measures, and by
reinforcing the importance of performance measurement. The vice president and
general manager launched the flight deck at an all-leaders meeting and continue to reinforce the message of performance measurement through open forums with all levels
of employees.
GTE Human Resources:
Senior executive support of the performance measurement initiative was key to the
successful rollout of GTEs scorecard. The executive vice president of HR and
departmental vice presidents played a major role in positioning the performance
measurement initiative as a learning experience and a constructive, positive process of
improvement.
The executive vice president of HR served as senior executive sponsor of the HR
balanced scorecard implementation initiative. He actively influenced others to support
the initiative and then held them accountable for performance. He effectively conveyed that the intent of the performance measurement initiative is to develop highly
effective processes in HR, rather than to identify poor performers. The executive
vice president of HR also modeled a commitment to deliver the best possible service to GTE employees, the customers of HR.
Nortel Networks CCS:
Measure What Matters: Aligning Performance Measures with Business Strategy 2000 APQC
41
KEY FINDINGS
Finding 5:
The organization must dedicate top-notch
resources to the implementation and
operation of the performance
measurement system.
Measure What Matters: Aligning Performance Measures with Business Strategy 2000 APQC
KEY FINDINGS
89%
89%
Executives
Directors
78%
78%
Managers
78%
78%
44%
44%
Professionals
11%
Employees
44%
0
20
40
60
80
100
Percentage
Sponsors (n=9)
Partners (n=9)
Boeing CACSO:
Figure 12
20
40
60
80
100
Percentage
Sponsors (n=9)
Partners (n=9)
Measure What Matters: Aligning Performance Measures with Business Strategy 2000 APQC
Figure 13
43
KEY FINDINGS
Caterpillar WLED:
WLEDs product managers were ultimatly responsible for determining the measures that were used to run their business. The company enlisted the help of external
consultants as well as Caterpillars business resources group, which aided the product
manager in determining measuresan evolutionary processand reporting and
analyzing them. The business resources group is a shared service organization that is
in charge of the collection and analysis of some performance measurement data that
it reports to the department heads.
GTE Human Resources:
GTE HRs newly formed planning, measurement, and analysis team includes a director plus three employees who have been dedicated to the team full time since the
beginning of the HR balanced scorecard initiative. The HR measurement core team
44
Measure What Matters: Aligning Performance Measures with Business Strategy 2000 APQC
KEY FINDINGS
includes eight functional subject matter experts representing the various functions
within HR and the five GTE strategic business units. These core team members
were identified the critical measures and communicated them back to their business
units. During the development of the scorecard, each team member invested
approximately 400 hours in the effort. In addition, GTE HR enlisted the aid of
consultants from Hewitt Associates for a year-long development and implementation
initiative. These consultants are not actively engaged in the ongoing efforts.
Each core team member continues to devote about one week every quarter to
sustaining the balanced scorecard system. These core team members coordinate the
collection, validation, and submission of performance measurement data for their
business units, in addition to performing their full-time roles within the business
units. An extended team in the HR technology and data group supports the
performance measurement effort.
Nortel Networks CCS:
Two groups are involved in the process of aligning measures with business strategy:
the strategic planning group and the business performance measurement (BPM)
team. The strategic planning group is responsible for organizing the yearly planning
sessions with the senior managers, incorporating the strategic review into quarterly
business performance reviews, and collaborating with the business performance team
to ensure alignment between the balanced scorecard and the strategic objectives of
the CCS.
The BPM team was responsible for the creation and rollout of a balanced
scorecard to the CCS, including the gathering, trending, and reporting of all
performance data. It also established a centralized reporting function. The BPM
team is responsible for the ongoing collection and analysis of the performance
measurement data.
The CCS BPM team relies on contacts within other business units to support
the performance measures system. Each metric has a data provider and a regional
data owner. Regional directors are ultimately responsible for the data submitted by their
particular region.
Measure What Matters: Aligning Performance Measures with Business Strategy 2000 APQC
45
KEY FINDINGS
Finding 6:
Meaningful and effective performance
measurement begins with strategic
planning and is linked to the periodic
planning process.
here does the scorecard process fit in the traditional organizational structure?
Many organizations view it as a natural extension of the strategic planning
process and necessary vehicle for communicating their strategies and making them more
tangible. Others link it more closely to their quality improvement efforts. Still
others view it as an extension of their financial function. Wherever its home base,
most organizations prefer to position performance measurement as an extension of
current practice rather than as an entirely new function.
No matter its location in the existing organizational structure, the fact that
performance measurement picks up where strategic planning ends is formally recognized in best-practice organizations. During strategic planning, the organization identifies the strategies and initiatives it will focus on in the future. This exercise
leads to the development of performance measures that will gauge the organizations
success related to these strategies. As depicted in Figure 15 (page 47), the development
of the performance measures involves strategic planning professionals as well as
quality, financial, and business unit representatives.
Several study participants link their balanced scorecard implementation to their
strategic planning organization and/or process. All responding participants indicated
that performance measures are identified during the strategic planning process. Some
participants reported additional processes, as indicated in Figure 16 (page 47).
3M:
The 3M strategic planning process aligns and drives virtually every company
action. This process:
pulls together vast amounts of data and information for analysis,
determines priorities,
defines approaches,
assigns responsibilities,
allocates resources, and
aligns activities with each divisions vision.
46
Measure What Matters: Aligning Performance Measures with Business Strategy 2000 APQC
KEY FINDINGS
Cross-functional team
67%
67%
44%
11%
Quality group
33%
33%
44%
Financial group
0
20
40
60
80
100
Percentage
Sponsors (n=9)
Partners (n=9)
Figure 15
Boeing CACSO:
78%
Business/functional
management
100%
100%
Measures are
identified during the
budgeting process.
56%
56%
22%
78%
0
20
40
60
80
100
Percentage
Sponsors (n=9)
Partners (n=9)
Measure What Matters: Aligning Performance Measures with Business Strategy 2000 APQC
Figure 16
47
KEY FINDINGS
GTE Human Resources:
48
Measure What Matters: Aligning Performance Measures with Business Strategy 2000 APQC
KEY FINDINGS
Finding 7:
Simple, intuitive tools are most effective
for managing and communicating
performance measurement information.
he balanced scorecard and its associated set of performance measures can create a major logistical challenge. Data, often generated at remote locations, need
to be input periodically into the performance measurement system. Narrative explanations of significant performance gaps need to be disseminated. Results need to be
accessible in a timely manner, which usually means within days of the reporting
periods close. Reports have to be structured, perhaps using color-coding, to draw
attention in a potential maze of data to those few areas requiring management
attention.
Most organizations initially manage performance measurement data and results
with manual systems, often based on simple spreadsheets and graphics packages. Data
are centrally collected using fax or e-mail and published from a single location. Once
the organizations have a clear understanding of their data needs, they can transition
to one of the many custom software packages designed for automating the scorecard
logistics. Other organizations start with these automated solutions and use their
hardwired framework as the template for their scorecard implementation (Figure 17,
page 50).
Even among best-practice organizations, performance measurement solutions are
not completely automated. The critical element of simplicity is demonstrated in
study participants choices of tools used to manage performance measurement.
Some best-practice partners use a commercial balanced scorecard software package
(Panoramic Business Views or PB Views) to compile and distribute periodic
performance measurement reports. In each case, they used simple software programs
(e.g., Excel spreadsheets) to collect and analyze the data. Many organizations anticipate further advances in automation as enterprisewide solutions (such as SAP and
Oracle) become available.
Most responding organizations that have selected a technology solution or software
package did so after they implemented their performance measurement system
(Figure 18, page 50). However, a technology solution is not necessary for the successful
Measure What Matters: Aligning Performance Measures with Business Strategy 2000 APQC
49
KEY FINDINGS
78%
89%
22%
11%
20
40
60
80
100
Percentage
Sponsors (n=9)
3M:
Partners (n=9)
Figure 17
11%
13%
After
performance measurement
system implementation
33%
50%
56%
38%
0
20
40
60
Percentage
Sponsors (n=9)
Partners (n=9)
Figure 18
50
80
100
Measure What Matters: Aligning Performance Measures with Business Strategy 2000 APQC
KEY FINDINGS
When 3M tried to roll up the divisions numbers, it did not see significant benefit
or improvement as a result. Because of the diversity of businesses, it is hard to see
the real numbers because some divisions are doing great, while others are not doing as
well. Corporate measures are directions and provide guidance to divisions. When
3M reports a single aggregate number to represent all divisional results, it makes sure
everyone understands how the number was calculated. Most aggregates are created
merely to see overall improvement within 3M.
Boeing CACSO:
Most data collection and analysis is performed using simple tools, such as Excel
spreadsheets and Access databases. Boeing CACSO has not yet automated the collection and analysis of performance-related data. In the long term, CACSO plans to
incorporate into the performance measurement system a Web front-end, drill-down
capability and interface with existing systems.
Some divisions within CACSO are ready to begin further automating their
performance measurement systems. CACSOs strategy group will work with those
divisions to establish the enterprise requirements for performance measurement
software, then evaluate off-the-shelf products and pilot the selected tool.
Implementation of an automated tool will enable CACSOs personnel to monitor,
assess, and manage process performance daily rather than once per month. In addition, the automated tool will simplify routine tasks and help to ensure data integrity.
CACSO uses a balanced scorecard measure definition template to ensure that
everyone in the organization shares a common understanding of each balanced
scorecard indicator. This template documents and communicates critical information
about each measure, such as the measure name, the purpose of the measure, the
operational definition, targets for the current and future periods, information about
data collection, and the reporting format.
Each indicator has a process owner. This individual has responsibility, accountability, and authority pertaining to his or her indicator. The performance measurement
teams can audit the BSC measure definition templates to ensure compliance with
definitions and consistency in application of methods.
Nortel Networks CCS:
Nortel Networks CCS ensures the integrity and accuracy of its data by making it
available to everyone. If a manager skewed data to show improved performance,
another manager would likely question the data via internal benchmarking while
trying to improve his or her own processes. This open environment and the Nortel
Networks culture, which supports accuracy and accountability, has allowed the
organization to self-audit its data. CCS made it a priority when it designed its
performance measurement system to apply consistent definitions to all of its metrics.
These definitions are available online using the PB Views software so that if there is a
question about how to measure something, the definition is easily accessible.
Measure What Matters: Aligning Performance Measures with Business Strategy 2000 APQC
51
KEY FINDINGS
When CCS was looking for a technology application to aid its balanced scorecard implementation, it created a wish list of everything that it wanted its software to
do. First, it wanted the system to roll up raw data, not averages of percentages for
reporting. Second, it wanted the system to track performance measurement data at
several locations in order to compare data among CCSs multiple locations.
Additionally, it wanted a tool that offered color-coded performance indicators,
flexible reporting, benchmarkable data, and a package that could be used to
determine trends over time.
CCS has been very happy with its selection of PB Views. According to CCS, the
biggest weaknesses of the system are the limited reporting functions and the inability
to allow data feeds from other applications. CCS has been extremely pleased with
the service it has received from software vendors, including on-site visits and
suggestions for upgrades to the system. Using technology has encouraged CCS to
set goals for all of its measures, and it has helped the company measure its metrics
consistently across the organization.
52
Measure What Matters: Aligning Performance Measures with Business Strategy 2000 APQC
M E A S U R E W HAT M AT T E R S
Section Three
Communicating and
Driving Behaviors
Measure What Matters: Aligning Performance Measures with Business Strategy 2000 APQC
55
KEY FINDINGS
Introduction
56
Measure What Matters: Aligning Performance Measures with Business Strategy 2000 APQC
KEY FINDINGS
Finding 8:
Few organizations effectively use
incentive compensation to manage
individual performance and contribution
to scorecard goals.
57
KEY FINDINGS
Up to 10%
Up to 20%
Up to 30%
Up to 40%
90%
80%
70%
60%
Exempt
n=12
Manager
n=13
Director
n=9
100%
80%
60%
40%
20%
0%
Other Compensation
Tied to Compensation
All eight respondents reported that incentive compensation for nonexempt and union
employees ranges from 1 percent to 10 percent of wages.
Ten of 12 respondents reported that exempt employees are eligible to receive from
1 percent to 10 percent of wages in incentive compensation. Two respondents
reported ranges of 11 percent to 20 percent.
Measure What Matters: Aligning Performance Measures with Business Strategy 2000 APQC
KEY FINDINGS
100%
100%
Manager
88%
100%
88%
Director
71%
63%
Employee
86%
25%
Functional team
57%
0
20
40
60
80
100
Percentage
Sponsors (n=8)
It is unclear if any approach most effectively produces
Partners (n=7)
the desired changes in individual behavior. We are
unaware of any organizations that deploy their corporate
Figure 20
performance measures down to the level of individuals
scorecards linked to their compensation, an approach
taken by the Hoshin Kanri method widely used in Japan.
At Caterpillar WLED, corporate bold goals tie to individual SMART goals. But individual incentives are not based on these SMART
goals. At GTE HR, individuals are compensated based on overall performance
measures, rather than on their individual contribution to those measures.
Nearly all study participants voiced a desire to eventually link their performance
management and compensation systems to their balanced scorecards. In most cases,
they were gradually and cautiously moving toward this long-term objective. Caterpillar
WLED and GTE Human Resources have formalized and implemented performance
incentive programs tied to their balanced scorecards, as described below.
Caterpillar WLED:
Measure What Matters: Aligning Performance Measures with Business Strategy 2000 APQC
59
KEY FINDINGS
60
Measure What Matters: Aligning Performance Measures with Business Strategy 2000 APQC
KEY FINDINGS
TIME FRAME FOR TYING COMPENSATION TO
PERFORMANCE MEASUREMENT RESULTS
29%
0%
0%
25%
29%
25%
43%
0
20
40
60
80
100
Percentage
Sponsors (n=8)
Partners (n=7)
Figure 21
Measure What Matters: Aligning Performance Measures with Business Strategy 2000 APQC
61
KEY FINDINGS
Finding 9:
Best-practice organizations enhance employee
understanding of and support for performance
measurement through customized, ongoing
communication.
62
Measure What Matters: Aligning Performance Measures with Business Strategy 2000 APQC
KEY FINDINGS
Measure What Matters: Aligning Performance Measures with Business Strategy 2000 APQC
63
KEY FINDINGS
Caterpillar WLED:
Measure What Matters: Aligning Performance Measures with Business Strategy 2000 APQC
KEY FINDINGS
the front-line supervisor and the online system. These two methods are used to address
issues that affect employees on a daily basis, such as quality, safety, and sharing best
practices within the plant. In addition to press releases, the print forms of communication primarily are used to convey messages about overall company performance.
In addition, during the annual performance development process, all managers
and employees look at the organizations critical success factors and bold goals to
develop individual SMART goals. The employees gain a better understanding of
the impact that their work has on the success of the company.
GTE Human Resources:
GTE HR produces its balanced scorecard quarterly and shares it with all 2,000 GTE
HR employees, as well as with GTEs business leaders and board of directors. The
scorecard includes:
an introduction that can be easily understood by all 2,000 HR employees;
news briefs that detail significant accomplishments and demonstrate the value of
HR to the business;
a high-level summary of HR performance in each of the four perspectives;
definitions of important terms to help the reader understand the scorecard;
interpretive commentary noting items of interest;
a table showing all measures, actual results for the quarter and the year to date,
and targets for the measures, where applicable; and
charts and graphs, where applicable.
The 1999 quarterly scorecards were distributed to all HR employees in hardcopy form. In 2000, GTE HR hopes to gain a broader audience for the scorecard.
Scorecard results and news briefs will be posted on the GTE HR intranet.
In addition, the PMA group uses PB Views software to manage the performance
measures system. The software also enables the PMA group to create briefing books
for customers of HR, which allow them to view and analyze the data that are most
relevant to the process for which they are responsible.
Nortel Networks CCS:
65
M E A S U R E W HAT M AT T E R S
Measure What Matters: Aligning Performance Measures with Business Strategy 2000 APQC
67
KEY FINDINGS
Introduction
68
Measure What Matters: Aligning Performance Measures with Business Strategy 2000 APQC
KEY FINDINGS
Caterpillar WLED:
Caterpillar WLED ensures the integrity of data by hiring an outside consultant (PricewaterhouseCoopers) to
audit all of its data and collection processes and the financial and nonfinancial performance data. In addition to
PricewaterhouseCoopers, Caterpillar has its own inhouse auditing team that visits the plant annually to conduct audits. Caterpillars self-auditing unit is capable of
performing several types of audits on the plant and
ensures that at least one of each of the different audits is
completed every three years. Audits that Caterpillar
WLED feels are more crucial to the success of its business are conducted at least once a year.
56%
25%
33%
External auditors
No formal approach to
ensuring data integrity
63%
67%
38%
11%
0
20
40
60
80
100
Percentage
Sponsors (n=8)
Partners (n=8)
Figure 24
CALIBRATION OF EXPECTATIONS
Measure What Matters: Aligning Performance Measures with Business Strategy 2000 APQC
69
KEY FINDINGS
DEVELOPING INDIVIDUAL ACCOUNTABILITY
Management support
89%
43%
89%
71%
78%
Performance incentives
43%
Training/education
3M:
78%
43%
Technology tools
56%
0
20
40
60
Percentage
Sponsors (n=7)
Partners (n=9)
Figure 25
80
100
Boeing CACSOs leadership aims to involve the organization in the performance measurement system through
extensive two-way dialogue in order to develop commitment and buy-in to the process. The strategy group acknowledges that this approach
lengthens the time required for implementation, but it feels that the resulting shared
vision, commitment, and results will be more durable.
Each indicator has a process owner who holds responsibility for, accountability
for, and authority over the measure. Boeing CACSOs leadership foresees that
implementing performance measurement technology tools and putting these tools
in the hands of employees will effectively increase ownership and understanding
among employees.
Another critical success factor for CACSO was the development of tools and
methods to populate and display the balanced scorecard. All of these tools were
created using simple spreadsheets so that anyone could access and use the performance
measurement tools.
Caterpillar WLED:
All employees are well aware of their SMART goals because they are the basis for
employee evaluation. The links between employee goals and the critical success
factors are apparent, as are the key values that should be the framework for all
70
Measure What Matters: Aligning Performance Measures with Business Strategy 2000 APQC
KEY FINDINGS
employees at Caterpillar. During the PDP process, managers and employees design
the employees SMART goals for the year. The first step in the process is for employees and managers to look at the higher levels of the performance measurement system
(CSFs and bold goals) to develop measures for employees that support these goals.
The idea behind the PDP system is to give employees a better understanding of their
performance measures, goals, and the impact that their work has on the overall
success of the company.
GTE Human Resources:
GTEs HR Operation Center enlisted subject matter experts from each area of
the Operations Center to participate in the measurement initiative. This ensured
that the new system considered process-specific knowledge and helped to gain buy-in
from those participants and their respective departments.
CHANGE MANAGEMENT THROUGH POSITIVE POSITIONING OF PERFORMANCE
MEASUREMENT INITIATIVE
Caterpillar WLED combated employee skepticism by using its business understanding plan, which helped the employees understand why the organization was
changing and thus helped gain their support for the program.
GTE Human Resources:
GTE HRs workforce development group recognized that the strategic performance measurement would require extensive communication and education of personnel to secure buy-in. This group modeled the development process for the overall
HR organization and addressed change issues and becoming the early adopter of
the balanced scorecard.
Key to overcoming resistance to the change was the leadership and active
involvement of senior sponsors, specifically the executive vice president of HR and
departmental vice presidents, such as the vice president of workforce development.
These leaders played a major role in positioning the performance measurement initiative as a learning experience and a constructive, positive process of improvement.
The organizations positioning of the balanced scorecard as a positive improvement
effort rather than a mechanism for assigning blame enabled employees to feel more
Measure What Matters: Aligning Performance Measures with Business Strategy 2000 APQC
71
KEY FINDINGS
comfortable during the change without worrying about what the scorecard might
reveal about their individual performance.
STARTING SMALL TO ENSURE BIG SUCCESS
Another key recurring theme among the studys best-practice organizations is the
willingness to launch the performance measurement effort as soon as possible, even if
this entails launching before fully developing a complete set of metrics or without a
sophisticated method for analysis or communication.
Best-practice organizations agreed that beginning to communicate the concepts
of performance measurement early can help to allay discomfort and avoid surprises.
Oftentimes, existing metrics can be identified and reported immediately. The
organization can adjust to accountability for performance metrics using familiar
measures.
Further, the organization should become accustomed to the idea that measures
may change along with strategies and processes. This type of change will be ongoing,
even as performance measurement processes are finalized.
As with any change initiative, quick wins, or displaying early benefits from the
effort, can garner support for the change. Similarly, over-designing the performance
measurement system before rollout can delay the implementation and can lose
momentum, enthusiasm, and even credibility.
GTE Human Resources:
72
Measure What Matters: Aligning Performance Measures with Business Strategy 2000 APQC
M E A S U R E W HAT M AT T E R S
76
3M
78
80
82
84
Measure What Matters: Aligning Performance Measures with Business Strategy 2000 APQC
75
PROFILES
3M
3M
SNAPSHOT
Industry:
Manufacturing
Headquarters:
$15.07 billion
Employees:
75,639
Web Page:
www.3m.com
76
Measure What Matters: Aligning Performance Measures with Business Strategy 2000 APQC
PROFILES
Like its parent, DPD is committed to customer satisfaction. The driving force behind
every business decision is DPDs commitment to its customers. This commitment led
to the divisions focus on quality and performance measurement.
PERFORMANCE MEASUREMENT AT 3M AND 3M DPD
Although 3M values outside the box thinking, innovation, and challenge to the
status quo, the organization sought a framework around which to align the efforts
and energies of its employees. The organization wished to focus on elements beyond
financial measures (operating income, cost of capital, and economic profit.) 3M
recognizes that financial results are lagging measures and emphasizes the management of operational indicators in real time.
3M learned about the balanced scorecard in the mid-1990s. Today, 3M uses a
balanced measurement system companywide at all levels, including divisions, business
units, products, and employees. The form of the balanced measurement system is
flexible, in keeping with 3Ms value of autonomy for its 40 to 45 divisions. The
performance measures communicate what is important to the company across diverse
locations and operations.
3M DPD began its measurement efforts as a means to fix recurring field problems
and win back customers it had lost in the late 1980s. The division identified goals and
established a business process to track programs and ensure these goals were achieved.
The division steering committee adapted performance management in the early 1990s
and developed its balanced scorecard, called the business process performance matrix.
3M DPD has seen many tangible benefits from its quality journey, enabled
through effective performance measurement. Among these results are:
consistent revenue performance,
sales growth of 250 percent (projected) based on 1987 base,
more than 40 percent (1999) of annual global sales from new projects,
dramatically improved safety results,
more than 50 percent improvement in waste reduction since 1990,
consistently high channel partner satisfaction with products and services and
technical support, and
increasing economic profit as a percent of sales.
Measure What Matters: Aligning Performance Measures with Business Strategy 2000 APQC
77
PROFILES
T
SNAPSHOT
Industry:
Manufacturing
Headquarters:
Seattle, Wash.
Revenue:
231,100 (1998)
Web Page:
www.boeing.com
78
he only maker of big commercial jets in the United States, Boeing is the worlds
largest aerospace company. It has divisions devoted to commercial airplanes,
military aircraft and missiles, and space and communications systems.
The companys commercial planes (63 percent of sales) include the Boeing 737
(the worlds most popular commercial aircraft), 747, 757, 767, and 777 jets, which
represent a variety of passenger and cargo configurations and range capabilities.
The dominant producer of large commercial aircraft, Boeings only competition comes
from the French consortium, Airbus.
Boeings military aircraft include the F/A-18 Hornet strike fighter, the venerable
F-15E Eagle fighter-bomber, the AH-64D Apache Longbow helicopter, and the
C-17 Globemaster III transport. Missiles include the Standoff Land Attack Missile
(SLAM ER) and the Joint Direct Attack Munition (JDAM).
Major Boeing space systems include the space shuttle (with Lockheed Martin), the
Delta family of rockets, global positioning systems (GPS), and communications
satellites. Through partnerships with other companies, Boeing is planning to offer
satellite communication services. Boeing also is the prime contractor for the
International Space Station.1
Boeing consists of multiple business units, including the space and communications group, the commercial airplane group, and the military aircraft and
missile systems group. The Boeing commercial airplane Customer Support
Organization (CACSO), is part of the commercial aviation services unit, which is an
operating unit of the commercial airplane group. CACSO is responsible for
supporting and maintaining the existing fleet of 11,000 Boeing aircraft currently in
service. The group also offers more than 250 products, such as technical documentation and parts.
Measure What Matters: Aligning Performance Measures with Business Strategy 2000 APQC
PROFILES
PERFORMANCE MEASUREMENT AT BOEING CACSO
Boeing introduced its value scorecard system in the second quarter of 1999. The
CFO has championed the scorecard as a tool to communicate to analysts Boeings focus
on value and its near- and long-term goals. The entire Boeing organization must
align with the measures expressed on this companywide scorecard.
CACSO rolled out its flight deck performance measurement system about a year
ago. The organization uses the flight deck tool as a vehicle for change, to increase the
organizations focus on process management, and to drive the development of
performance at lower levels of the organization.
CACSO believes that the performance measurement system has resulted in great
focus on what is important to the organization. It seems to have more of a
sense of direction. And though it is difficult to identify the ROI for performance
measurement initiatives, CACSO has seen some immediate process improvements
gained from its focus on process management.
1 www.hoovers.com
Measure What Matters: Aligning Performance Measures with Business Strategy 2000 APQC
79
PROFILES
CaterpillarWheel Loader
and Excavator Division
C
SNAPSHOT
Industry:
Manufacturing
Headquarters:
Peoria, Ill.
Revenue:
65,800 (1998)
Web Page:
www.caterpillar.com
In the early 1980s, Caterpillar experienced a severe decline in its business growth
due to foreign competition. In an effort to modernize its processes and facilities,
Caterpillar began the Plant With a Future program in 1983 and put it into practice
between 1985 and 1993 at all of its facilities worldwide. This program enabled the
company to reduce manufacturing space and reduce cycle times from 24 days to
six days.
80
Measure What Matters: Aligning Performance Measures with Business Strategy 2000 APQC
PROFILES
Measure What Matters: Aligning Performance Measures with Business Strategy 2000 APQC
81
PROFILES
GTE Corporation
Human Resources Organization
G
SNAPSHOT
Industry:
Telecommunications
Headquarters:
Irving, Texas
Revenue:
120,000 (1998)
Web Page:
www.gte.com
TE, the largest non-Baby Bell recently agreed to be acquired by Bell Atlantic,
the largest Baby Bell. After the merger, the new organization will have 240,000
employees and will be the leading local phone company in the United States. GTE
serves more than 23 million local phone customers in the United States and offers
long-distance service in every state. It provides cellular and PCS phone service to
5 million subscribers through subsidiary GTE Wireless, offers consumer Internet
access through GTE.net, and has cable franchises in California and Florida. GTE
also provides telecom services in Argentina, Canada, China, the Dominican Republic,
and Venezuela. In a joint venture with investment firm Georgetown Partners, GTE
is buying about half of Ameritechs wireless business.3
GTEs human resources (HR) organization is made up of three major components:
1. the center of expertise, which creates and implements HR programs, policies,
and strategies;
2. business partners, which provide on-site consulting and assessment to business
leaders, employees, and managers; and
3. service delivery/operations centers, which deliver traditional transactional HR
services (e.g., payroll processing, benefits enrollment) to employees and managers.
The 2,000-person GTE HR organization supports six strategic business units,
each of which has a vice president of HR and a staff of HR business partners.
PERFORMANCE MEASUREMENT AT GTE HR
Measure What Matters: Aligning Performance Measures with Business Strategy 2000 APQC
PROFILES
GTE realized that its people were key to its future success. During the Leadership
2000 effort, GTE HR leaders inventoried the current skills and capabilities that would
provide value in the future, then identified the employee-focused imperatives to grow
that talent and increase the value delivered by GTE employees. GTE would need
new behaviors, actions, and capabilities to drive business results.
To focus the HR organization on the achievement of these imperatives, GTE
developed a new HR strategy to support the business strategy. This strategy included
five strategic thrusts:
1. talent,
2. leadership,
3. customer service and support,
4. organizational integration, and
5. HR capability.
In the first quarter of 1998, four members of a newly formed planning measurement and analysis (PMA) team translated the GTE HR strategy into a measurement
model for the future. The group selected the balanced scorecard approach and
developed a proof for the concept. GTE HR senior management approved the
balanced scorecard as the communication vehicle for GTEs strategy, and the PMA team
introduced the first quarterly balanced scorecard one year after beginning the initiative.
The scorecard concept has been readily adopted within many areas of the GTE HR
organization.
The benefits of GTE HRs scorecard include:
improving communication throughout the organization,
monitoring critical work force indicators,
assessing organizational health and competitive capability,
measuring the enterprisewide results of HR initiatives,
enhancing HRs ability to provide effective solutions,
promoting a culture of continuous improvement, and
focusing on the key factors of business success.
3 www.hoovers.com
Measure What Matters: Aligning Performance Measures with Business Strategy 2000 APQC
83
PROFILES
Nortel NetworksCanadian
Customer Service Division
T
SNAPSHOT
Industry:
Telecommunications
Headquarters:
Ontario, Canada
Revenue:
75,000 (1998)
Web Page:
www.nortelworks.com
84
In recent years Nortel Networks has found its industry to be changing rapidly.
Widespread use of the Internet brought new types of customers to the company.
Nortel Networks also saw new network carriers and the dawn of deregulation of the
industry. The company realized it needed a performance measurement system that
would help it compete in this dynamic environment.
CCS began its performance measurement efforts in early 1998 by creating two
separate groups: one tasked with creating the strategic vision for the company and
the other to track organizational performance. This second group, the business performance measurement (BPM) team, decided to use a balanced scorecard system.
In July 1998 CCS developed its vision and mission and communicated them to
all CCS employees. This was the first step in gaining employee buy-in for the performance
measurement system. The next significant step was linking the organizations metrics
to its strategic and operational scorecards. Beginning the following year all managers
Measure What Matters: Aligning Performance Measures with Business Strategy 2000 APQC
PROFILES
were trained how to use the balance scorecard, and they began to report all of their data
using this tool. Following the rollout of this device, CCS has focused on communicating the benefits of the balanced scorecard to all employees.
Nortel Networks has seen many benefits from its performance measurement
initiative.
Focusing its efforts on only 16 measures has helped create a narrowly focused
work force that has concentrated on what is most important to the organization.
This has been helpful in staffing.
All of the measures are strongly linked to the strategic plan, which has enabled
CCS to track its progress toward its strategic goals.
The balanced scorecard has given the organization a secure foundation of measurements that are indicative of organizational direction and independent of management. This will help the company maintain strategic direction and focus
should its leadership change.
CCS now is able to make decisions based on data rather than instinct.
4 www.hoovers.com
Measure What Matters: Aligning Performance Measures with Business Strategy 2000 APQC
85
LEGAL NOTICE
Disclaimer
Copyright
There are substantial penalties for willful violation of copyrights existing under this
license, including criminal and civil penalties.
More Information
86
Measure What Matters: Aligning Performance Measures with Business Strategy 2000 APQC