Documente Academic
Documente Profesional
Documente Cultură
Access to this document was granted through an Emerald subscription provided by emerald-srm:101358 []
For Authors
If you would like to write for this, or any other Emerald publication, then please use our Emerald for
Authors service information about how to choose which publication to write for and submission guidelines
are available for all. Please visit www.emeraldinsight.com/authors for more information.
About Emerald www.emeraldinsight.com
Emerald is a global publisher linking research and practice to the benefit of society. The company
manages a portfolio of more than 290 journals and over 2,350 books and book series volumes, as well as
providing an extensive range of online products and additional customer resources and services.
Emerald is both COUNTER 4 and TRANSFER compliant. The organization is a partner of the Committee
on Publication Ethics (COPE) and also works with Portico and the LOCKSS initiative for digital archive
preservation.
BJM
7,4 Using non-mandatory
performance measures in local
governments
416
Lourdes Torres, Vicente Pina and Caridad Mart
Department of Accounting and Finance, University of Zaragoza,
Received 31 May 2011
Revised 18 January 2012, Zaragoza, Spain
17 May 2012
Accepted 20 July 2012 Abstract
Purpose The purpose of this paper is to analyse how local governments implement non-mandatory
performance measures (PM), the types of PM employed, the degree of their usefulness in decision
Downloaded by Carleton University At 05:43 30 January 2016 (PT)
1. Introduction
Issues considered cornerstones of public sector reform in the 1980s, such as performance
measures (PM) and improved efficiency, are returning as proposed ways of reducing the
pressure on public budgets. Performance measurement is regaining its popularity in the
EUs public sectors, especially local ones (Lapsley and Wright, 2004; Ammons and
Rivenbark, 2008). Improving efficiency and effectiveness is driven not only by managerial
rationality but also by the political agendas of most countries (Halachmi, 2005).
Accordingly, the local governments of most EU countries are developing PM systems as a
Baltic Journal of Management public expression of their commitment to use taxes efficiently.
Vol. 7 No. 4, 2012
pp. 416-428
q Emerald Group Publishing Limited
1746-5265
This study has been carried out with the financial support of the Spanish National R&D Plan
DOI 10.1108/17465261211272166 through research project ECON2010-17463 (ECON-FEDER).
The disclosure of non-financial information and the introduction of performance Non-mandatory
indicators are rarely legally required in OECD countries. Such requirements as exist PM in local
do not refer to specific indicators and allow local government discretion in their
definition and introduction[1]. For Matland (1995) and Barrett (2004), this governmental governments
discretion and the lack of detailed legal requirements are meant to smooth local
governments PM implementation processes by making it easier for local government
staffs to arrive at a consensus and thus avoid conflicts while implementing PM. As the 417
decision to introduce performance indicators is usually made internally, heterogeneity in
their implementation and usage is common.
This study addresses the following research questions. First, how do local
governments implement performance indicators when they are non-mandatory? Second,
what types of PM are employed by local governments? Third, how useful are
performance indicators in local governments decision-making (internal/learning usage)
and/or accountability (external usage)? Fourth, what are the outcomes of their use? This
Downloaded by Carleton University At 05:43 30 January 2016 (PT)
this frequency varies according to the type of users. Studies have analysed the usefulness
of PM information in influencing political and management decision-making, with mixed
results. ter Bogt (2004) and Pollitt (2006) found that politicians generally either use
performance information in limited ways or not at all, other works (Ho, 2006; Askim, 2007)
have found that PM are used by councilors in their decision-making processes. Councilors
and managers both seem to use PM for budgeting purposes, but PM are used by managers
mostly to identify strategic priorities and by councilors to support program evaluation
decisions (Hildebrand and McDavid, 2011). PM are also used for reporting to elected
officials and management and in support of improved communication within local
governments (Melkers and Willoughby, 2005); they are used less frequently for
benchmarking when officials are unwilling to embrace comparison with other local
governments (Ammons and Rivenbark, 2008).
Stakeholder participation has been found to be a positive factor in PMs impact on
decision-making (Ho, 2006). The support of top managers has been consistently
associated with PM success (de Lancer Julnes and Holzer, 2001; Wang and Berman, 2001;
Cavalluzzo and Ittner, 2004). Political support, a goal-oriented culture, citizen
involvement in PM processes (Moynihan and Pandey, 2010), and the capacity of
performance indicators to meet the users information needs (Taylor, 2009) have been
positively associated with PM use. Meanwhile, the lack of technical infrastructure for
PM implementation and use including the technical ability to collect and process data
in a timely way and staff able to analyse PM data have been consistently cited
as problems (Berman and Wang, 2000; Hildebrand and McDavid, 2011).
about the organization of local service delivery, taxes, fees, and performance management
models, allowing them to implement their own strategies and avoid conflicts.
3.2 Methodology
The sample comprises the 144 Spanish local governments of over 50,000 inhabitants
in January 1, 2008; they were the ones legally required to disclose performance indicators
in their annual report. Below this threshold, PM are practically irrelevant. We phoned
these 144 cities o find out whether they had implemented PM before sending a
questionnaire[3] adapted from Poister and Streib (1999). A number of questionnaire
items were also relevant in analyses of PM use in other studies (Wang and Berman, 2001;
Cavalluzzo and Ittner, 2004; Hildebrand and McDavid, 2011). The questionnaire was
answered by 72 local governments, 30 of which (Appendix) had some kind of experience
in PM development; the other 42 did not use performance indicators. Therefore, the
response rate for the target population was 50 percent (72/144), an average response rate
for survey studies in management accounting (Nazari et al., 2006)[4]. The respondent
municipalities include all the big Spanish cities and represent 22.9 percent of the total
inhabitants of Spain and 25.86 percent of Spanish local government expenditure.
The questionnaire is divided into five blocks: block A collects background
information and is common across all the local governments analysed; blocks B to E
refer exclusively to the local governments with centralized citywide PM systems. The
questionnaire was addressed to the expert manager or technical staff in charge of PM
development in each local government, as identified in the exploratory phone contact.
The survey included questions about the background of the municipality and the
development, operation, and outcomes of PM. The municipalities also indicated the
services with performance information and the kind of performance indicator used. Data
sources were triangulated. We requested and obtained access to data on performance
indicators published in the notes to the financial statements of each local government in
order to assess their consistency with the answers to our survey. We also carried out an
analysis of the 144 local governments web sites[5] and found that only 6.2 percent of the
local governments (nine of them) had published their performance indicators there.
Univariate analysis and Cronbachs a were applied to analyse the data collected.
Cronbachs a is based on the average correlation among the items and tests the
reliability and/or consistency of multi-item variables or blocks of questions. It ranges
BJM from 0 to 1, with 0.60 and 0.70 deemed the lowest levels of acceptability[6]. Cronbachs
7,4 a is often used as the primary method of assessing survey instrument reliability and
validity (Nazari et al., 2006). We have applied non-parametric tests (Mann-Whitney) to
examine whether municipality size and political orientation influence the use of PM[7].
3.3 Results
420 3.3.1 Use and context of PM. Table I shows the number of respondent municipalities
that agreed with the statements in the background section of the survey (block A of the
questionnaire). Respondents were asked to describe their motivations in implementing
PM. The most highly ranked was the desire to make better management decisions
(83.3 percent). This result conforms to the NPM doctrine highlighting the need to
implement PM to improve the efficiency of public service delivery. It is also consistent
with the answers to the question about PMs primary audience, in which department
and program heads (76.7 percent) took the highest ranking.
Downloaded by Carleton University At 05:43 30 January 2016 (PT)
The item that attained the second highest score on the question about motivation
(pressure from elected city officials [43.3 percent]) addresses politicians interest in PM.
This is also consistent with the answers about PMs primary audience, in which the
Mayor scores 70 percent and the council members 60 percent, suggesting that
politicians seem to play an important role in non-mandatory implementation processes.
These results do not confirm the findings of Pollitt (2006), who argues that elected
representatives have apparently taken little interest in PM even though they have
become almost universal.
Cities %
Motivations to implement PM
The desire to make better management decisions 25 83.3
Citizen demands for greater a ccountability 7 23.3
Pressure from elected city officials 13 43.3
Recommendations or best practices 6 20
Primary audience for PM reports
City manager, chief administrative officer or other executive staff 13 43.3
Mayor or professional staff in the mayors office 21 70
City council members 18 60
Department heads, program managers, other line managers 23 76.7
Budget officials, personnel officials, other professional staff 13 43.3
State and federal funding agencies 5 16.7
Citizen advisory boards or groups 6 20
Other: (citizenry, etc.) 5 16.7
Frequency of the distribution of performance information to the users
Monthly 8 26.7
Quarterly 12 40
Annually 23 76.7
Do you conduct a comprehensive citizen survey every year? 10 33% every year
6.7% every two
2 years
Have data from your PM system led to decisions to privatize or to
externalize some of your operations? 6 20
Table I.
Background information Note: n30 local governments
The information is usually provided annually (76.7 percent) or quarterly (40 percent), too Non-mandatory
seldom for use in daily decision-making; thus, the most common use of PM in local PM in local
governments is in planning and strategic management, as is confirmed by the answers in
Table II. The frequency of PM provision and the primary audience scores show that PM are governments
more useful to top managers (e.g. department heads, city managers) than to medium- and
street-level managers (e.g. budget officials, personnel officials, and other professional staff).
The citizen demands for greater accountability item is cited as a motivation for PM 421
implementation by 23.3 percent of interviewees. Though greater accountability is not
usually directly required by citizens, it expresses a desire to address a formal and
democratic principle.
Municipalities were also asked whether they conducted a comprehensive citizen
survey every year. Ten of 30 municipalities answered positively, and another two
reported that they conducted a citizen survey every two years. In both cases, the
information obtained was taken into account in later PM developments.
Downloaded by Carleton University At 05:43 30 January 2016 (PT)
Mean SD
B. How important are PM to the following management processes in your city? (1 very important; 2
important; 3 somewhat important; 4 not at all important)
Personnel-oriented processes, such as management by objectives or appraisal by
objectives 2.44 1.031
Performance-oriented budgeting processes, such as program budgeting, target-based
budgeting or results-oriented budgeting systems 1.65 0.862
Strategic management processes, such as tracking the progress of strategic initiatives,
monitoring the achievement of strategic goals and objectives or measuring
performance in key results areas 1.73 0.961
Benchmarking of city departments and services against other, similar cities 2.20 1.014
Incentive systems such as pay-for-performance, shared savings or gain-sharing
programs 2.76 0.970
Cronbachs a for section B: 0.927
C1. The development of PM. To what extent do the following statements describe how PM are developed
in your city? (1 usually; 2 sometimes; 3 seldom; 4 never)
We involve managers in the development of performance measures 1.56 0.705
We involve citizens and/or citizens groups in the development of performance
measures 3.19 0.750
Data from citizen surveys help to determine criteria to include in our measurement
system 2.21 1.051
We involve lower-level employees in the development of performance measures 2.28 0.958
Cronbachs a for section C1: 0.599
C2. To what extent do the following statements describe how PM are developed in your city? (1 usually;
2 sometimes; 3 seldom; 4 never)
We have trouble getting the city council to support our performance measurement
system 2.71 0.89 Table II.
We have trouble getting lower-level employees to support our performance Background information
measurement system 2.33 1.113 and the development of
We have trouble getting citizens to support our performance measurement system 3.00 1.044 performance measures
Cronbachs a for section C2: 0.764 (for users with
centralized, city-wide
Note: n 18 local governments systems)
BJM had used this information in privatization initiatives, especially for services without
7,4 social added value such as garbage collection and street cleaning. Garbage collection,
urban transport, water supply, and street cleaning are often outsourced by Spanish local
governments in any case, although the lack of comparable PM disclosures in almost all
Spanish local governments makes benchmarking difficult.
Blocks B, C, D, and E, designed for local governments with centralized, city-wide PM
422 systems, were filled in by the 18 local governments that reported having implemented
centralized systems. Block B deals with the importance of performance indicators to
the citys management processes, such as management by objectives, strategic
planning, benchmarking, and incentive systems. According to our respondents,
performance-oriented budgeting processes and strategic management processes are
the activities for which performance indicators are considered most important, followed
by benchmarking. Local governments prefer not to use PM for pay-for-performance
programs or personnel oriented processes. According to the OECD (2005), countries
Downloaded by Carleton University At 05:43 30 January 2016 (PT)
indicated that they experienced difficulties in measuring the quality of the programs
and services and in keeping PM updated.
Block E of the survey studies PM outcomes (Table IV). The local governments
studied had a positive overall opinion of the implementation experience, of the
improvements in the quality of decisions and services, and in the accountability of
individual managers. The lowest scores for PM outcomes concerned the measurement of
personnel. The results in this table reveal the problems associated with using PM
Mean SD
4. Discussion
The questionnaire results show that the motivations for introducing PM seem to fall into
424 two categories. The intra-organizational determinants of PM focus on the improvement
of efficiency and effectiveness, basically from economic and rational decision-making
perspectives: many local governments agree that PM helps produce better decisions
and report observable improvements in their decision-making quality. The
extra-organizational determinants of PM are based on the idea that organizations adapt
their structures and processes to external demands and expectations (as institutional
theory posits), to pressure from elected officials, and for greater accountability.
From the information in Tables I to IV, it is possible to extract answers to the research
Downloaded by Carleton University At 05:43 30 January 2016 (PT)
questions about how PM are implemented and how Spanish local governments use it.
Analysis reveals the important involvement of managers and the low involvement of
medium- and street-level staff in PM implementation. Therefore, it seems that local
governments have followed a top-down approach in their PM implementation. This is
consistent with the use of PM in budgeting and strategic management and the
identification of Mayors and heads of departments and programs as the primary
audience for PM information, since planning and other long-term decisions are usually
the top managers responsibilities. The low involvement of medium- and street-level
staff makes introducing pay-for-performance more difficult and reduces the impact of
PM in daily decision-making, which could decouple PM systems from traditional work
routines and procedures, as institutional theory asserts. On the other hand, designing
PM through a top-down approach in each local government makes it easier to align PM
with the mission, objectives, and accountability policies of the whole entity and with its
long-term budgetary and strategic management decisions.
The agency theory does not fully explain PM implementation in non-mandatory
cases because the decision to implement PM is taken by local politicians (the agent) and
not by the central government (the principal). For institutional theory, non-mandatory
implementation results from a local governments wish to imitate the public
management reforms implemented by other local governments with good managerial
reputations in order to improve the performance and/or image of the city.
The Matland theory of conflict and ambiguity helps explain the choice of a
non-mandatory approach in Spain. Ambiguity has been the main method of limiting
conflicts in Spain. Instead of using clear guidelines and procedures in its PM design and
coercion in ensuring proper implementation, Spains central government has adopted a
policy that minimizes the potential for conflict arising from the political autonomy of
Spains Mayors, the special status of its civil servants, and its powerful public sector
unions. Spains approach can be considered experimental because its PM
implementation policy has been to avoid conflicts with and within local governments
by giving them the option of designing and disclosing such non-financial PM as they have.
The result is minimized conflict but also a low comparability with other local governments
and difficulties in assessing the real impact of PM initiatives. Since the non-mandatory
system and the special status of public sector employees are common among most EU
bureaucratic public administration styles (both Napoleonic and Germanic), the Spanish
case could shed light on other PM implementation processes with similar administrative Non-mandatory
and contextual features. Meanwhile, local governments consider the results of their PM PM in local
implementations satisfactory, since block E reports moderate improvements in service
decision-making, and manager accountability quality, which could provide the starting governments
point for extending PM to lower organizational levels.
Alternative systems, such as in the UK and Australia, do not seem to offer the best PM
introduction methods. These mandatory PM systems are not used by managers because 425
they are not aligned with managerial objectives (Wilson, 2005). Managers complain
about the imposition of PM and are reluctant to disclose the measures they use in their
decision-making. Thus, it is unclear whether a mandatory or non-mandatory system is
more effective in PM implementation and disclosure in local governments.
5. Conclusions
The survey results allow us to conclude that the implementation of PM in Spain
Downloaded by Carleton University At 05:43 30 January 2016 (PT)
follows a top-down approach in which each local government can choose whether to
implement PM, how to conduct the implementation, and what information to disclose.
The primary use of PM by local Spanish governments is in planning and long-term
budgetary and strategic management decision-making rather than in daily work
routines and procedures or linking pay to performance.
Performance measurement information in non-mandatory systems could enhance top
managements awareness of organizational strengths and weaknesses and indicate
activity areas requiring improvement, since PM information is addressed to Mayors and
heads of departments and programs. By contrast, non-mandatory systems usually
disclose less PM information than do mandatory systems such as the UKs and Australias.
Choosing non-mandatory systems has given politicians and top managers the
freedom to design PM systems that fit the traditional organizational structure of each
local government. This prevents internal conflicts and facilitates the introduction of
PM but also makes benchmarking across cities difficult because the performance
indicators are not always disclosed and are not comparable when they are disclosed.
How to combine the external and internal uses of PM is a significant globally relevant
question. Systems using mandatory measures and standardized guidelines and
non-mandatory systems both fail to overcome the decoupling effect. When PM are
mandatory, managers claim it is not useful in managerial decision-making and are
reluctant to disclose the measures they use. When PM are non-mandatory, managers
disclose some of their measures, but these are not comparable across cities. The
mismatch between external and internal uses remains in both the Anglo-Saxon and
continental systems. Thus, academics and (especially) practitioners face the global
challenge of strengthening the link between the PM disclosed and the performance
information used in decision-making both at the strategic and budgetary level and
day-to-day decision-making levels.
Notes
1. This is the case in The Netherlands, with the Public Management Initiative (ter Bogt and
van Helden, 2000) and the new Governments Accounts Act, 2004, in Portugal, with the Local
Government Chart of Accounts (2002; Carvalho et al., 2006), in Spain, with the Local
Government Chart of Account (2004), and in Italy, with the Testo unico delle leggi
sullordinamento degli enti local (2000; Mussari, 2005).
BJM 2. Orden EHA 4041/2004 of 23rd November.
7,4 3. During the phone calls, 42 municipalities stated that they were not familiar with PM, and no
further contact was made; seven answered by email, stating they did not have a performance
indicator system. Others preferred to read the survey to see if they were able to answer it.
4. If the 42 cases with no PM experience were eliminated, the response rate would be 30 percent
(30/(144 2 42)). Of the 72 local governments that did not respond to the questionnaire
426 (144 2 72), it is believed that many would not use PM, so the number of completed
questionnaires (30) could be considered near the average response rate indicated in the
literature.
5. The analysis of the local government web sites was carried out in May 2009 and November 2011.
6. The common threshold value is 0.70, but values below 0.70 are acceptable when the research
is exploratory in nature (Hair et al., 1995).
7. Some studies (Berman and Wang, 2000; Moynihan and Ingraham, 2004) have shown that
Downloaded by Carleton University At 05:43 30 January 2016 (PT)
larger municipalities have been associated with PM use because they generally have more
resources and staff with which to implement PM systems. Regarding political orientation,
Moynihan and Ingraham (2004) found that relatively liberal US governments were more
successful at incorporating performance information in executive branch decisions.
8. However, Pollanen (2005) found that Canadian municipalities developed and used more
efficiency measures than effectiveness measures for most services.
References
Ammons, D.N. and Rivenbark, W.C. (2008), Factors influencing the use of performance data to
improve municipal services: evidence from the North Carolina benchmarking project,
Public Administration Review, Vol. 68 No. 2, pp. 304-18.
Askim, J. (2007), How do politicians use performance information? An analysis of the
Norwegian local government experience, International Review of Administrative Sciences,
Vol. 73 No. 3, pp. 453-72.
Barrett, S.M. (2004), Implementation studies: time for a revival? Personal reflections on 20 years
of implementation studies, Public Administration, Vol. 82 No. 2, pp. 249-62.
Berman, E. and Wang, X. (2000), Performance measurement in US counties: capacity for
reform, Public Administration Review, Vol. 60 No. 5, pp. 409-20.
Carvalho, J., Jorge, S. and Fernandes, M.J. (2006), New local government accounting in Portugal,
Public Money & Management, Vol. 26 No. 4, pp. 211-16.
Cavalluzzo, K.S. and Ittner, C.D. (2004), Implementing performance measurement innovations:
evidence from government, Accounting, Organizations and Society, Vol. 29 Nos 2/3, pp. 243-67.
Christensen, T. and Laegreid, P. (Eds) (2001), New Public Management: The Transformation of
Ideas and Practice, Ashgate, Aldershot.
de Lancer Julnes, P. and Holzer, M. (2001), Promoting the utilization of performance measures in
public organizations: an empirical study of factors affecting adoption and
implementation, Public Administration Review, Vol. 61 No. 6, pp. 683-708.
DiMaggio, P.J. and Powell, W. (1983), The iron cage revisited: institutional isomorphism and
connective rationality in organisational fields, American Sociological Review, Vol. 48, pp. 147-60.
Hair, J.F., Anderson, R.E., Tatham, R.L. and Black, W. (1995), Multivariate Data Analysis with
Readings, Prentice-Hall, London.
Halachmi, A. (2005), Performance measurement: test the water before you dive in, International
Review of Administrative Sciences, Vol. 71 No. 2, pp. 255-66.
Hildebrand, R. and McDavid, J.C. (2011), Joining public accountability and performance management: Non-mandatory
a case study of Lethbridge, Alberta, Canadian Public Administration, Vol. 54 No. 1, pp. 41-72.
PM in local
Ho, A.T.-K. (2006), Accounting for the value of performance measurement from the perspective
of Midwestern Mayors, Journal of Public Administration: Research and Theory, Vol. 16 governments
No. 2, pp. 217-37.
Lapsley, I. and Wright, E. (2004), The diffusion of management accounting innovations in the
public sector: a research agenda, Management Accounting Research, Vol. 15 No. 3, pp. 355-74. 427
Lee, J., Perara, H. and Rahman, A. (2006), The grounded theory: a theory discovery method for
accounting research, in Hoque, Z. (Ed.), Methodological Issues in Accounting Research:
Theories, Methods and Issues, Spiramus Press, London, pp. 129-60.
Letza, S.R., Smallman, C. and Sun, X. (2004), Reframing privatisation: deconstructing the myth
of efficiency, Policy Sciences, Vol. 37 No. 2, pp. 159-83.
Matland, R.E. (1995), Synthesizing the implementation literature: the ambiguity-conflict model
of policy implementation, Journal of Public Administration Research and Theory, Vol. 5
Downloaded by Carleton University At 05:43 30 January 2016 (PT)
428 Appendix
Madrid 3,213.271 Chief of the Budgetary Office and the Head of the
Quality and Citizen Service Department
Barcelona 1,615.908 Chief of Management Control Services
Sevilla 699,759 An official of the Budgetary Office
Downloaded by Carleton University At 05:43 30 January 2016 (PT)
Corresponding author
Vicente Pina can be contacted at: vpina@unizar.es
1. Bndicte Buylen, Johan Christiaens. 2015. Talking Numbers? Analyzing the Presence of Financial
Information in Councilors Speech During the Budget Debate in Flemish Municipal Councils.
International Public Management Journal 1-23. [CrossRef]
2. Francesca Manes Rossi, Natalia Aversano. 2015. Advancing performance measurement. International
Journal of Productivity and Performance Management 64:1, 76-93. [Abstract] [Full Text] [PDF]
Downloaded by Carleton University At 05:43 30 January 2016 (PT)