Sunteți pe pagina 1din 51

2006

Resource
Centre
European Institute of
Public Administration
The Common Assessment Framework (CAF)
Improving an organisation through self-assessment

CAF 2006

Index
Introduction .................................................................................................................. 2

Enablers Criteria ........................................................................................................... 7


Criterion 1: Leadership .................................................................................................. 8
Criterion 2: Strategy and planning .............................................................................. 10
Criterion 3: People ...................................................................................................... 12
Criterion 4: Partnerships and resources ....................................................................... 14
Criterion 5: Processes .................................................................................................. 16

Results Criteria ........................................................................................................... 19


Criterion 6: Citizen/customer-oriented results ............................................................. 20
Criterion 7: People results ........................................................................................... 21
Criterion 8: Society results ........................................................................................... 22
Criterion 9: Key performance results ........................................................................... 23

CAF Scoring and assessment panels ........................................................................... 24

Guidelines for improving organisations using CAF ..................................................... 30

Bench learning ........................................................................................................... 40

Glossary ................................................................................................................... 43
Introduction e-tools, brochures, CAF users’ events and CAF data
bases. All these activities assure all the CAF actors in-
volved that the target of 2000 registered CAF users in
Definition 2010 – set by the United Kingdom presidency – will
The Common Assessment Framework (CAF) is a To- be met.
tal Quality Management (TQM) tool inspired by the
Excellence Model of the European Foundation for The Ministers responsible for Public Administration in
Quality Management (EFQM) and the model of the the European Union expressed at the end of the Lux-
German University of Administrative Sciences in embourg presidency on 8 June 2005 their apprecia-
Speyer. It is based on the premise that excellent results tion for the fruitful exchange of ideas, experiences and
in organisational performance, citizens/customers, good/best practices between the Public Administrations
people and society are achieved through leadership of the EU Member states within the European Public
driving strategy and planning, people, partnerships Administration Network (EPAN) and for the develop-
and resources and processes. It looks at the organisa- ment and use of tools such as the Common Assess-
tion from different angles at the same time, the holistic ment Framework. They asked to integrate even more
approach of organisation performance analysis. the quality approach with the Lisbon agenda. The CAF
2006 revision has taken this demand into account.
Origin and growth
The CAF is a result of co-operation among the EU Main purpose and support
Ministers responsible for Public Administration. The CAF is offered as an easy to use tool to
It is jointly developed under the aegis of the assist public sector organisations across Europe
Innovative Public Services Group (IPSG), a working to use quality management techniques to improve
group of national experts set up by the Directors- performance. The CAF provides a self-assess-
General (DG) in order to promote exchanges and ment framework that is conceptually similar to the
cooperation where it concerned innovative ways of major TQM models, EFQM in particular, but is
modernising government and public service specially conceived for the public sector organisations,
delivery in EU Member States. taking into account their differences.

A pilot version was presented in May 2000 and The CAF has four main purposes:
a first revised version was launched in 2002. 1. To introduce public administration to the principles
A CAF Resource Centre CAF (RC) was created at the of TQM and progressively guide them, through the
European Institute of Public Administration (EIPA) use and understanding of self-assessment, from
in Maastricht following the decision of DGs in the current “Plan-Do” sequence of activities to a
charge of public service. In a strategic state- full fledged “Plan-Do-Check-Act (PDCA)” cycle;
ment, EIPA pointed out how it wants to play its role 2. To facilitate the self-assessment of a public organi-
as a European CAF Resource Centre and what its sation in order to obtain a diagnosis and improve-
objectives are in this respect. ment actions;
3. To act as a bridge across the various models used
Together with the network of national CAF correspond- in quality management;
ents, assisted by the European Foundation for Quality 4. To facilitate bench learning between public sector
Management (EFQM) and the University of Speyer, the organisations.
CAF RC coached the implementation of the model in
many ways and evaluated its use. Between 2000 and A number of components have been worked out in
2005 ca. 900 European public administrations used the support of these purposes and are explained in this
CAF to improve their organisations. Also from outside brochure: the structure with 9 criteria, 28 sub crite-
Europe there is a lot of interest in using the tool e.g. from ria with examples; assessment panels for the enablers
China, Middle East, Dominican Republic and Brazil. and the results, guidelines for self-assessment, im-
More than 300 CAF users met at the 1st and 2nd provement actions and bench learning projects and
European CAF Users Events in Rome in 2003 a glossary.
and in Luxembourg in 2005. Two studies by EIPA,
established in the context of these events, give detailed Target organisations
information on the use of CAF in Europe and they in- The CAF has been designed for use in all parts of the
spired the CAF 2006 revision. A database on CAF ap- public sector, applicable to public organisations at the
plications is being further developed at EIPA, allowing national/federal, regional and local level. It may also
integrating good practices in public administrations be used under a wide variety of circumstances e.g. as
from all over Europe and maybe wider. A CAF e-tool part of a systematic programme of reform or as a ba-
will be soon fully available for the CAF community. The sis for targeting improvement efforts in specific public
CAF website gives all the available information on the service organisations. In some cases, and especially in
European level. The model is now translated in 19 lan- very large organisations, a self-assessment may also
guages. But also on the national level, many countries be undertaken in part of an organisation e.g. in a se-
developed CAF support structures including training, lected section or department.

2
Customisation of the tool The CAF provides:
As CAF is a generic tool, the customisation of its – an assessment based on evidence, against a set of
use can be recommended but respecting its ba- criteria which has become widely accepted across
sic elements is compulsory: the 9 criteria, 28 sub the public sector in Europe;
criteria and the scoring system. Examples and the – opportunities to identify progress and outstanding
process of self-assessment as described in the guide- levels of achievement;
lines are free/flexible but it is recommended to take – a means to achieve consistency of direction
into account the key elements of the guidelines. and consensus on what needs to be done to
improve an organisation;
Structure – a link between the different results to be achieved
The structure of the CAF is illustrated below: and supportive practices or enablers;

4HE#!&-ODEL
%.!",%23 2%35,43

0EOPLE 0EOPLE2ESULTS

#ITIZEN#USTOMER +EY
,EADERSHIP 3TRATEGY 0ROCESSES 0ERFORMANCE
/RIENTED
0LANNING 2ESULTS
2ESULTS

0ARTNERSHIP 3OCIETY
2ESOURCES 2ESULTS

)../6!4)/.!.$,%!2.).'

Based on the EFQM-Model

The nine-box structure identifies the main aspects re- – a means to create enthusiasm among employees
quiring consideration in any organisational analysis. by involving them in the improvement process;
Criteria 1-5 deal with the Enabler features of an or- – opportunities to promote and share good practice
ganisation. These determine what the organisation within different areas of an organisation and with
does and how it approaches its tasks to achieve the other organisations;
desired results. In the criteria 6-9, results achieved in – a means to integrate various quality initiatives into
the fields of citizens/customers, people, society and normal business operations;
key performance are measured by perception meas- – a means of measuring progress over time through
urements and internal indicators are evaluated. Each periodic self-assessment.
criterion is further broken down into a list of sub cri-
teria. The 28 sub criteria identify the main issues that Concepts and Values of CAF
need to be considered when assessing an organisa- As a tool of Total Quality Management, CAF sub-
tion. They are illustrated by examples that explain the scribes to the fundamental concepts of excellence as
content of the sub criteria in more detail and suggest defined by EFQM: results orientation, customer focus,
possible areas to address, in order to explore how the leadership and constancy of purpose, management by
administration answers the requirements expressed in processes and facts, involvement of people, continu-
the sub criterion. ous improvement and innovation, mutually beneficial
partnerships and corporate social responsibility. It aims
Main characteristics to improve the performance of public organisations on
Using the CAF provides an organisation with a power- the basis of these concepts.
ful framework to initiate a process of continuous im-
provement. Public management and quality in the public sector
have a number of special unique conditions in com-
parison with the private sector. They presume basic
preconditions, common to our European socio-politi-

3
cal and administrative culture: legitimacy (democratic, Cross connection between criteria and sub criteria on the
parliamentary), the rule of law and ethical behaviour enabler side: since quality of results is to a large extent
based on common values and principles such as open- determined by the type and intensity of relationships
ness, accountability, participation, diversity, equity, so- between enablers, this type of relationship must be ex-
cial justice, solidarity, collaboration and partnerships. plored in self-assessment. In fact their intensity is very dif-
ferent between different organisations and their nature
Although CAF primarily focuses on the evaluation of determines to a large extent the quality of the organisa-
performance management and the identification of its tion. Excellent organisations are, for example, charac-
organisational causes to make improvement possible, terised by strong interactions between criterion 1 and
contributing to good governance is the ultimate goal. criteria 2/3/4, and between 3 and 4/5. Relationships
are obviously not limited to the criteria level. Quite of-
So the assessment of performance addresses the fol- ten substantial interaction/relationships materialise at
lowing main features of a public sector organisation: sub criterion level.
– democratic responsiveness/accountability;
– operating within the legislative, legal and regula- Importance of evidence and measurements
tory framework; Self-assessment and improvement of public organi-
– communicating with the political level; sations is very difficult without reliable information
– involvement of stakeholders and balancing of across the different functions of the organisation. CAF
stakeholder needs; stimulates public sector organisations to gather and
– excellence in service delivery; use information but very often this information is not
– value for money; available at a first self-assessment. This is why CAF
– achievement of objectives; often is considered to be a zero base measurement. It
– management of modernisation, innovation and indicates the areas in which it is essential to start meas-
change. uring. The more an administration progresses towards
continuous improvement the more it will systematically
Cross functions inside the model and progressively collect and manage information, in-
The holistic approach of TQM and CAF does not sim- ternally and externally.
ply mean that all aspects of the functioning of an or-
ganisation are carefully assessed but also that all the Role of the scoring system
composing elements have a reciprocal impact on each One of the compulsory elements of the CAF is the scor-
other. A distinction should be made between ing system. Although the discovery of strengths and
– cause-effect relationship between the left part of areas for improvement and the linked improvement
the model (the enablers-causes) and the right part actions are the most important outputs of the self-as-
(the results-effects), and sessment, organisations sometimes focus too much
– the holistic relationship between the causes (ena- on scores. The scoring system has been retained and
blers). elaborated in the new CAF version.

Only to the latter can the holistic character be Allocating a score to each sub criterion and criterion of
applied. the CAF model has 4 main aims:
1. to give an indication on the direction to follow for
Cross connection between the left and right parts of the improvement activities;
model: consists in the cause-effect relation between the 2. to measure your own progress;
enablers (causes) and the results (effects), as well as 3. to identify good practices as indicated by high
in the feedback from the latter to the former. Verifica- scoring for Enablers and Results;
tion of cause-effect links is of fundamental importance 4. to help to find valid partners to learn from.
in self-assessment, where the assessor should always
check for consistency between a given result (or set of New in the CAF 2006 is the provision for two ways
homogeneous results) and the “evidence” collected on of scoring. The “classical CAF scoring” and the “fine-
the relevant criteria and sub criteria on the enabler tuned CAF scoring”. More information is given in the
side. Such consistency is sometimes difficult to verify, chapter on scoring.
since due to the holistic character of the organisation,
the different causes (enablers) interact with each other Managerial language and the glossary
when producing results. In any case, the existence of Many public sector organisations, that use CAF
appropriate feedback, from results appearing on the for the first time, are confronted with a terminol-
right side to the appropriate criteria on the left side, ogy that is difficult to access. A background in pub-
should be checked in the assessment. lic management helps of course to overcome this
but some people participating at a CAF self-assess-
ment may not have this background. The glossary
at the end of this brochure is there to assist them by
providing a more precise definition for the main words
and concepts.

4
Given the nature of “clients” in the public sector howev- The guidelines on self-assessment and improvement
er, we wish to define from the start what we understand action plans give additional advice.
by citizen/customer. This term is used to emphasise the
dual relationship between public administration and The recent success of bench learning with CAF has in-
– the users of public services, and spired new guidelines in this field.
– all the members of the public, who as citizens and
taxpayers have a stake in the services provided To summarise, self-assessment against the CAF model
and their outputs. offers the organisation an opportunity to learn more
about itself. Compared to a fully developed Total Qual-
Major differences between CAF 2002 and ity Management model, the CAF is designed to be a
2006 user-friendly introductory model. It is assumed that any
Users of previous CAF versions will not find it too dif- organisation that intends to go further will select one
ficult to find their way in the new version. of the more detailed models. The CAF has the advan-
tage of being compatible with these models and may
In the context of the Lisbon strategy more emphasis is therefore be a first step for an organisation wishing to
placed on modernisation and innovation. This concern go further with quality management.
is therefore more explicitly present in the criteria on
leadership and strategy whilst the need for permanent We know that “CAF Works”!
innovation of the processes is presented in criterion 5.
The CAF is in public domain and free of charge. Or-
The introduction and many new formulated examples ganisations are free to use the model as they wish.
better illustrate the contribution of quality manage-
ment in the public sector towards good governance.
The scoring system allows organisations to deepen
their assessment knowledge and focus more closely
on their improvement actions.

5
Enablers

Criteria 1-5 deal with the Enabler features of an organisation. These determine what the organisation does and
how it approaches its tasks to achieve the desired results. The assessment of actions relating to the Enablers
should be based on the Enablers Panel (see CAF scoring and Assessment panels).

7
Criterion 1: Leadership understanding of who their customers are, their re-
quirements, and how these can be balanced with po-
litical imperatives, demonstrating clear commitment to
Definition citizens/customers, as well as to other stakeholders.
The behaviour of an organisation’s Leaders can
help to create clarity and unity of purpose and
an environment in which the organisation and its Assessment: Consider the evidence of what the
people excel. organisation’s leadership is doing to:

Leaders provide direction for the organisa- 1.1. Provide direction for the organisation by
tion. Leaders develop the mission, vision and the developing its mission, vision and val-
values required for the organisation’s long-term suc- ues.
cess. They motivate and support people in the or-
ganisation by acting as role models and through Examples:
appropriate behaviours which are consistent with the a. Formulating and developing the mission (what our
expressed and implied values. goals are) and the vision (where we want to go)
of the organisation involving relevant stakeholders
Leaders develop, implement, and monitor the and employees.
organisation’s management system and review per- b. Translating the mission and vision into strategic
formance and results. They are responsible for im- (long-term and medium-term) and operational
proving performance and prepare for the future by or- (concrete and short-term) objectives and actions.
ganising the changes necessary to deliver its mission. c. Establishing a value framework, including in it
transparency, ethics and citizen service, and a
In the public sector, leaders are the main interface be- code of conduct involving stakeholders.
tween the organisation and politicians and manage d. Strengthening of mutual trust and respect between
their shared responsibilities and are also responsible leaders/managers/employees (e.g. defining
for managing relationships with other stakeholders norms of good leadership).
and ensuring that their needs are met. e. Creating conditions for effective communication.
Ensuring the wider communication of the mission,
Key implications vision, values, strategic and operational objectives
In a representative democratic system, elected politi- to all employees in the organisation and to other
cians make the strategic choices and define the goals stakeholders.
they want to achieve in the different policy areas. The f. Reviewing periodically the mission, vision and values
leadership of public sector organisations assists politi- reflecting changes in the external environment.
cians in formulating policy by giving advice in terms of g. Managing “conflicts of interest” by identifying po-
analysis, horizon-scanning, or visioning, and is also tential areas of conflicts of interest and providing
responsible for policy implementation and realisation. guidelines for employees.

Therefore a distinction needs to be drawn within the Award a score using the Enablers Panel
public sector between the role of the political leader-
ship and that of the leaders/managers of organisa-
tions. The CAF focuses on the management of public 1.2. Develop and implement a system for the
organisations rather than on the “quality“ of public management of organisation, perform-
policies which is a political responsibility. ance and change
Beside their proper values, European public sector or-
ganisations share a number of common values such Examples:
as the legality, transparency, equity, diversity and the a. Developing processes and organisational struc-
refusal of conflicts of interest. Leaders communicate tures in accordance with strategy, planning and
these values throughout the organisation and may needs and expectations of stakeholders using
translate them, for example, into codes of conduct that available technologies.
guide people’s professional behaviour. b. Defining appropriate management forms (levels,
functions, responsibilities and competencies) and
Leaders create the optimal conditions for their organi- ensuring a system for managing processes.
sation to adapt itself to the continuously changing so- c. Developing and agreeing on measurable objec-
ciety they serve. They are themselves looking for op- tives and goals for all levels of the organisation.
portunities to innovate and modernise. They actively d. Giving direction on output and outcome targets
integrate e-government approaches. balancing the needs and expectations of different
Leaders in public service organisations typically are re- stakeholders.
quired to work within allocated resources to achieve e. Formulating and aligning the net/e-gov strategy
goals and targets. This sometimes necessitates bal- with the strategic and operational objectives of the
ancing the needs of citizens, politicians and other organisation.
stakeholders. Therefore leaders need to show a clear f. Establishing a management information system
8
including internal audits. 1.4. Manage the relations with politicians
g. Establishing appropriate enablers/assumptions and other stakeholders in order to en-
(frameworks) for project management and team- sure shared responsibility
work.
h. Permanent application of TQM-system principles such Examples:
as the CAF Model or the EFQM Excellence Model. a. Identifying the public policies affecting the
i. Developing a system of measurable strategic and organisation.
operational goals/performance measuring in the b. Maintaining proactive and regular relations with
organisation (e.g. Balanced Scorecard). the political authorities of the appropriate execu-
j. Developing systems of quality management such tive and legislative areas.
as ISO 9001-2000, Service Level Agreements c. Ensuring that objectives and goals of the organi-
(SLAs) and different kinds of certification. sation are aligned with public policies.
k. Identifying and setting priorities for necessary d. Developing and maintaining partnerships and
changes regarding the organisational design and networks with important stakeholders (citizens,
business model. Non-Government Organisations (NGOs), interest
l. Communicating change initiatives and the reasons groups, industry and other public authorities).
for change to employees and relevant stakehold- e. Involving political and other stakeholders in the set-
ers. ting of output and outcome targets and the develop-
ment of the organisation’s management system.
Award a score using the Enablers Panel f. Seeking public awareness, reputation and recog-
nition of the organisation and its services.
g. Developing a concept of marketing (product and
1.3. Motivate and support people in the or- service targeted) and its communication in rela-
ganisation and act as a role model tion to stakeholders.
h. Taking part in the activities of professional asso-
Examples: ciations, representative organisations and interest
a. Leading by example thus acting in accordance groups.
with established objectives and values.
b. Demonstrating personal willingness of leaders/ Award a score using the Enablers Panel
managers to accept change by acting on construc-
tive feedback.
c. Keeping employees regularly informed about key
issues related to the organisation.
d. Supporting employees by helping them to car-
ry out their duties, plans and objectives in sup-
port of the achievement of overall organisational
objectives.
e. Stimulating, encouraging and creating conditions
for the delegation of authority, responsibilities and
competencies including accountability (empower-
ment).
f. Promoting a culture of innovation and improve-
ment by encouraging and supporting employees
to make suggestions for innovation and improve-
ment and to be proactive in their daily work.
g. Recognising and rewarding the efforts of teams
and individuals.
h. Respecting and addressing individual needs and
personal circumstances of employees.

Award a score using the Enablers Panel

9
Criterion 2: Strategy and planning 2.2. Develop, review and update strategy
and planning taking into account the
needs of stakeholders and available
Definition resources
The way an organisation effectively combines its inter-
related activities determines its overall performance. Examples:
The organisation implements its mission and vision a. Developing and applying methods to monitor,
via a clear stakeholder-focused strategy aligning pub- measure and/or evaluate the performance of the
lic policies/goals and other stakeholders needs, sup- organisation at all levels ensuring the monitoring
ported by a continuously improving management of of the strategy‘s implementation.
resources and processes. The strategy is translated b. Systematically reviewing risks and opportunities
into plans, objectives and measurable targets. Plan- (e.g. SWOT-analysis) and identifying critical suc-
ning and strategy reflects the organisation’s approach cess factors by regularly assessing these factors in
to implementing modernisation and innovation. the organisation’s environment (including political
changes).
Key implications c. Evaluating existing tasks in terms of outputs (re-
Strategy and planning is part of the PDCA (Plan Do sults) and outcomes (impacts) and the quality of
Check Act) cycle, starting by gathering information the strategic and operations plans.
on the present and future needs of stakeholders and d. Balancing tasks and resources, long and short
also from outcomes and results in order to inform the term pressures and stakeholder requirements.
planning process. This includes the use of reliable in- e. Assessing the need to reorganise and improve
formation, including perceptions from all stakeholders strategies and methods of planning.
to inform operational policies, planning and strategic
direction. Feedback from an internal review process is Award a score using the Enablers Panel
also fundamental to producing planned improvements
in organisational performance.
2.3. Implement strategy and planning in the
Identifying critical success factors – conditions that whole organisation
must be fulfilled to achieve strategic goals – and set-
ting goals plays a crucial part to ensure an effective Examples:
follow-up and measurement of the results. Goals need a. Implementing strategy and planning by reaching
to be formulated in such a way that a distinction is agreement and setting priorities, establishing time
made between outputs and outcomes. frames, appropriate processes and the organisa-
tional structure.
Organisations should consistently and critically moni- b. Involving stakeholders in the process of deploying
tor the implementation of their strategy and planning, strategy and planning and prioritising stakehold-
and update and adapt them whenever necessary. ers’ expectations and needs.
c. Translating strategic and operational objectives of
the organisation into relevant plans and tasks for
Assessment: Consider evidence of what the departmental units and individuals within the or-
organisation is doing to ganisation.

2.1. Gather information relating to the Award a score using the Enablers Panel
present and future needs of stakehold-
ers
2.4. Plan, implement and review modernisa-
Examples: tion and innovation
a. Identifying all relevant stakeholders.
b. Systematically gathering and analysing informa- Examples:
tion about stakeholders, their needs and expecta- a. Creating and developing a new culture/readiness
tions. for innovation by training, benchmarking, estab-
c. Regularly gathering and analysing information, lishment of learning laboratories, focusing on the
its source, accuracy and quality. This may include role of strategic thinking and planning.
information about important variables such as so- b. Systematic monitoring of internal indicators/driv-
cial, ecological, economic, legal and demograph- ers for change and external demands for mod-
ic developments. ernisation and innovation.
d. Systematically analysing internal strengths and weak- c. Planning of changes leading towards the process
nesses (e.g. TQM-diagnosis with CAF or EFQM or of modernisation and innovation (e.g. applying
SWOT analysis). net services) on the basis of discussions with stake-
holders.
Award a score using the Enablers Panel d. Integration of instruments and measures; e.g. in-
put + output + outcome – measurement; use of
10
TQM principles.
e. Ensuring the deployment of an efficient change
management system which includes the monitor-
ing of progress in innovation.
f. Ensuring the availability of necessary resources to
implement the planned changes.

Award score using the Enablers Panel

11
Criterion 3: People

Definition
People are the organisation. They are the organisa- Assessment: Consider evidence on what the
tion’s most important asset. The way in which employ- organisation is doing to
ees interact with each other and manage the available
resources ultimately decides organisational success. 3.1. Plan, manage and improve human
Respect, dialogue, empowerment and also providing resources transparently with regard to
a safe and healthy environment are fundamental to strategy and planning
ensure the commitment and participation of people on
the organisational route to excellence. The organisa- Examples:
tion manages, develops and releases the competences a. Regularly analysing current and future human re-
and full potential of its people at individual and organ- source needs, taking into account the needs and
isation-wide levels in order to support its strategy and expectations of stakeholders.
planning and the effective operation of its processes. b. Developing and communicating the human re-
sources management policy based on the strategy
Key implications and planning of the organisation.
Criterion 3 assesses whether the organisation aligns c. Ensuring HR capability (recruitment, allocation,
its strategic objectives with its human resources so that development) is available to achieve tasks and
they are identified, developed, deployed and cared balancing tasks and responsibilities.
for to achieve optimum utilisation and success. Con- d. Monitoring of invested human resources in pro-
sideration should be given to widening the scope of ducing and developing net services.
people management to the advantage of both the or- e. Developing and agreeing on a clear policy con-
ganisation and its people. People should be assisted taining objective criteria with regard to recruit-
to achieve their full potential. Taking care of people’s ment, promotion, remuneration, rewards and the
well-being is an important aspect of people manage- assignment of managerial functions.
ment. f. Ensuring good environmental working conditions
throughout the organisation including taking care
When organisations create frameworks to allow em- of health and safety requirements.
ployees to continually develop their own competen- g. Managing recruitment and career development
cies, to assume greater responsibility and to take more with regard to fairness of employment, equal op-
initiative, employees contribute to the development of portunities and diversity aspects (e.g. gender, sexual
the workplace. This can be enabled by making sure orientation, disability, age, race and religion).
they associate their own performance goals with the h. Ensuring that conditions are conducive towards
strategic objectives of the organisation and also by in- achieving a reasonable work-life balance for em-
volving them in the establishment of policies related to ployees.
the recruitment, training, and reward of people. i. Paying particular attention to the needs of
disadvantaged employees and people with
Finally, criterion 3 spotlights the ability of managers/ disabilities.
leaders and employees to actively cooperate on devel-
oping the organisation, breaking down organisational Award score using the Enablers Panel
silos by creating dialogue, making room for creativity,
innovation and suggestions for improving perform-
ance. This also helps to increase employee satisfac- 3.2. Identify, develop and use competencies
tion. of employees, aligning individual and
organisational goals
The proper execution of people policies is not just of
concern to the HR department, it depends upon all Examples:
leaders, managers and department heads throughout a. Identifying current competencies at the individual
the organisation, demonstrating that they care about and organisational levels in terms of knowledge,
people issues and they actively promote a culture of skills and attitudes.
open communication and transparency. b. Discussing, establishing and communicating a
Organisations may, in assessing their performance, strategy for developing competencies. This in-
take account of any restrictions on their freedom of cludes an overall agreed training plan based on
action resulting from national/general public person- current and future organisational and individual
nel policies, pay policies, etc., and indicate how they needs (with for example distinctions between man-
work within these restrictions to optimise their people’s datory and optional training programmes).
potential. c. Developing and agreeing on personal training
and development plans for all employees with a
special emphasis on managerial, leadership, abil-
ities to deal with diverse customers/citizens and
12
partners. This may also include skills training for
the providing of net services.
d. Developing managerial and leadership skills as
well as relational competences of management
regarding the people of the organisation, the citi-
zens/customers and the partners.
e. Supporting and assisting new employees (e.g. by
means of mentoring, coaching, tutoring).
f. Promoting internal and external mobility of
employees.
g. Developing and promoting modern training meth-
ods (e.g. multimedia approach, on the job train-
ing, e-learning).
h. Planning of training activities and developing
communication techniques in the areas of risk and
conflict of interest management.
i. Assessing the impacts of training and develop-
ment programmes in relation to the costs of the
activities through monitoring and the provision of
cost/benefit analyses.

Award a score using the Enablers Panel

3.3. Involve employees by developing open


dialogue and empowerment

Examples:
a. Promoting a culture of open communication and
dialogue and the encouragement of team work-
ing.
b. Proactively creating an environment for gain-
ing ideas and suggestions from employees and
developing appropriate mechanisms (e.g. sugges-
tion schemes, work groups, brainstorming).
c. Involving employees and their representatives in
the development of plans, strategies, goals, the
design of processes and in the identification and
implementation of improvement activities.
d. Seeking agreement/consensus between managers
and employees on goals and on ways of measur-
ing goal achievement.
e. Regularly conducting staff surveys including pub-
lishing results/summaries/interpretations.
f. Ensuring the employees have an opportunity to
give feedback on their line managers/directors.
g. Consulting with the representatives of employees
(e.g. Trade Unions).

Award a score using the Enablers panel

13
Criterion 4: Partnerships and resources The organisation should also ensure that it shares criti-
cal information and knowledge with key partners and
other stakeholders according to their needs.
Definition
How the organisation plans and manages its key part-
nerships – especially with citizens/customers – in order Assessment: Consider evidence on what the
to support its strategy and planning and the effective organisation is doing to
operation of its processes. In this way partnerships are
important resources for the well-functioning of the or- 4.1. Develop and implement key partnership
ganisation. relations

Next to partnerships, organisations need the more Examples:


traditional resources – such as finances, technology, a. Identifying potential strategic partners and the na-
facilities – to assure their effective functioning. These ture of the relationship (e.g. purchaser-provider,
are used and developed to support an organisation’s co-production, net services).
strategy and its most important processes in order to b. Establishing appropriate partnership agreements
achieve the organisation’s goals in the most efficient taking into account the nature of the relation-
way. Presented in a transparent way, organisations ship (e.g. purchaser – provider, collaborator/
can assure accountability towards citizens/customers co-provider/co-producer of products/services,
on the legitimate use of available resources. co-operation, net services).
c. Defining each party’s responsibilities in managing
Key implications partnerships including controls.
In our constantly changing society with growing com- d. Regularly monitoring and evaluating processes,
plexity, public organisations are required to manage results and the nature of partnerships.
relationships with other organisations in both the pub- e. Stimulating and organising task-specific partner-
lic and private sectors in order to realise their strategic ships and developing and implementing joint
objectives. projects with other public sector organisations.
f. Creating conditions for exchange of employees
Another consequence of this complexity is the need with partners.
for an increasing active role of citizens/customers as g. Stimulating activities in the area of corporate so-
key partners. The terms citizens/customers refers to the cial responsibility.
citizens’ varying role between stakeholder and service-
user. In this criterion, CAF focuses on the involvement Award a score using the Enablers Panel
of citizens in public matters and the development of
public policies and on the openness to their needs and
expectations. 4.2. Develop and implement partnerships
with the citizens/customers
Public organisations are often subject to constraints
and pressures, when managing their resources, over Examples:
and above those normally encountered in the private a. Encouraging the involvement of citizens/customers
sector. The ability of public organisations to gener- in public matters and in political decision-making
ate additional financial resources may be limited as processes (e.g. consultation groups, survey, opin-
may its freedom to allocate, or reallocate, its funds ion polls, quality circles).
to the services it wishes to deliver. It is therefore criti- b. Being open to ideas, suggestions and complaints
cal that they measure the efficiency and effectiveness of citizens/customers and developing and using
of the services they are charged to deliver. Full finan- appropriate mechanisms to collect them (e.g. by
cial management, internal control and accountan- means of surveys, consultation groups, question-
cy systems are the basis for sound cost accounting. naires, complaints boxes, opinion polls, etc.).
Although public organisations often have little say c. Ensuring a proactive information policy (e.g. about
in resource allocation, demonstrating the organisa- the competencies of the several public authorities,
tions ability to deliver more and improved services for about their processes, etc.).
less cost, creates the opportunity for more innovative d. Ensuring transparency of the organisation as well
services or products to be introduced more quickly. as its decisions and development (e.g. by publish-
It is important to identify the organisation’s knowledge ing annual reports, holding press conferences and
and information requirements and these should feed posting information on the Internet).
into the strategy and planning process reviews. The or- e. Actively encouraging citizens/customers to organ-
ganisation should ensure that appropriate knowledge ise themselves, express their needs and require-
and information is made available timeously and in ments and supporting citizen groups.
easily accessible formats to enable employees to do
their jobs effectively. Award a score using the Enablers Panel

14
4.3. Manage Finances Award a score using the Enablers Panel

Examples:
a. Aligning financial management with strategic ob- 4.5. Manage Technology
jectives.
b. Ensuring financial and budgetary transparency. Examples:
c. Ensuring the cost efficient management of a. Implementing an integrated policy of tech-
financial resources. nology management in accordance with the
d. Introducing innovative systems of budgetary and strategic and operational objectives.
cost planning (e.g. multi-annual budgets, pro- b. Efficiently applying appropriate technology to:
gramme of project budgets, gender budgets). – Manage tasks.
e. Permanently monitoring the costs of delivery and – Manage knowledge.
service standards of products and services offered – Support learning and improvement activities.
by the organisation including the involvement of – Support the interaction with stakeholders and
organisational units. partners.
f. Delegating and decentralising financial responsi- – Support the development and maintenance of
bilities and balancing them with central controlling. internal and external networks.
g. Basing investment decisions and financial control
on cost/benefit-analysis. Award a score using the Enablers Panel
h. Developing and introducing modern financial
controlling (e.g. through internal financial audits,
etc.) and promoting transparency of the financial 4.6. Manage facilities
control for all employees.
i. Creating parallel financial and cost account- Examples:
ing systems including balance sheets (capital a. Balancing effectiveness and efficiency of physical
accounts). locations with the needs and expectations of us-
j. Ensuring internal cost allocation (e.g. transfer pric- ers (e.g. centralisation versus decentralisation of
es: units are charged for internal services). buildings).
k. Including non-financial performance data in b. Ensuring a safe, cost efficient and ergonomically
budget documents. suitable use of office facilities based on strategic
l. Introducing comparative analyses (e.g. bench- and operational objectives, accessibility by pub-
marking) between different actors and organisa- lic transport, the personnel needs of employees,
tions. local culture and physical constraints (e.g. open
plan offices vs. individual offices, mobile offices)
Award a score using the Enablers Panel and technical equipment (e.g. number of PCs and
copy-machines by service).
c. Ensuring an efficient, cost effective, planned and
4.4. Manage information and knowledge sustainable maintenance of buildings, offices and
equipment.
Examples: d. Ensuring an efficient, cost effective and sustain-
a. Developing systems for managing, storing and able use of transport and energy resources.
assessing information and knowledge in the or- e. Ensuring appropriate physical accessibility of
ganisation in accordance with strategic and op- buildings in line with the needs and expectations
erational objectives. of employees and citizens/customers (e.g. disa-
b. Ensuring that externally available relevant informa- bled access to parking or public transport).
tion is gained, processed and used effectively. f. Developing an integrated policy for managing
c. Constantly monitoring the organisation’s informa- physical assets, including their safe recycling/dis-
tion and knowledge, ensuring its relevance, cor- posal, e.g. by direct management or subcontract-
rectness, reliability and security. Also aligning it ing.
with strategic planning and the current and future
needs of stakeholders. Award a score using the Enablers Panel
d. Developing internal channels to cascade informa-
tion throughout the organisation to ensure that
all employees have access to the information and
knowledge relevant to their tasks and objectives.
e. Ensuring access and exchange of relevant infor-
mation with all stakeholders and presenting infor-
mation and data in a user-friendly way.
f. Ensuring, as far as is practicable, that key informa-
tion and knowledge of employees is retained with-
in the organisation in the event of their leaving the
organisation.
15
Criterion 5: Processes paying social security benefits
– providing customer service through enquiry
handling
Definition – formulation and implementation of legislative
How the organisation identifies, manages, improves policy
and develops its key processes in order to support * Management processes
strategy and planning. Innovation and the need to – assessment of the quality of tax collection
generate increasing value for its citizens/customers – decision-making processes
and other stakeholders are two of the main drivers in * Support processes
process development. – budgeting and planning
– processes for human resource management
Key implications
Each organisation that performs well is run by For support units, key processes will be linked to their
many processes, each process being a set of con- support function of the organisation which is responsi-
secutive activities that transform resources or in- ble for the delivery of the core business.
puts into results or outputs and outcomes, there-
by adding value. These processes can be of a It is essential that processes are continually reviewed as
different nature. The core processes are critical to the design, innovation and new technologies arrive at an
delivery of products or services. Management process- increasing pace to the market. In order to take advan-
es steer the organisation and support processes de- tage of potential improvements public organisations
liver the necessary resources. Only the most important need to ensure that they have mechanisms in place to
of these processes, the key processes, are the object enable them to receive feedback from all stakeholders
of the assessment in the CAF. A key to the identifica- on product and service enhancements.
tion, evaluation and improvement of key processes is
how effectively they contribute in achieving the mis- Assessment: Consider evidence on what the
sion of the organisation. Involving citizens/customers organisation is doing to
in the different stages of process management and
taking into account their expectations contributes to
their overall quality and reliability. 5.1. Identify, design, manage and improve
processes on an ongoing basis
The nature of processes in public service organisations
may vary greatly, from relatively abstract activities such Examples:
as support for policy development or regulation of a. Identifying, describing and documenting key proc-
economic activities, to very concrete activities of serv- esses on an ongoing basis.
ice provision. In all cases, an organisation needs to be b. Identifying process owners and assigning
able to identify the key processes, which it performs responsibilities to them.
in order to deliver its expected outputs and outcomes, c. Involving employees and other external stakehold-
considering the expectations of citizens/customers and ers in the design and development of key proc-
other stakeholders. esses.
d. Allocating resources to processes based on the
The role of citizens/customers could operate at 3 lev- relative importance of their contribution to the
els: 1) the involvement of representative citizens/cus- strategic aims of the organisation.
tomers, associations or ad hoc panels of citizens in the e. Gathering, recording and understanding le-
design of the organisation’s services and products, 2) gal requirements and other regulations relevant
collaboration with citizens/customers in the implemen- to the processes of the organisation, analys-
tation of services and products, 3) empowerment of ing them and making proposals for streamlin-
citizens/customers in order to realise or access services ing legally integrated processes aimed at elimi-
and products themselves. nating unnecessary administrative burdens and
bureaucracy.
Cross-functional processes are common in public f. Implementing process indicators and setting citi-
administration. It is vital to successfully integrate the zen/customer-oriented performance goals.
management of such processes, since from that inte- g. Co-ordinating and synchronising processes.
gration the effectiveness and efficiency of processes h. Monitoring and evaluating impacts of net serv-
greatly depend. To that aim, well experimented forms ices/e-gov on the organisation‘s processes (e.g.
of organisational integration should be pursued, such efficiency, quality, effectiveness).
as the creation of cross-functional process manage- i. In conjunction with relevant stakeholders, improv-
ment teams with the appointment of team leaders. ing processes on the basis of their measured ef-
ficiency, effectiveness and results (outputs and out-
Examples of Public Administration processes are: comes).
* Core processes j. Analysing and evaluating key processes, risks and
– core service provision related to the mission(s) critical success factors taking the objectives of the
of the organisation, e.g. collecting taxes and organisation and its changing environment into
16
consideration. 5.3. Innovate processes involving
k. Identifying, designing and implementing citizens/customers
process changes leading to one-stop-principle
services. Examples:
l. Measuring and reviewing the effectiveness of a. Active approach to learning from innovations of
process changes and carrying out benchmarking other organisations nationally and internationally.
to drive improvement. b. Involving stakeholders in process innovations e.g.
by piloting new services and e-government solu-
Award a score using the Enablers Panel tions.
c. Involving citizens/customers and stakeholders in
process innovations.
5.2. Develop and deliver citizen/customer- d. Providing the resources necessary for process in-
oriented services and products novations.
e. Actively identify, analyse and overcome obstacles to
Examples: innovation.
a. Involving citizens/customers in the design and
improvement of services and products (e.g. by Award a score using the Enablers Panel
means of surveys/feedback focus-groups/inquiries
/

concerning the suitability of services or products


and whether they are effective taking into account
gender and diversity aspects).
b. Involving citizens/customers and other stakehold-
ers in the development of quality standards for
services, products and information for citizens/
customers.
c. Develop clear guidelines and regulations using
plain language.
d. Involving citizens/customers in the design
and development of information sources and
channels.
e. Ensuring the availability of appropriate and
reliable information with an aim to assist and sup-
port citizens/customers.
f. Promoting accessibility of the organisation (e.g.
flexible opening hours and documents in a variety
of formats e.g. appropriate languages, internet,
posters, brochures, Braille).
g. Promoting electronic communication and interac-
tion with citizens/customers.
h. Developing sound response query handling and
complaint management systems and procedures.

Award a score using the Enablers Panel

17
Results

From Criterion 6 onwards, the focus of the assessment shifts from Enablers to Results. In the Results criteria
we measure perceptions: what our people, citizens/customers and society think of us. We also have internal
performance indicators which show how well we are doing against the targets we may have set for ourselves
– the outcomes. The assessment of results requires a different set of responses, so the responses from this point
onwards are based on the Results Assessment Panel (see CAF scoring and Assessment panels).

19
Criterion 6: Citizen/customer-oriented 6.1. Results of citizen/customer satisfaction
results measurements

Examples:
Definition a. Results regarding the overall image of the organi-
The results the organisation is achieving in relation to sation (e.g. friendliness and fairness of treatment;
the satisfaction of its citizens/customers with the or- flexibility and ability to address individual solu-
ganisation and the products/services it provides. tions).
b. Results regarding involvement and participation.
Key implications c. Results regarding accessibility (e.g. opening and
Public sector organisations can have a complex rela- waiting times, one-stop-shops).
tionship with the public. In some cases it can be char- d. Results relating to products and services (e.g.
acterised as a customer relationship – especially in the quality, reliability, compliance with quality stand-
case of direct service delivery by public sector organi- ards, processing time, quality of advice given to
sations – and in other cases may be described as a citi- the customers/citizens).
zen relationship, where the organisation is involved in
determining and enforcing the environment in which Award a score using the Results Panel
economic and social life is conducted. Since the two
cases are not always clearly separable, this complex
relationship will be described as a citizens/customers 6.2. Indicators of citizen/customer-oriented
relationship. Citizens/customers are the recipients or measurements
beneficiaries of the activity, products or services of the
public sector organisations. Citizens/customers need Examples:
to be defined but not necessarily restricted to only the Indicators regarding the overall image of the
primary users of the services provided. Public organi- organisation
sations deliver services according to local and/or cen- a. Number and processing time of complaints (e.g.
tral government policy and are held accountable for resolution of conflict of interest cases).
their performance to political stakeholders. Perform- b. Extent of public trust towards the organisation and
ance against statutory requirements is covered under its services or products.
organisational results (Criterion 9). Public policy tar- c. Waiting time.
gets are those set by national, regional and local gov- d. Handling/processing time of services delivery.
ernments which may or may not be citizens/customers e. Extent of employee training in relation to the ef-
driven. Citizens/customers satisfaction measures are fective handling of citizen/customer relationships
normally based on areas that have been identified as (e.g. professionalism and friendly communication
important by customer groups and based on what the with, and treatment of, citizens/customers).
organisation is able to improve within its specific area f. Indicators of complying with diversity and gender
of service. aspects.

It is important for all kinds of public sector organisa- Indicators regarding involvement
tions to directly measure the satisfaction of their citi- g. Extent of involvement of stakeholders in
zens/customers with regard to the overall image of the the design and the delivery of services and
organisation, the products and services the organisa- products and/or the design of decision-making
tion provides, the openness of the organisation and processes.
the extent to which it involves citizens/customers. Or- h. Suggestions received and recorded.
ganisations typically use citizen/customer question- i. Implementation and extent of use of new and in-
naires or surveys to record levels of satisfaction, but novative ways in dealing with citizens/customers.
they may also use other complementary tools such as
focus groups or user panels. Indicators regarding products and services
j. Adherence to published service standards (e.g.
Some examples of information which may be collected citizens‘ charters).
include data on products and services, image of the k. Number of files returned back with errors
organisation, politeness, helpfulness and friendliness and/or cases requiring repeated processing/com-
of staff. pensation.
l. Extent of efforts to improve availability, accuracy
Assessment: Consider what results the organisation and transparency of information.
has achieved to meet the needs and expectations
of citizens and customers, through: Award a score using the Results Panel

20
Criterion 7: People results Results regarding satisfaction with working
conditions:
g. The working atmosphere and the organisation‘s
Definition culture (e.g. how to deal with conflict, grievances
The results the organisation is achieving in relation to or personnel problems).
the competence, motivation, satisfaction and perform- h. The approach to social issues (e.g. flexibility of
ance of its people. working hours, balance between work and per-
sonal matters, health).
Key implications i. The handling of equal opportunities and fairness
This criterion addresses the satisfaction of all the peo- of treatment and behaviour in the organisation.
ple in the organisation. Organisations typically use
people (employee) surveys to record satisfaction lev- Results regarding motivation and satisfaction with ca-
els, but they may also use other complementary tools reer and skills development:
such as focus groups, termination interviews and ap- j. The ability of the management to promote HRM-
praisals. They may also examine the performance of strategy and systematic competency development
people and the level of skills development. and the employees’ knowledge about the goals of
Sometimes external constraints may limit the organi- the organisation.
sation’s freedom in this area. The constraints and how k. Results regarding people‘s willingness to accept
the organisation overcomes or influences constraints changes.
should therefore be clearly presented.
Award a score using the Results Panel
It is important for all kinds of public sector organisa-
tions to directly record people results concerning the
employees’ image of the organisation and its mission, 7.2. Indicators of people results
the working environment, the organisation’s leader-
ship and management systems, career development, Examples:
the development of personal skills and the products a. Indicators regarding satisfaction (e.g. levels of
and services the organisation provides. absenteeism or sickness, rates of staff turnover,
Organisations should have a range of internal people- number of complaints).
related performance indicators through which they can b. Indicators regarding performance (e.g. measures
measure the results they have achieved in relation to of productivity, results of evaluations).
targets and expectations in the areas of people over- c. Levels of using information and communication
all satisfaction, their performance, the development of technologies by employees.
skills, their motivation and their level of involvement in d. Indicators regarding skills development (e.g. par-
the organisation. ticipation and success rates in training activities,
effectiveness of training budgets).
e. Evidence on the ability to deal with citizens/cus-
Assessment: Consider what results the organisation tomers and to respond to their needs.
has achieved to meet the needs and expectations f. Degree of employee rotation inside the organisa-
of its people, through: tion (mobility).
g. Indicators regarding motivation and involvement
7.1. Results of people satisfaction and (e.g. response rates for staff surveys, number of
motivation measurements proposals for innovation, participation in internal
discussion groups).
Examples: h. Amount/frequency of rewarding individuals and
Results regarding overall satisfaction with: teams.
a. The overall image and the overall performance of i. Number of reported possible conflict of interest
the organisation (for society, citizens/customers, cases.
other stakeholders).
b. The level of employees´ awareness of conflicts of Award a score using the Results Panel
interest.
c. The level of employees´ involvement in the organ-
isation and its mission.

Results regarding satisfaction with management and


management systems:
d. The organisation‘s top management and middle
management ability to steer the organisation (e.g.
setting goals, allocating resources, etc.) and com-
munication.
e. Rewarding individual and team efforts.
f. The organisation‘s approach to innovation.
21
Criterion 8: Society results tional and international level.
h. General public‘s view about the organisation’s
openness and transparency.
Definition i. Organisation‘s ethical behaviour.
The results the organisation is achieving in satisfying the j. The tone of media coverage received.
needs and the expectations of the local, national and
international community. This may include the percep- Award a score using the Results Panel
tion of the organisation‘s approach and contribution to
quality of life, the environment and the preservation of
global resources and the organisations‘ own internal 8.2. Indicators of societal performance es-
measures of its effectiveness in contributing to society. tablished by the organisation

Key Implications Examples:


Public Sector organisations have an impact on society a. Relationship with relevant authorities, groups and
by the very nature of their primary business or statutory community representatives.
mandate, and the outputs of these core activities will b. The amount of media coverage received.
affect direct and indirect beneficiaries. These analyses c. Support dedicated to socially disadvantaged citi-
of the immediate effects on the beneficiaries should be zens.
presented in the citizen/customer satisfaction (Cr. 6) d. Support for integration and acceptance of ethnic
and key performance results criteria (Cr. 9). minorities.
Criterion 8 will measure the intended or unintended e. Support for international development projects.
impacts on society, i.e. the global effects of the organi- f. Support for civic engagement of citizens/custom-
sation’s policies beyond its primary missions/ statutory ers and employees.
mandate or core activities. In this direction, the analy- g. Productive exchange of knowledge and informa-
sis will consider the impacts derived from planned ob- tion with others.
jectives as well as the unintended consequences i.e. h. Programmes to prevent citizens/customers and
side effects which may have positive and/or negative employees from health risks and accidents.
effects on society. i. Organisation activities to preserve and sustain the
resources (e.g. degree of compliance with environ-
The measures cover both qualitative measures of per- mental standards, use of recycled materials, use
ception and quantitative indicators. of environmentally friendly modes of transport,
They can be related to reduction of nuisance, harms and noise, reduction
– economic impact in use of utilities e.g. water, electricity, gas).
– social dimension e.g. disabled people
– quality of life Award a score using the Results Panel
– impact on the environment
– quality of democracy.

Assessment: Consider what the organisation has


achieved in respect of impact on society, with
reference to

8.1. Results of societal measurements per-


ceived by the stakeholders

Examples:
a. General public‘s awareness of the impact of how
the organisation´s performance affects the quality
of citizens/customers´ life.
b. General reputation of the organisation (e.g. as an
employer/contributor to local/global society).
c. Economic impact on society at the local, regional,
national and international level.
d. The approach to environmental issues (e.g. pro-
tection against noise, air pollution).
e. Environmental impact on society at the local, re-
gional, national and international level.
f. Impact on society with regard to sustainability at the
local, regional, national and international level.
g. Impact on society taking into account quality of
democratic participation at the local, regional, na-
22
Criterion 9: Key performance results 9.2. Internal results

Examples:
Definition Results in the field of management and innovation
The results the organisation is achieving with regard a. Evidence of involvement of all stakeholders in the
to its strategy and planning related to the needs and organisation.
demands of the different stakeholders (i.e. external re- b. Results of the establishment of partnerships and
sults); and the results the organisation has achieved in results of joint activities.
relation to its management and improvement (internal c. Evidence of ability to satisfy and balance the needs
results). of all the stakeholders.
d. Evidence of success in improving and innovating
Key implications organisational strategies, structures and/or proc-
Key performance results relate to whatever the or- esses.
ganisation has determined are essential, measurable e. Evidence of improved use of information technol-
achievements for the success of the organisation in the ogy (in managing internal knowledge and/or in
short and longer term. internal and external communication and net-
They represent the capacity of policies and processes working).
to reach goals and objectives including specific tar- f. Results of inspections and audits.
gets, which are politically driven. g. Process performance.

Key performance results can be divided into: Financial results


1) External results: the measures of the effectiveness h. Extent to which budgets and financial targets are
of policies and services/products in terms of the met.
capacity to improve the condition of direct ben- i. Extent or trend to which part the organisation re-
eficiaries: the achievement of key activities’ goals lies on own fiscal resources and revenues from
in terms of a) outputs – services and products and fees and earnings from selling services/goods.
b) outcomes – effects of the organisation’s core j. Evidence of ability to satisfy and balance the
activities on external stakeholders (effectiveness). financial interests of all stakeholders.
2) Internal results: the measures of the internal func- k. Measures of effective use of operating funds.
tioning of the organisation: its management, im- l. Results of financial inspections and audits.
provement and financial performance (efficiency
and economy). Award a score using the Results Panel

These measures are likely to be closely linked to policy


and strategy (Criterion 2), partnerships and resources
(Criterion 4) and processes (Criterion 5).

Assessment: Consider the evidence of defined


goals achieved by the organisation in relation to

9.1. External results: outputs and outcomes


to goals

Examples:
a. The extent to which the goals are achieved in terms
of output (delivery of products or services).
b. Improved quality of service or product delivery
with respect to measurement results.
c. Cost efficiency (outputs achieved at the lowest pos-
sible cost).
d. Results of inspections and audits.
e. Results of participation in competitions, quality
awards and the quality management system certi-
fication (Excellence Awards – League table/Bench-
mark).
f. Results of benchmarking/bench learning activi-
ties.
g. Cost effectiveness (outcomes achieved at the low-
est possible cost).

Award a score using the Results Panel


23
CAF Scoring and assessment panels

Why score? 1. CAF classical scoring

Allocating a score to each sub criterion and criterion of This cumulative way of scoring helps the organisation
the CAF model has 4 main aims: to become more acquainted with the PDCA-cycle and
1. to provide information and give an indication on the directs it more positively towards a quality approach.
direction to follow for improvement activities.
2. to measure your own progress, if you carry out The scores as defined in the CAF 2002 version are
CAF assessments regularly, each year or eve- presented in the column “level 2002”. In the enablers
ry two years, considered to be good practice assessment panel the PDCA phase is in place only
according to most quality approaches. when bench learning activities are part of the continu-
3. to identify good practices as indicated by high ous improvement cycle.
scoring for Enablers and Results. High scoring of
Results are usually an indication of the existence of In the results assessment panel a distinction is made
good practices in the Enablers field. between the trend of the results and the achievement
4. to help to find valid partners to learn from (bench- of the targets.
marking: How we compare; and bench learning:
What we learn from each other).

With regard to bench learning however, it should be


noted that comparing CAF scores has limited value
and carries a risk, particularly if it is done without
experienced external assessors trained to validate
the scores in a homogeneous way in different public
organisations. The main aim of bench learning is to
compare the different ways of managing the enablers
and achieving results. The scores, if validated, can be
a starting point in this regard. That is how bench learn-
ing can contribute to improvement.

How to score?

New in the CAF 2006 is that it provides two ways of


scoring. The “classical” CAF scoring is the updated
version of the CAF 2002 assessment panels. The “fine-
tuned” CAF scoring is suitable for organisations that
wish to reflect in more detail the analysis of the sub
criteria. It allows you to score – for each sub criterion
– all phases of the Plan Do Check Act (PDCA) cycle
simultaneously.

The PDCA-cycle is the fundament of both ways of scor-


ing. Compared to 2002 when the scale was set at 0-5,
the scale has been revised and set at 0-100, this scale
being more widely used and generally accepted at an
international level.

24
Assessment panels 1

0(!3% %.!",%230!.%, 3#/2% ,%6%,


7EARENOTACTIVEINTHISFIELD
  
7EHAVENOINFORMATIONORVERYANECDOTAL

0,!. 7EHAVEAPLANTODOTHIS   

$/ 7EAREIMPLEMENTINGDOINGTHIS   

#(%#+ 7ECHECKREVIEWIFWEDOTHERIGHTTHINGSINTHERIGHTWAY   

!#4 /NTHEBASISOFCHECKINGREVIEWSWEADJUSTIFNECESSARY   

%VERYTHINGWEDO WEPLAN IMPLEMENT CHECKANDADJUSTREGULARLYANDWE


0$#!   
LEARNFROMOTHERS7EAREINACONTINUOUSIMPROVEMENTCYCLEONTHISISSUE

Instructions:
– Choose the level that you have reached: Plan, Do, – Give a score between 0 and 100 according to the
Check or Act. This way of scoring is cumulative: level that you have reached inside the phase. The
you need to have accomplished a phase (e.g.: scale on 100 allows you to specify the degree of
Check) before reaching the next phase (e.g.: Act). deployment and implementation of the approach.

RESULTS PANEL 1 SCORE LEVEL 2002


No results are measured
0-10 0
and / or no information is available.

Results are measured and show negative trends


11-30 1
and / or results do not meet relevant targets.

Results show flat trends


31-50 2
and / or some relevant targets are met.

Results show improving trends


51-70 3
and / or most of the relevant targets are met.

Results show substantial progress


71-90 4
and / or all the relevant targets are met.

Excellent and sustained results are achieved. All the relevant targets are met.
91-100 5
Positive comparisons with relevant organisations for all the key results are made.

Instructions:
– Give a score between 0 and 100 for each sub cri- – For each level, you can take into account either
terion on a scale divided in 6 levels (correspond- the trend, either the achievement of the target or
ing to the results panel of the CAF 2002). both.

25
2. CAF fine-tuned scoring Instructions for each sub criterion:
– Read the definition of each phase (Plan, Do, Check
The fine-tuned scoring is a simultaneous way of scor- and Act);
ing closer to the reality where e.g. many public organi- – Find evidence of strengths and weaknesses and
sations are doing things (Do) but sometimes without give a global judgement for each phase in the ap-
enough planning (Plan). propriate box. This judgement can be illustrated by
– In the enablers panel, the emphasis lays more on some examples or evidence in order not to over-
the PDCA as a cycle and progress can be repre- complicate the scoring exercise. However, those
sented as a spiral where in each turn of the cir- who want to go further can put all the examples or
cle improvement may take place in each phase: evidence in the different boxes of the 4 phases and
PLAN, DO, CHECK and ACT. calculate the average for each phase.
– Bench learning activities are normally taken into – Calculate the sum of the four phase scores and
account at the highest level of all the phases. divide by 4 in order to obtain a score on 100 for
– This way of scoring gives more information on the the enabler sub criterion. This score should be
areas where improvement is mostly needed. plausible and consistent e.g. total scoring should
– The results panel shows you if you have to acceler- not exceed 40 if any of the four evaluation criteria
ate the trend or focus on the targets achievement. (Plan, Do, Check, Act) is lower than or equal to
20. It should not exceed 60 if any of the criteria is
lower than 30.

Assessment panels 2

Enablers Panel 2
SCALE 0-10 11-30 31-50 51-70 71-90 91-100
EVIDENCE EVIDENCE EVIDENCE EVIDENCE EVIDENCE EVIDENCE EVIDENCE

No Some weak Some good Strong Very strong Excellent


evidence evidence, evidence evidence evidence evidence,
PHASE or just related to related to related to related to compared
some ideas some areas relevant most areas all areas with other
areas organisations,
related to all
areas.

Planning is based on stakeholders’


needs and expectations. Planning is
PLAN deployed throughout the relevant parts
of the organisation on a regular basis.
SCORE

Execution is managed through defined


processes and responsibilities and
DO diffused throughout the relevant parts
of the organisation on a regular basis
SCORE
Areas of improvement
Defined processes are monitored with
relevant indicators and reviewed
CHECK throughout the relevant parts of the
organisation on a regular basis
SCORE

Correction and improvement actions


are taken following the check results
ACT throughout the relevant parts of the
organisation on a regular basis
SCORE

TOTAL / 400
SCORE / 100

26
The above findings have been placed in the following
EXAMPLE of a fine-tuned scoring: Enablers – sub Enabler Matrix, to help elaborate a global scoring for
criterion 1.1: the sub criterion: Notice: that does not necessarily
mean giving scores to the individual examples; the
Provide direction to the organisation by developing blank boxes of the matrix are used as a memo pad,
its mission, vision and values to pass from the evidences collected during the sub
criterion assessment to a global sub criterion scoring,
and as a way to guide the discussion in the consensus
meeting.
Synthesis of the evidence emerged in self-assessments
(starting points for improvement planning and basis
for scoring).
1.1.a. A vision and a mission for the administration
was elaborated three years ago. It was re-
quested by the director general and the dis-
cussion involved all the first line managers. An
elegant, coloured card with the vision and mis-
sion statement was distributed to all employ-
ees.
1.1.b Nothing has been done yet in the area of val-
ues statement and code of conduct. The Hu-
man Resources Manager has developed a
project to this end. Middle management will
be invited to a seminar to reflect together on
the values of the organisation. The values will
be crystallised into teaching what positions
have to be taken in difficult situations.
1.1.c Employees, customers/citizens and other
stakeholders have not been involved up to
now in the vision and mission definition proc-
ess. However, awareness of the importance of
such involvements arose two years ago, when
some managers of our administration partici-
pated in TQM Seminars, particularly one dedi-
cated to the CAF model. The decision was then
taken to make internal and external surveys to
collect employees’ and citizens perceptions.
Results indicated that middle managers and
employees considered the vision and mission
as “image” statements, totally detached from
reality and that the objectives quite often did
not seem in tune with such statements. As far
as customers are concerned, surveys indicated
that alignment of management perceptions
with customer perceptions is needed. Meet-
ings with managers and employees and with
representatives of citizens have been planned
and will take place soon. The decision was
also taken to conduct employees and custom-
er surveys every year. An administration wide
self-assessment is also being planned.
1.1.d The above mentioned surveys should guaran-
tee that in the future the vision and mission
statements will be periodically reviewed and
updated taking into accounts customer/stake-
holder needs and expectations; that employ-
ee’s involvement will increase as well as com-
munication within the organization.

27
%NABLERS0ANEL
3#!,%            
%6)$%.#% %6)$%.#% %6)$%.#% %6)$%.#% %6)$%.#% %6)$%.#% %6)$%.#%

.O 3OMEWEAK 3OMEGOOD 3TRONG 6ERYSTRONG %XCELLENT


EVIDENCE EVIDENCE EVIDENCE EVIDENCE EVIDENCE EVIDENCE
0(!3% ORJUST RELATEDTO RELATEDTO RELATEDTO RELATEDTO COMPARED
SOMEIDEAS SOMEAREAS RELEVANT MOSTAREAS ALLAREAS WITHOTHER
AREAS ORGANISATIONS
RELATEDTOALL
AREAS

0LANNINGISBASEDONSTAKEHOLDERS B
NEEDSANDEXPECTATIONS0LANNINGIS
0,!. DEPLOYEDTHROUGHOUTTHERELEVANTPARTS
OFTHEORGANISATIONONAREGULARBASIS
3#/2%  

%XECUTIONISMANAGEDTHROUGHDEFINED A
PROCESSESANDRESPONSIBILITIESAND
$/ DIFFUSEDTHROUGHOUTTHERELEVANTPARTS
OFTHEORGANISATIONONAREGULARBASIS
3#/2%  

$EFINEDPROCESSESAREMONITOREDWITH C
RELEVANTINDICATORSANDREVIEWED
#(%#+ THROUGHOUTTHERELEVANTPARTSOFTHE
ORGANISATIONONAREGULARBASIS
3#/2%  

#ORRECTIONANDIMPROVEMENTACTIONS D
ARETAKENFOLLOWINGTHECHECKRESULTS
!#4 THROUGHOUTTHERELEVANTPARTSOFTHE
ORGANISATIONONAREGULARBASIS
3#/2%  

4/4!, 
3#/2% 

28
2ESULTS0ANEL
3#!,%            

42%.$3 .O .EGATIVETREND &LATTRENDOR 3USTAINED 3UBSTANTIAL 0OSITIVECOMPAR


MEASUREMENT MODESTPROGRESS PROGRESS PROGRESS ISONWITHRELEVANT
ORGANISATIONSFOR
ALLRESULTS
3#/2%

4!2'%43 .OORANECDOTAL 2ESULTSDONOT &EWTARGETSARE 3OMERELEVANT -OSTOFTHE !LLTHETARGETSARE


INFORMATION MEETTARGETS MET TARGETSAREMET RELEVANTTARGETS MET
AREMET

3#/2%
4/4!,
3#/2%

Instructions
– Consider separately the trend of your results for 3 EXAMPLE of a fine-tuned CAF scoring:
years and the targets achieved in the last year. Results – sub criterion 9.1:
– Give a score for the trend between 0 and 100 on Key performance results. External results.
a scale divided in 6 levels.
– Give a score for the targets achievement of the last
year between 0 and 100 on a scale divided in 6 Synthesis of the evidence emerged in self-as-
levels. sessments (starting points for improvement
– Calculate the sum for the trends and targets planning and basis for scoring).
achievement and divide by 2 in order to obtain a In preparation on the strategic meeting in the begin-
score on 100 for the result sub criterion. ning of the new working year, a report was prepared
for the board of directors on the key performance
results of last year in order to optimise the strategic
planning for the next year. The conclusions of the re-
port were clear: the performance’s goals were met for
more than 50% and in comparison with the year be-
fore a progress of 10% was established. The apprecia-
tion of these conclusions was far from anonymous and
gave way to intensive discussions among the members
of the board.

2ESULTS0ANEL n3CORING
3#!,%            

42%.$3 .O .EGATIVETREND &LATTRENDOR 3USTAINED 3UBSTANTIAL 0OSITIVECOMPAR


MEASUREMENT MODESTPROGRESS PROGRESS PROGRESS ISONWITHRELEVANT
ORGANISATIONSFOR
ALLRESULTS
3#/2% 

4!2'%43 .OORANECDOTAL 2ESULTSDONOT &EWTARGETSARE 3OMERELEVANT -OSTOFTHE !LLTHETARGETSARE


INFORMATION MEETTARGETS MET TARGETSAREMET RELEVANTTARGETS MET
AREMET

3#/2% 
4/4!, 
3#/2% 

29
Guidelines for improving organisations
using CAF Survey 2005 – The most important benefits of
a CAF self-assessment
The CAF users’ survey of 2005 shows that major ben-
The process of continuous improvement can be de- efits of a self-assessment include:
signed and carried out in a number of ways. The size – Effective identification of the strengths of the or-
of the organisation, the culture and prior experience ganisation and the areas where improvement has
with Total Quality Management tools are some of the to be made
parameters that help to determine what the most ap- – Identification of relevant improvement ac-
propriate way of launching the TQM approach will be. tions
– Increased level of awareness and communication
In this chapter we have identified a 10 step process of throughout the organisation
continuous improvement with CAF that may be consid- – People started to become aware and interested in
ered relevant to most organisations. quality issues
In relation to other TQM tools the CAF users generally
It is important to emphasise that the advice given here find CAF to be easy to use, low cost and well adapted
is based on the experience of the many organisations to the public sector.
that have used CAF. However each improvement proc-
ess is unique and therefore this description should be In this phase it is vital that one or more persons in the
seen as an inspiration for the people responsible for organisation take responsibility for securing these basic
the process of self-assessment rather than as a precise principles. A good idea is to contact the organisation
manual for the process. responsible for dissemination of CAF in your country
(for information on this see www.eipa.eu) and either
ask them to make a presentation of the CAF model or
Phase 1 – The start of the CAF journey get information on/from other organisations that have
already used the model and are willing to share their
Step 1 DECIDE HOW TO ORGANISE AND experience.
PLAN THE SELF-ASSESSMENT
In order for the people of the organisation to support
A high level of commitment and shared owner- the process of self-assessment it is important that con-
ship between the senior management and the peo- sultation takes place before the final decision about
ple of the organisation are most crucial elements in carrying out self-assessment has been made. Apart
securing the success of the self-assessment process. from the general benefits of carrying out self-assess-
ment, experience shows that many people find CAF to
In order to gain commitment and ownership, the expe- be an excellent opportunity to gain more insight into
rience of many organisations shows that a clear man- their organisation and want to be actively involved in
agement decision through a sound consultative process its development.
with the stakeholders of the organisation is necessary.
This decision should clearly illustrate the willingness of For some organisations it may also be relevant to seek
the management to be actively involved in the process the acceptance or approval of external stakeholders
by recognising the added value of the self-assessment before deciding to carry out self-assessment. This may
and guaranteeing the openness of mind, respect for the be the case with politicians or senior management of
results and readiness to start improvement actions higher level organisations who are traditionally closely
afterwards. It also includes the commitment to set aside involved in management decision making. Key external
the resources needed to carry out the self-assessment stakeholders may have a role to play, particularly in
in a professional way. data collection and processing information, and also
potentially benefit from changes regarding some of the
Knowledge about the potential benefits of a CAF self- areas of improvement that may be identified.
assessment and information about the structure of the
model and the process of self-assessment are neces- Initial planning of the self-assessment
sary elements in providing management with a basis Once a decision has been made to carry out self-as-
for decision making. It is very important for all manag- sessment the planning process can start. One of the
ers to be convinced of these benefits from the outset. first elements in this – that may have been included
in the management decision – is the definition of the
scope and the approach of self-assessment.

A frequently asked question is whether the self-assess-


ment has to cover the whole organisation or if sepa-
rate parts such as units or departments can undertake
self-assessment. The answer is that separate parts can
perform self-assessment but in order to assess all cri-
teria and sub criteria in a meaningful way, they should
30
have enough autonomy to be considered as a mainly Step 2 COMMUNICATE THE
autonomous organisation with a proper mission and SELF-ASSESSMENT PROJECT
significant responsibility for Human Resources and fi-
nancial processes. In such cases the relevant supplier/ A very important planning activity once the project ap-
customer relations as well as stakeholder relations be- proach has been defined is the outlining of a com-
tween the selected unit and the remaining part of the munication plan. This plan includes communication
organisation should be assessed. efforts targeted at all stakeholders in the project with a
special emphasis on middle managers and people of
It is recommended to include in the management deci- the organisation.
sion the choice of the scoring panel to be used.
Two ways of scoring are offered. An organisation Communication is a core field in all change manage-
should choose depending on the time available to ment projects, but especially when an organisation is
invest in scoring and on its level of experience and performing self-assessment. If communication regard-
maturity. ing the purpose and the activities of the self-assessment
is not clear and appropriate, it is likely that the self-as-
A very important action by top management to un- sessment effort will be seen as “just another project”
dertake in this phase is the appointment of a project or “some management exercise”. The risk here is that
leader for the self-assessment process. Tasks that are these assumptions become self-fulfilling prophecies as
normally performed by the project leader include: there may be a reluctance from middle managers and
1. Detailed planning of the project, including the other people to be fully committed or involved.
communication process;
2. Communication and consultation with all stake- Survey 2005 – The importance of communi-
holders regarding the project; cation to create ownership by the employ-
3. Organising training of the self-assessment group; ees is generally underestimated
4. Gathering of supporting documents and evidence; An important conclusion of the latest CAF
5. Active participation in the self-assessment group; users’ survey is that the users of CAF find that they
6. Facilitation of the consensus process; have generally not prioritised sufficiently the commu-
7. Editing of the self-assessment report; nication efforts regarding employees during the proc-
8. Supporting the management in prioritising ess. The lessons learned show that one of the major
actions and outlining of the action plan. potential benefits of CAF is to increase the level of
awareness and communication across the organisa-
The demands regarding the competences of the project tion. But this can only be realised if management and
leader are high. The person has to have both a high the people responsible for the CAF self-assessment are
level of knowledge regarding his or her own organisa- active at a very early stage in communicating and in-
tion, knowledge of the CAF model as well as knowl- volving people and middle managers in the organisa-
edge about how to facilitate the process of self-assess- tion about the purpose and the potential benefits of
ment. Appointing the right project leader who has this self-assessment.
knowledge and the confidence of senior management
and people within the organisation is one of the key An important result of early communication is to
management decisions that can affect the quality and stimulate the interest of some of the employees and
outcome of the self-assessment. Appropriate project managers to be directly involved in a self-assessment
management training is available at national and Eu- group. Involvement should ideally be pursued through
ropean level. personal motivation. Motivation should be the basic
element that links people to the whole process of self-
For some organisations the language and the exam- assessment. People should have a completely clear
ples used in the CAF model are unfamiliar and too far view of the purpose of the CAF self-assessment proc-
away from their daily practise to be used directly. If this ess: the improvement in the overall performance of
is not resolved early in the familiarisation of the model, the organisation. The communication policy on the
it can later be an obstacle in the process of self-as- CAF self-assessment process should focus on win-win
sessment. What can be done in such cases, in addi- outcomes for all stakeholders, people and citizens/cli-
tion to the training efforts that are later described, is ents.
to “adapt” the model to the language of the organisa-
tion. Prior to embarking on this action it is a good idea So clear and coherent communication to all stakehold-
to check if this has already been done by an organi- ers during the relevant phases of the project is key to
sation similar to your own. This can be done through securing a successful process and follow up action.
the organisation responsible for disseminating CAF in The project leader along with the top management of
your country or with the CAF Resource Centre at EIPA. the organisation should reinforce that policy by focus-
ing on:
1. how self-assessment can make a difference;
2. why it has been given priority;
3. how it is connected to the strategic planning of the
organisation;
31
4. how it is connected (for example as the first step implementation of the improvement actions identified. It
to) to a general effort for improvement in the or- also increases diversity/representation. However, if the
ganisation’s performance, for instance through culture is not likely to support this, then the quality of the
the implementation of an innovative operational self-assessment can be jeopardised if one or more of the
reform programme. group members feels inhibited and unable to contribute
or speak freely.
The communication plan should be differentiated and
consider the following elements: focus group, mes-
sage, medium, sender, frequency and tools. Step 4 ORGANISE TRAINING

Information and training of management


Phase 2 – Self-Assessment Process It could be of value to involve top, middle manage-
ment and other stakeholders in self-assessment train-
Step 3 COMPOSE ONE OR MORE ing, on a voluntary basis, to widen knowledge and
SELF-ASSESSMENT GROUPS understanding of the concepts of TQM in general and
self-assessment with CAF in particular.
The self-assessment group should be as representa-
tive of the organisation as possible. Usually people Information and training of the self-assess-
from different sectors, functions, experience and levels ment group
within the organisation are included. The objective is The CAF model should be introduced and the purpos-
to establish an as effective group as possible, while at es and nature of the self-assessment process explained
the same time a group, which is able to provide the to the group. If the project leader has been trained
most accurate and detailed internal perspective of the prior to this phase it is a very good idea that this per-
organisation. son plays a major role in the training. In addition to
theoretical explanations, training should also include
The experience of the CAF users shows that groups are practical exercises to open the minds of participants
composed with between 5-20 participants. However, to the principles of total quality and also to experience
in order to secure an effective and relatively informal consensus building as these concepts and behaviours
working style, groups around 10 participants are gen- may be unfamiliar to most members.
erally preferable.
The CAF Resource Centre at EIPA arranges “train the
If the organisation is very large and complex it could trainer” sessions every year, and similar activities take
be relevant to compose more than one self-assessment place in a number of European countries.
group. In this case it is critical that the project design
takes into consideration how and when the appropri- A list provided by the project leader with all relevant
ate coordination of the groups will be taking place. documents and information needed to assess the or-
ganisation in an effective way should be available for
Participants should be selected on the basis of their the group. One sub criterion from the enablers crite-
knowledge of the organisation and their personal skills ria and one from the results criteria could be assessed
(e.g. analytical and communicative skills) rather than in common. This will give the group a better under-
professional skills alone. They can be selected on a standing of how the CAF self-assessment is operating.
voluntary basis but the project leader and the man- A consensus has to be reached on how to evaluate
agement remain responsible for the quality, the diver- evidence of strengths and areas for improvement and
sity and credibility of the self-assessment group. how to assign scores.

The project leader of the group may also be the chair, Another relevant session that will afterwards – during
this can help with project continuity but care should be the consensus phase – save time is to get a common pic-
taken in order to avoid conflicting interests. What is ture of the key stakeholders of the organisation, those
important is that the chair of the group is trusted by all which have a major interest in its activities: customers/
the members of the group to be able to lead discus- citizens, politicians, suppliers, partners, managers and
sions in a fair and effective way that will enable eve- employees. The most important services and products
rybody to contribute to the process. The chair can be delivered to, or received from, these stakeholders and
appointed by the group itself. An effective secretariat the key processes to assure this should also be clearly
to help the chair and organise meetings is essential as identified.
well as good meeting facilities and ICT support.

A frequently asked question is whether senior manag-


ers should be included in the self-assessment group. The
answer to this will depend on the culture and tradition of
the organisation. If management is involved, they can
provide additional information and it will increase the
likelihood that management has ownership to the later
32
Step 5 UNDERTAKE THE SELF-ASSESSMENT
Survey 2005 – The added value of
Undertake individual assessment discussions
Each member of the self-assessment group, using the Overall, the practice of coming to conclusions was the
relevant documents and information provided by the same as observed in 2003: the majority reached con-
project leader, is asked to give an accurate assess- sensus after discussions. The discussion itself is very
ment, under each sub criterion, of the organisation. often seen as the real added value of a self-assess-
This is based on their own knowledge and experience ment: when a consensus is reached, the end result is
of working in the organisation. They write down key more then the pure sum of the individual opinions. It
words of evidence about strengths and areas for im- reflects the common vision of a representative group
provement. It is recommended to formulate the areas and in this way it corrects and goes beyond the sub-
for improvement as precisely as possible in order to jective individual opinions. Clarifying evidences and
make it easier to identify proposals for action at a later expressing the background to different views on
stage. They should then overview their findings and strengths and weaknesses are often considered to be
score each sub criterion, according to the scoring pan- more important than the scores.
el that has been chosen.

The chair must be available to handle questions from


the members of the self–assessment group during the The chair is responsible and has a key role in
individual assessment. He/she can also coordinate the conducting this process and arriving at a group con-
findings of the members in preparation for the consen- sensus. In all cases, the discussion should be based
sus meeting. on clear evidence of actions undertaken and results
achieved. In the CAF, a list of relevant examples is
Undertake consensus in group included, to help provide assistance in identifying ap-
As soon as possible after the individual assessments, propriate evidence. This list is not exhaustive nor is it
the group should meet and agree on the strengths, necessary to meet all the possible examples, only those
areas for improvement and the scores on each sub relevant to the organisation. However, the group is en-
criterion. A process of dialogue and discussion is nec- couraged to find any additional examples which they
essary, indeed essential as part of the learning experi- feel are relevant to the organisation.
ence, to reach consensus as it is very important to un-
derstand why differences regarding the strengths and The role of the examples is to explain the content of the
areas of improvement and scoring exist. sub criteria in more detail in order to:
1. explore how the administration answers the
The sequence for assessment of the nine criteria can requirements expressed in the sub criterion;
be established by the self-assessment group. It is not 2. provide assistance in identifying evidence; and
necessary for this to be in strict numerical order. 3. be an indication of good practices in that particu-
lar area.
The consensus finding
How can the consensus be achieved? How to score
In the process of arriving at consensus, a four-step The CAF provides two ways of scoring: the classical
method may be used: approach and the fine-tuned approach. Both scoring
1. Presenting all evidence concerning the identified systems are explained in detail in this brochure. It is
strengths and areas for improvement per sub cri- recommended to use the classical scoring system if an
terion – identified by each individual; organisation is not familiar with self-assessment and/
2. Reaching consensus on strengths and areas for or inexperienced in Total Quality Management tech-
improvement. This is usually reached after the niques.
consideration of any additional evidence or infor-
mation; Duration of the self-assessment exercise
3. Presenting the range of individual scores under Comparing the reality and the preference, based on
each sub criterion; the survey 2005, 2 to 3 days seems to be rather short
4. Reach consensus regarding the final scoring. to do a reliable self-assessment whilst 10 days or more
is too long. It is difficult to suggest an ideal time sched-
A good preparation of the meeting by the chairperson ule for a CAF self-assessment as there are too many
(e.g. collection of important information, coordination variables which include the objectives of management,
of the individual assessments) can lead to smooth run- the time, resources and expertise available for invest-
ning of meetings and important time saving. ment, the availability of data, stakeholder time and
information and political pressures. However to the
majority of organisations a duration of up to 5 days
is the norm. This includes individual assessment and
consensus meeting(s).
The large majority of organisations completed the
whole CAF application process in 3 months, including
33
the preparation, the self-assessment, the drawing of 1. It is an integrated systematic action planning for
conclusions and the formulation of an action plan. the whole span of the organisation’s functionality
and operability.
Three months seems to be an ideal lapse of time to 2. It comes as a result of the self-assessment report, so
stay focused. Taking more time raises the risk of re- it is based upon evidence and data provided by the
duced motivation and interest of all parties involved. organisation itself and – absolutely vital – from the
Furthermore, the situation might have changed be- aspect of the people of the organisation.
tween the start and the end of the self-assessment 3. It builds on the strengths, addresses the weak-
process. In such a case, the assessment and scoring nesses of the organisation and responds to each
may no longer be accurate. This is highly likely as im- of them with appropriate improvement actions.
proving an organisation using CAF is a dynamic, con-
tinuous improvement process and therefore updating Prioritise areas of improvement
data and information is part of that process. In preparing an improvement plan, the management
might wish to consider the use of a structured ap-
proach, including the questions:
Step 6 DRAW UP A REPORT DESCRIBING THE – Where do we want to be in 2 years in line with the
RESULTS OF SELF-ASSESSMENT overall vision and strategy of the organisation?
– What actions need to be taken to reach these
A typical self-assessment report should follow the goals (strategy/task definition)?
structure of CAF (as showed in scheme A) and consist The process for building an improvement plan could
at least of the following elements: be structured as follows:
1. The strengths and areas for improvement for each The management – in consultation with relevant stake-
sub criterion supported by relevant evidence; holders
2. A score which is justified on the basis of the scor- 1. collects ideas for improvement from the self-as-
ing panel; sessment report and collates these ideas for im-
3. Ideas for improvement actions. provement under common themes;
2. analyses the areas for improvement and suggest-
In order to use the report as basis for improvement ac- ed ideas, then formulates improvement actions
tions it is crucial that Senior Management officially ac- taking into account the strategic objectives of the
cepts the self-assessment report, ideally endorses and organisation;
approves it. If the communication process has worked 3. prioritises the improvement actions using agreed
well this should not be a problem. Senior Management criteria to calculate their impact (low, medium,
should reconfirm its commitment to implementing the high) in the improvement areas, such as:
improvement actions. It is also essential at this stage to – strategic weight of the action (a combination of im-
communicate the main results to people in the organi- pact on the stakeholders, impact on the results of
sation and other participating stakeholders. the organisation, internal/external visibility)
– ease of implementation of the actions (looking
into the level of difficulty, the resources needed
Phase 3 – Improvement plan/prioritisation and the speed of realisation);
4. assigns ownership to each action as well as a time
Step 7 DRAFT AN IMPROVEMENT PLAN schedule and milestones & identifies the necessary
resources (cf. scheme B).
Survey 2005: Lack of measurements
Many organisations encountered obstacles during It can be useful to link the ongoing improvement ac-
their first CAF application. The lack of measurement tions to the CAF structure in order to keep a clear over-
has obviously been the major problem in many public view.
organisations doing self-assessment for the first time,
very often resulting in the installation of measurement One way to prioritise is to combine:
systems as the first improvement action. 1. the level of scoring per criterion or sub criterion
which gives an idea of the organisations’ perform-
The self-assessment procedure should go beyond the ance in all fields,
self-assessment report in order to fulfil the purpose of 2. the key strategic objectives.
CAF implementation. It should lead directly to a report
of actions to improve the performance of the organisa- Recommendations
tion. This action plan is one of the main goals of the While a CAF self-assessment is recognised to be the
CAF self-assessment effort and also the means to feed start of a longer-term improvement strategy, the as-
vital information to the strategic programming system sessment will inevitably highlight a few areas that can
of the organisation. It must realise an integrated plan be addressed relatively quickly and easily. Acting on
for the organisation to upgrade its functioning as a them will help with the credibility of the improvement
whole. Specifically the core logic of the report is that: programme and represent an immediate return on
time and training investment, it also provides an in-
centive to continue – success breeds success.
34
It is a good idea to involve the people who carried out Step 8 COMMUNICATE THE IMPROVEMENT
the self-assessment in the improvement activities. This PLAN
is usually personally rewarding for them and boosts
their confidence and morale. They may also become As mentioned previously, communication is one of the
ambassadors for further improvement initiatives. critical success factors of a self-assessment and the
improvements actions that follow. Communication ac-
Survey 2005 – The members of the Self as- tions must provide the appropriate information with
sessment groups (SAG) the appropriate media to the appropriate target group
The members of the SAG have invested a lot of their at the appropriate moment: not only before or dur-
energy in the exercise, very often besides their usual ing but also after the self-assessment. An organisation
daily work. Very often they start their work in the SAG should decide individually whether or not it makes the
with some suspicion about the usefulness of the task, self-assessment report available, but it is good prac-
the engagement of the management, the dangers of tice to inform the whole staff about the results of the
being open and honest etc. After a while, when they self-assessment i.e. the main findings of the self-as-
see that things are taken seriously, motivation and sessment, the areas in which action is most needed,
even some enthusiasm raise and at the end they take and the improvement actions planned. If not, the pos-
the full ownership of the results. They have the po- sibility to create an appropriate platform for change
tential to become the most motivated candidates for and improvement runs the risk of being lost. In any
improvement teams and should be treated in accord- communication about results it is always good practice
ance with this role. to highlight the things that the organisation does well
and how it intends to further improve – there are many
At best, the action plan resulting from the self-assess- examples of organisations taking for granted their
ment should be integrated into the strategic planning strengths sometimes forgetting, or even not realising,
process of the organisation and become part of the how important it is to celebrate success.
overall management of the organisation.

35
Step 9 IMPLEMENT THE IMPROVEMENT PLAN manage improvements actions. To fully benefit from
the improvements actions they should be integrated in
As described in step 7, the formulation of the priori- the ordinary processes of the organisations.
tised improvement action plan is very important. Many
of the examples in the CAF model can be considered On the basis of the CAF self-assessment more and
as a first move towards improvement actions. Existing more countries are organising recognition schemes.
good practices and management tools can be linked The CAF self-assessment could also lead to a recogni-
to the different criteria of the model. Examples of them tion from EFQM Levels of Excellence (www.efqm.org).
are shown below.

)NVESTORS )3/ 5SER )MPROVEMENTACTIONS


"3# IN0EOPLE  -ANUAL
0EOPLE #ITIZEN
3URVEYS #USTOMER3URVEYS !UDITS

4HE#!&-ODEL
%.!",%23 2%35,43

0EOPLE 0EOPLE2ESULTS

#ITIZEN#USTOMER +EY
,EADERSHIP 3TRATEGY 0ROCESSES 0ERFORMANCE
/RIENTED
0LANNING 2ESULTS
2ESULTS

0ARTNERSHIP 3OCIETY
2ESOURCES 2ESULTS

6!4)/.!.$,%!2.).'
6!

0ERFORMANCE -ISSION #ITIZENOR "UDGETING )3/


-ANAGEMENT $EVELOPMENT 3ERVICE#HARTERS !CCOUNTING 

The implementation of these improvement actions Implementation of CAF action plans facilitates
should be based on a suitable and consistent ap- the permanent use of management tools such as
proach, a process of monitoring and assessment; Balanced Scorecard, customer and employee’s
deadlines and results expected should be clarified; a satisfaction surveys, performance management sys-
responsible person for each action (an “owner”) should tems, etc.
be assigned, and alternative scenarios for complex ac-
tions should be considered. Survey 2005 – CAF as an introduction
to TQM
Any quality management process should be based The study shows that the use of quality or
on regular monitoring of implementation and evalu- management instruments was limited before us-
ation of the outputs and outcomes. With monitoring it ers applied CAF. Most used are customer and
is possible to adjust what was planned in the course of employees satisfaction surveys, external and
implementation and post evaluation (results and out- internal audits, ISO 9000/2000 standard(s) with and
comes), to check what was achieved and its overall without certification, project management and BSC.
impact. To improve this it is necessary to establish ways The ambition to use more of these tools in the future
to measure the performance of the actions (perform- is very high.
ance indicators, success criterion, etc). Organisations
could use the Plan-Do-Check and Act cycle (PDCA) to
36
Step 10 PLAN NEXT SELF-ASSESSMENT

Using the PDCA cycle to manage the Action Plan im-


plies a new assessment with CAF.

Monitor progress and repeat the assessment


Once the improvement action plan is formulated
and the implementation of changes has begun it
is important to make sure that the changes have
a positive effect and are not having an adverse
effect on things that the organisation was previously
doing well. Some organisations have built regular self-
assessment into their business planning process – their
assessments are timed to inform the annual setting of
objectives and bids for financial resources.

The evaluation panels of the CAF are simple but pow-


erful tools to use when assessing the on-going progress
of the improvement action plan.

Survey 2005 – CAF is generally repeated


every 2nd year
The organisations consent that in order to be
effective, the CAF has to be applied several times.
There is a preference towards the use of CAF every 2
years (44%). The investments in the exercise and the
time needed to generate results in the improvement
actions support this view.

37
Ten steps to improve organisations with CAF

Phase 1 – The start of the CAF journey Step 5 Undertake the self-assessment
– Undertake individual assessment
Step 1 Decide how to organise and plan the – Undertake consensus in group
self-assessment (SA) – Score
– Assure a clear management decision in con-
sultation with the organisation Step 6 Draw up a report describing the re-
– Define the scope and the approach of the SA sults of self-assessment
– Choose the scoring panel
– Appoint a project leader
Phase 3 – Improvement plan/ prioritisation
Step 2 Communicate the self-assessment
project Step 7 Draft an improvement plan, based on
– Define and implement a communication plan the accepted self-assessment report
– Stimulate involvement of the staff in the SA – Prioritise improvement actions
– Communicate during the different phases to – Differentiate the actions within realistic time
all the stakeholders scales
– Integrate the action plan in the normal
strategic planning process
Phase 2 – Self-Assessment Process
Step 8 Communicate the improvement plan
Step 3 Compose one or more self-assess-
ment groups Step 9 Implement the improvement Plan
– Decide on the number of self assessment – Define a consistent approach of monitor-
groups ing and assessing the improvement actions,
– Create a self assessment group that is relevant based on the Plan-Do-Check-Act cycle
for the whole organisation in all its aspects, – Appoint a responsible person for each action
respecting a set of criteria – Implement the appropriate management tools
– Choose the chair of the group(s) on a permanent basis
– Decide if the manager should be part of the
self-assessment group Step 10 Plan next self-assessment
– Evaluate the improvement actions by a new
Step 4 Organise training self-assessment
– Organise information and training of the
management team
– Organise information and training of the self-
assessment group
– The project leader provides a list with all rel-
evant documents
– Define the key stakeholders, the products
and services that are delivered and the key
processes

38
Scheme A – Pro forma self-assessment sheet for classical scoring

#RITERION ,EADERSHIP
%VALUATIONOF#RITERION
#ONSIDEREVIDENCEOFWHATTHEORGANISATIONSLEADERSHIPISDOINGTO

3UBCRITERIA
0ROVIDEDIRECTIONFORTHEORGANISATIONBYDEVELOPINGITSMISSION VISIONANDVALUES
$EVELOPANDIMPLEMENTASYSTEMFORTHEMANAGEMENTOFORGANISATION PERFORMANCEANDCHANGE
-OTIVATEANDSUPPORTTHEPEOPLEINTHEORGANISATIONANDACTASAROLEMODEL
-ANAGERELATIONSWITHPOLITICIANSANDOTHERSTAKEHOLDERSINORDERTOENSURESHAREDRESPONSIBILITY

3UB 3TRENGTHS !REASFORIMPROVEMENT 3CORE*USTIFICATION /PTIONAL !CTIONITEMS


CRITERIA 









4OTAL

!VERAGE
ON

Scheme B – Action sheet

Action programme 1: (e.g.Leadership)


!CTION description of the action

3PONSOR the highest authority that is responsible for the item and wants and supports a specific
action; could be considered as the end user

!CTIONLEADER the person or service who is in charge of the action

!CTIONTEAM the individuals identified to work in implementing the action; can be people from inside
and/or outside the organisation

#ONTACT

Scope

Stakeholders

Strengths as defined in self-assessment

Context and areas for improvement

Alternatives to explore

Constraints

Human resources needed (in man/days)

Budget

Deliverable

Starting date

Estimated Deadline

39
Bench learning operates
4. The overall performance of the organisation

1. Definition An assessment of results in these key areas will give


The main purpose of establishing bench learning and/ us a comprehensive view of what an organisation is
or benchmarking activities is to find better ways of do- achieving and will provide us with performance data
ing things with a view to improving overall organisa- and appropriate metrics.
tion performance. This is normally based on better re-
sults achieved in other organisations. At its simplest, However, in order to offer the full range of benefits
benchmarking is a process by which an organisation that can be obtained by a bench learning activity, it is
finds relevant organisations with which it can compare, also necessary to consider the question of governance
or benchmark, its own organisation and performance. and how the organisation is managed; this is reflected
The technique can be a powerful and effective tool for in the enablers criteria of the CAF model, which de-
organisational development, as it exploits sound ba- scribe how the organisation approaches issues such as
sic principles such as “not re-inventing the wheel” and the setting of objectives, the development of human
“learning from others”. The CAF, and other relevant resources, the function of leadership, resources man-
organisational analysis tools, can be used to agement and processes, etc.
support the purpose.
Every function, process and task of the organisation
Unlike classical benchmarking, bench learning does can be the subject of bench learning. The advantage
not necessarily include searching for comparable or- of linking bench learning initiatives to CAF is that the
ganisations and using clear indicators for direct com- CAF framework with the 9 criteria and 28 subcriteria
parisons. It emphasises more the process of learning can be used to identify the organisations problem ar-
from others rather than making comparisons. The eas and look for appropriate bench learning partners
goal of bench learning is to learn from the strengths that have performed well in the given areas.
of other organisations, to learn from them the things A self-assessment with CAF should lead to the drawing
they do well, to search for inspiration in our own work up of an action plan addressing the areas of improve-
and to learn from and to avoid the mistakes that others ment. Bench learning with other organisations is just
have made. It is an active, continuous process and not one way to realise these improvement actions. As in
just a comparison of benchmarks: facts and measure- the case for self-assessment, bench learning has an
ments. inherent idea of continuity and performance improve-
ment over the long term.
Good practices are usually inextricably linked with
bench learning. The bench learning partners chosen Given the increased use of CAF in Europe, it has be-
should be organisations employing good practices come easier to find bench learning partners through
which- when adapted and implemented in your own CAF. The EIPA CAF resource centre, with the help of the
organisation – lead to improved performance. It is national correspondents and its network of organisa-
worth noting that when searching for bench learning tions, keeps track of CAF users in Europe and invites
partners the search should not be restricted to simi- them to introduce their good practices in the EIPA da-
lar organisations, indeed innovation is often inspired tabase.
through learning from dissimilar cross sector partners.
By implementing in your own organisation what you When registering as a CAF user at the website of the
have learnt through the bench learning process you European Institute of Public Administration (EIPA) –
are inevitably creating your own good practices. www.eipa.eu – an organisation is able to register its
organisation details, its CAF self-assessment scores
2. CAF and Bench learning (optional & confidential) and information on its good
Self-assessment is a preliminary step towards the proc- practices. By offering key information the database
ess of bench learning and the subsequent changes to can help public sector organisations identify suitable
be implemented as it allows for a diagnosis of the or- bench learning partners i.e. to allow a search for CAF
ganisation – the knowledge and understanding of its users in a particular country, sector of activity, or good
strengths and areas for improvement. Prior to intro- practice area.
ducing bench learning, it is important to have a clear
picture of the current performance of the organisation 3. Bench learning cycle and project
in order to decide on the areas/criteria that will be Schematically, bench learning can be presented as a
used as the basis for the improvement process. 5-step cycle:
1. Plan
Bench learning using CAF thus implies that an organi- 2. Collect, measure and compare
sation has assessed its performance in relation to at 3. Analyse
least four key areas: 4. Adapt
1. The people in the organisation 5. Evaluate and repeat
2. The customers
3. The environment in which the organisation
40
Bench learning Cycle

%6!,5!4% 0,!.
progress and REPEAT (what, how, when,
with whom)

"%.#(,%!2.).'#9#,%

)-0,%-%.4 #/,,%#4 -%!352%


the good practices in your !.$#/-0!2%
organisation interesting procedures,
!.!,93% strengths and results

areas for learning

1. Plan 3. Analyse
In the first step of bench learning projects – the plan- The third step is the analysis. Participant organisations
ning – suitable partners are searched, identified and are asked to define the causes of the problems that
approached. Bench learning projects can be set up occurred in each area. They are also asked, wherever
among two or more partners. It is very important to ap- possible, to determine the root causes of problems and
point a project manager in each organisation. Among to understand how the reasons can be key to mak-
the project participants a coordinator can be chosen. ing the successful first steps in resolution of problems.
The partners must agree upon the areas and/or results Once the problem causes are known, it is necessary to
that will be addressed taking into account the roles choose or adapt good practices or identify other po-
and contributions of the various partners. They should tentially successful solutions. It is also recommended
always have in mind balancing the contributions made that project participants determine why some proce-
and benefits received by the partners, creating a win- dures, results or methods are more suitable and suc-
win situation for all participants. The partners should cessful than others and document these findings.
also agree a code of conduct which may include dead-
line conformities and rules on confidentiality, manage- 4. Adapt
ment and security of information. The fourth stage is the implementation. It includes the
selection of good ideas, suggestions, procedures and
2. Collect, measure and compare solutions and their introduction into the daily practice
During the second stage, interesting procedures and of the organisation. The full agreement, involvement
suggestions from the partner organisations to address and participation of employees at this stage is crucial
the identified problems are collected as well as results to successful implementation. Employees should also
achieved in the relevant areas. This data gathering of course be aware of the progress of the project at all
can be done by well prepared questionnaires, through stages as part of the organisation’s normal communi-
participant meetings and/or by site visits. All informa- cation channels.
tion collected – information on successes and failures
– should be compared and/or measured and differ- A final report should be drafted including a list of the
ences and preconditions for success identified. good practice suggestions, their implementation and
expected results/outcomes.
41
5. Evaluate and repeat
The final stage is an evaluation of the results of the
project. An assessment is made of the results of the
bench learning project and decisions are taken on the
next steps. These steps may include improving exist-
ing processes, including new suggestions/ideas – the
main point here is that continuous improvement is a
dynamic process and affects, and therefore necessi-
tates the involvement of, all stakeholders. To measure
the improvements achieved on an ongoing basis it is
important to monitor progress, it is therefore recom-
mended that organisations repeat a full self-assess-
ment based on the CAF Model.

4. Potential Pitfalls
– To limit yourself to your own sector to look for
bench learning partners. Some processes such
as the measurement of customer or people sat-
isfaction – although from different sectors – are
common and can be compared effectively with
different kinds of organisations. It’s about “get-
ting out of the box”;
– To focus only on the comparison measures of
the performance, without taking into account
the processes and the activities that lead to good
practices;
– To expect that bench learning is going to be fast
or easy;
– Spending too much time and resource in one
specific phase of the process;
– Have the expectation that all the components
of the organisation can be compared with other
organisations;
– Asking for information and data without be-
ing prepared to share your own data and in-
formation with others, and inversely, to expect
that other organisations will openly share infor-
mation that is valuable to them in commercial
terms, although in our experience most organi-
sations are happy to share most information if
the right partnership is established at the out-
set; respecting others and working in the true
spirit of partnership is fundamental to successful
bench learning projects.;
– The longer the bench learning process takes,
the more difficult it is to maintain enthusiasm
and the commitment of people responsible for
promoting action and ultimately its implementa-
tion.

42
Glossary Action Plan
A document which is a plan of tasks, allocation of
responsibilities, goals for the implementation of the
Accountability project (e.g. targets/deadlines) and resources needed
Accountability is the obligation to answer for responsi- (e.g. hours, money).
bilities that have been conferred and accepted and to
report on the utilisation and management of resources Audit
entrusted.The people who accept accountability are Auditing is an independent appraisal function to ex-
responsible for answering questions and reporting on amine and evaluate the activities of an organisation
resources and operations that are under their control and its results. The most common audits are: financial
to those people who have to hold accountability. So audit, operational audit, ICT audit, compliance audit
both parts have their duties. and management audit. Three levels of auditing con-
trol activity can be distinguished:
Appraisal/Performance appraisal – Internal control carried out by management.
“Performance appraisal” needs to be understood – Internal auditing by an independent unit of the organi-
in the management context. Usually, the manage- sation. In addition to compliance/regulation activities it
ment system of an organisation will include the as- may also have a role in controlling the effectiveness of
sessment of individual employees’ job performance. the organisations internal management.
This practice helps to monitor the departmental and – External auditing done by an independent body
overall organisational performance by aggregating from outside the organisation.
the individual performance at different management
levels within the organisation. The personal appraisal Balanced Scorecard
interview between the individual employee and his/her The Balanced Scorecard (BSC) is a whole of quanti-
line manager is the most common way for appraisal tative measurements evaluating to what extent the
to be carried out. During the interview, in addition to organisation succeeds in realising its mission and
an appraisal of performance, other aspects of the in- strategic objectives. These measurements are built
dividual’s employment can be assessed including level up around four viewpoints: innovation and learning
of job knowledge and competences from which train- (people management), internal processes, customers,
ing needs can be identified. In a TQM approach, the and financial management. The indicators of each ap-
PDCA, based on continuous improvement, is used at proach are linked to each other through a cause-effect
the individual level: PLAN the job for the coming year, relationship. These relationships are based on hypoth-
realise the job (DO), CHECK your realisation during esises that have to be monitored permanently.
the performance appraisal interview and adapt (ACT)
if necessary for the next year: the objectives, the means The BSC is also very useful as a communication tool
and the competences. for management to inform the people in the organisa-
tion and the stakeholders to what extent the strategic
There are several ways to increase the objectivity of plan has been realised.
performance appraisal:
- The upward appraisal where managers are evalu- The Balanced Scorecard is increasingly used in the
ated by employees directly reporting to them. public sector in Europe.
- The 360 degrees appraisal where managers are
evaluated from different points of views: general It should be noted that the Balanced Scorecard can be
managers, peers, collaborators and customers. used within CAF assessment.

Benchmark
A measured achievement at a high level (sometimes
'%.%2!,-!.!'%23 0%%23 referred to as “best-in-class” see Benchmarking be-
low); a reference or measurement standard for com-
parison; or a performance level which is recognised as
the standard of excellence for a specific process.

Benchmarking
There are numerous definitions of benchmarking but
-!.!'%2).$)6)$5!,3 the key words associated with benchmarking are ‘to
make comparison with others ‘

“Benchmarking is simply about making comparisons


with other organisations and then learning the lessons
that those comparisons reveal“ (Source: European
Benchmarking Code of Conduct).
0%%23 #/,,!"/2!4/23

43
In practice, benchmarking usually encompasses: call this approach BPR (Business process Re-engineer-
– regularly comparing aspects of performance ing) or simply re-engineering. The idea of BPR is to
(functions or processes) with those organisations completely redesign the process, which creates oppor-
which are considered to be good practitioners; tunities for making a big leap forward or for accom-
sometimes reference is made to best in class but plishing an important breakthrough. Once this new
as no one can ever be certain as to who is best the process has been implemented, you may then return
term good is preferred; to the process of searching for ways to make gradual
– identifying gaps in performance; continual improvements to optimise the process.
– seeking fresh approaches to bring about improve-
ments in performance; Change management
– following through with implementing improve- Change management involves both generating the
ments; and needed changes in an organisation, usually preceded
– following up by monitoring progress and review- by Modernisation and Reform agendas, and master-
ing the benefits. ing the dynamics of change by organising, implement-
ing and supporting the change.
Benchmarking in European Public Administrations
usually focuses on the learning aspects and is now Code of conduct
more commonly referred to as ‘Bench learning’ as May be expressed or implied, Rules and Guidelines,
learning how to improve through sharing knowl- for standards of behaviour for individuals, profession-
edge, information, and sometimes resources, is al groups, teams or organisations. Codes of conduct
recognised to be an effective way of introducing may also apply to specific activities, such as auditing
organisational change. It reduces risks, is efficient and or benchmarking and often refer to ethical standards.
saves time.
Competence
– Strategic benchmarking Competences include the knowledge, skills and atti-
Strategic Benchmarking is used where organisa- tudes of an individual used in practise in a job situ-
tions seek to improve their overall performance by ation. When an individual is able to carry out a task
examining the long-term strategies and general successfully he/she is regarded as having reached a
approaches that have enabled high-performers level of competence.
to succeed. It involves comparisons of high-level
aspects, such as core competencies; the devel- Conflict of interest
opment of new products and services; a change A “conflict of interest” in the public sector refers to a
in the balance of activities or an improvement in conflict between the public duty and the private inter-
capabilities for dealing with changes in the back- est of a public official, in which a public official’s pri-
ground environment. vate-capacity interest could improperly influence the
performance of his/her official duties. Even if there is
Best/Good practice no evidence of improper actions, a conflict of inter-
Superior performances, methods or approaches that est can create an appearance of impropriety that can
lead to exceptional achievement. Best practice is a rel- undermine confidence in the ability of that person to
ative term and sometimes indicates innovative or inter- act properly.
esting business practices, which have been identified
through benchmarking. As with Benchmark it is prefer- Consensus
able to talk about “good practice” since one cannot be As the word implies this is about reaching agreement
sure that there is not a better one. and usually follows an initial self-assessment when in-
dividual assessors get together to compare and discuss
Bottom-up their individual assessments and individual scores. The
Direction of the flow of, for example, information or process usually ends with individual assessors reach-
decisions from lower levels of an organisation to high- ing agreement with a combined overall score and as-
er levels. The opposite is top-down. sessment for the organisation.

Brainstorming Consensus or Self-assessment report


Used as a team working tool to generate ideas without A report describing the results of self-assessment. This
constraints in a short period of time. The most impor- report must include strengths and areas of improve-
tant rule is to avoid any kind of criticism during the ment for the organisation. It may also contain (option-
ideas production phase. al) proposals for improvement in some key projects.

Business Process Re-engineering (BPR) Continuous improvement process


We can always make further improvements to an ex- The ongoing improvement of business processes in
isting process by means of minor adaptation (Kaizen terms of quality, economy or cycle time. The involve-
approach). In some case, this approach is no longer ment of all stakeholders of an organisation is normally
suitable for accomplishing the required goals and it a pre-requisite in this process.
may be necessary to redesign the whole process. We
44
Corporate social responsibility Efficiency
Corporate Social Responsibility is a commitment by Outputs in relation to inputs or costs. Efficiency and
private and public sector organisations to contribute Productivity may be regarded as one and the same.
to sustainable development working with employees, Productivity may be measured in ways that capture ei-
their families, local communities, and society at large ther the input of all factors of production (total factor
to improve the quality of life. The aim is to bring ben- productivity) or a specific factor (labour productivity or
efits both for organisations and wider society. capital productivity).

Cost effectiveness
The relationship between the effects that are implied Efficiency – Effectiveness – Economy
by the goals of the
organisation and
the costs – possi- #/34%&&%#4)6%.%33
bly including the
full social cost – of
achieving them.
See also effective- /"*%#4)6%3 2%3/52#%3 !#4)6)4)%3 /54054 /54#/-%)-0!#4
ness.

Critical success
factor %#/./-9 %&&)#)%.#9 %&&%#4)6%.%33
The prior condi-
tions that must be '/!,!#()%6%-%.4
fulfilled in order
that an intended
strategic goal can
be achieved. It highlights those key activities or results eGovernment
where satisfactory performance is essential in order for The use of Information and Communication Technol-
an organisation to succeed. ogy (ICT) in public administrations. Combined with or-
ganisational change and new skills it helps to improve
Citizen/Customer public services and democratic processes and also
The term citizen/customer is used to emphasise the strengthen support to public policies. eGovernment is
dual relationship between the public administration regarded as an enabler to realise a better and more
on the one hand, the users of public services and, on efficient administration. It can improve the develop-
the other hand, all the members of the public, who as ment and implementation of public policies and help
citizens and taxpayers have a stake in the services and the public sector to cope with the potentially conflicting
their outputs. demands of delivering more and better services with
fewer resources.
Diversity
Diversity relates to differences. It may refer to val- Empowerment
ues, attitudes, culture, philosophy or religious A process by which more authority is given to an in-
convictions, knowledge, skills, experience and lifestyle dividual or a group of people in the decision mak-
between groups, or individuals within a group. It may ing process, It may apply to citizens or employees by
also be on the basis of gender, national or ethnic ori- involving the person/group and by granting them a
gin, disability or age. degree of autonomy in their actions/decisions.

In public administration a diverse organisation would Ethics


be considered to be one which reflects the society it Ethics in Public Service may be defined as those com-
serves. mon values and norms to which public servants sub-
scribe in carrying out their duties. The moral nature of
Economy these values/norms, which may be stated or implicit,
Economy and economising refer to prudent financial refer to what is considered to be right, wrong, good or
management including reducing costs through more bad behaviour. Whereas values serve as moral princi-
efficient purchasing processes and saving money with- ples, norms may also state what is legally and morally
out affecting the quality of outputs or objectives. correct in a given situation.

Effectiveness Evaluation
Effectiveness is the relation between the set goal and Examining whether actions undertaken have given
the impact, effect or outcome achieved. desired effects and whether other actions could have
achieved a better result at a lower cost.

45
Evidence – Key performance Indicators
Information that supports a statement or fact. Evidence Those measures that are most critical, and meas-
is considered to be essential in forming a firm conclu- ure the performance of those key processes, es-
sion or a judgement. sentially contained in CAF criteria 4 and 5, which
are most likely, to influence the effectiveness and
Excellence efficiency of our key performance outcomes.
Outstanding practice in managing an organisation
and achieving results which are based on a set of Fun- A good example of customer satisfaction may be meas-
damental Concepts from Total Quality Management urements in customer/citizen results of the performance
as formulated by EFQM. These include: results orien- of the processes we have put in place for delivering cus-
tation, customer focus, leadership and constancy of tomer/citizen products and services.
purpose management by processes and facts, involve-
ment of people, continuous improvement, and innova- Innovation
tion, mutually beneficial partnerships, corporate social Innovation is the process of translating good ideas into
responsibility. new services, processes, tools, systems and human
interaction. An organisation may be described as in-
Follow-up novative when an existing task is performed in a way
Subsequent to a self-assessment process and changes new to the workplace, or when the organisation offers
to an organisation, a follow-up aims at measuring customers a new service in a different way such as self-
goal achievement against stated objectives. The anal- service via the internet.
ysis may result in the launching of new initiatives and
adjusting strategy and planning in accordance with the Input
new circumstances. Any kind of information, knowledge, material and oth-
er resources used for production.
Governance
The main elements of good public governance are de- ISO
termined by the appointed framework of authority and ISO (International Organization for Standardization)
control. It will set out: the reporting obligation on the is a global network that identifies what International
goals achievement, transparency of actions and deci- Standards are required by business, government and
sion making process to the stakeholders, efficiency and society, develops them in partnership with the sectors
effectiveness, responsiveness to the needs of society, that will put them to use, adopts them by transparent
anticipation of the problems and trends and respect of procedures based on national input and delivers them
the law and rules. to be implemented worldwide. ISO Standards specify
the requirements for state-of-the-art products, serv-
Human resources management ices, processes, materials and systems, and for good
Managing, developing and utilising the knowledge, conformity assessment, managerial and organisation-
skills and full potential of the employees of an organi- al practice.
sation in order to support policy and business planning
and the effective operation of its processes. Key performance results
The results the organisation is achieving with regard to
Indicators its strategy and planning related to the needs and de-
Measures that are indicative i.e. showing the outcome mands of the different stakeholders (external results);
of an action. and the results of the organisation in relation to its
management and improvement (internal results).
– Performance Indicators
These are the numerous operational measures Knowledge management
used in Public Administration to help us Knowledge Management is the explicit and systematic
– Monitor management of vital knowledge – and its associated
– Understand processes of creation, organisation, diffusion, use and
– Predict and exploitation.
– Improve
how we function and perform. It is important to note that knowledge encompasses
both tacit knowledge (that contained in people‘s
There are several terms used to measure organisation- minds) and explicit knowledge (codified and expressed
al performance; outcomes, measures, indicators, pa- as information in databases, documents etc.). A good
rameters. However measurement terminology is less knowledge programme will address the processes of
important and we should use terms with which we are knowledge development and transfer for both these
comfortable and familiar. If we follow Pareto’s principle basic forms. The most vital knowledge in most or-
we realise that around 20% of what we do will deliver ganisations is often related to: Customer Knowledge,
80% of our outcomes. It is important therefore that we Knowledge in Processes, Knowledge in Products and
at least measure the performance of those processes Services, customised to users‘ needs, Knowledge in
that are essential to the delivery of our desired results. People, Organisational Memory, drawing on lessons
46
from the past or elsewhere in the organisation, Knowl- Network
edge in Relationships, Knowledge Assets, measuring An informal organisation connecting people or or-
and managing intellectual capital. A wide variety of ganisations that may or may not have a formal line of
practices and processes are used in knowledge man- command. Members of the network often share values
agement. Some of the more common ones are: Creat- and interests.
ing and Discovering, Sharing and Learning (communi-
ties of practices), Organising and Managing. Objectives (goals/aims/targets)
A formulation of a desired situation describing the de-
Leaders sired results or effects as defined in the mission of the
Traditionally we associate the term Leader with those organisation.
responsible for an organisation.
– Strategic objectives
Leadership Global objectives for the mid-and long-term indi-
The way in which leaders develop and facilitate the cate the overall direction to which the organisation
achievement of the mission and vision of the organisa- wants to go. It describes the final results or effects
tion. It reflects how they develop values required for (outcomes) it wants to pursue.
long-term success and implement them via appropri- – Operational objectives
ate actions and behaviours. It indicates how leaders They are a concrete formulation of the strategic
are personally involved in ensuring that the manage- objectives, e.g. at unit level. An operational objec-
ment system is developed, implemented and reviewed tive can be immediately transformed into a set of
and that organisations permanently focus on change activities and tasks.
and innovation.
Organisational culture
Learning The total range of behaviours, ethics, and values which
The acquiring and understanding of knowledge and are transmitted, practised and reinforced by members
information that may lead to improvement or change. of organisations; influenced by national, socio-politi-
Examples of organisational learning activities include cal and legal traditions and systems.
benchmarking/ bench learning, internally and exter-
nally led assessments and/or audits, and best practice Organisational structure
studies. Examples of individual learning include train- The way an organisation is structured, i.e. the division
ing and developing skills. of work areas or functions, formal chains of communi-
cation between management and employees, and the
– Learning environment way tasks and responsibilities are divided throughout
An environment within a working community the organisation.
where learning takes place in the form of skill ac-
quisition, knowledge sharing, the exchange of ex- Output
perience, and dialogue on best practice. The immediate result of production, which may be ei-
– Learning organisation ther goods or services. There is a distinction between
An organisation where people continually expand intermediate and final outputs, the former being prod-
their capacity to achieve the results they desire, ucts delivered from one department to another within
where new and expansive patterns of thinking are an organisation, the latter outputs delivered to some-
fostered, where collective aspiration is set free, one outside the organisation.
and where people are continually learning within
the context of the whole organisation. Outcome
The overall effect that outputs have on external stake-
Mission holders or wider society.
A description of what an organisation should achieve
for its stakeholders. The mission of a public sector or- Example of Output and Outcome: Stronger conditions
ganisation results from a public policy and/or statutory for possessing firearms lead to fewer permits. The in-
mandates. termediate output is that there are fewer permits is-
sued. The final output is that there are less firearms
It is the organisation’s “raison d’être”. circulating in society. These outputs lead to the out-
come that a higher level of safety or feeling of security
The final goals an organisation sets out to achieve in the is achieved.
context of its mission are formulated in its vision.
Partnership
Collaboration with other parties on a commercial or a
non-commercial basis to reach a common goal, thus
creating added value for the organisation and its cus-
tomers/stakeholders.

47
PDCA cycle Process owner
A cycle of four stages one has to go through to realise The person responsible for designing, improving and
continuous improvement, as described by Deming: performing processes, their coordination and integra-
– Plan (project phase) tion inside the organisation.
– Do (execution phase) Her/his responsibilities include the following:
– Check (control phase)
– Act (action-, adaptation- and correction phase) – Understand the process: How is it carried out in
It emphasises that improvement programs must start practice?
with careful planning, must result in effective action, be – Target the process: How does it fit into the broader
checked and eventually adapted, and must move on vision? Who are the internal and external stake-
again to careful planning in a continuing cycle. holders and are their expectations met? How does
the process relate to other processes?
People – Communicate the process to the internal and ex-
All individuals employed by the organisation including ternal stakeholders
full time, part time, and temporary employees. – Monitor and measure the process: To what extent
is the process efficient and effective?
Perception measurement – Benchmark the process: How do other organisa-
Measurement of subjective impressions and opinions tions perform and what can we learn from them?
of an individual or a group of people, e.g. the custom- – Envision the process: What is the long-term
er’s perception of the quality of a product or service. vision for the process and what do we have to do
to reach it?
Performance – Report the process: What exactly can be improved?
A measure of attainment achieved by an individual, Where are the weaknesses and how can they be
team, organisation or process. targeted?

Public policy By employing these steps the process owner has the
A purposeful course of action followed by governmen- chance to improve the process continually.
tal bodies and officials in dealing with a problem or
a matter of public interest. This includes government Public service organisation/Public adminis-
action, inaction, decisions and non-decisions and it tration
implies choices between competitive alternatives. A public service organisation is any institution, serv-
ice organisation or system, which is under the policy
Procedure direction of and controlled by an elected government
A description of how activities should take place, in a (national, federal, regional or local). It includes or-
detailed and defined way. ganisations that deal with development of policy and
enforcement of law, i.e. matters that could not be re-
Process garded strictly as services.
A process is defined as a set of activities, which trans-
forms a set of inputs into outputs, thereby adding val- Quality
ue. The nature of processes in public service organisa- Delivering quality in the public sector is concerned with
tions may vary greatly, from relatively abstract activities maximising the value of products and services for all
such as support for policy development or regulation stakeholders within a political and financial frame-
of economic activities, to very concrete activities of work. TQM focuses on procedures and processes that
service provision. are deemed instrumental in promoting quality.

One can distinguish between: – Quality control


– Core processes are critical to the delivery of prod- Systematic control of the organisation’s abil-
ucts and services ity to create professional quality in the serv-
– Support processes deliver the necessary resources ices it offers and delivers. It is systematic in that
– Management processes steer the organisation and the results emerge from a planned, deliberate
support processes effort. Some organisations choose a system for
– Key processes are those of the above pro- quality control based on a quality manual or proc-
cesses that are of utmost importance for ess manuals. Quality control systems usually con-
the organisation. tain a select collection of guidelines for implement-
ing quality controls in practice, and how quality is
Process diagram measured and improved.
A graphical representation of the series of actions tak- – Quality management
ing place within a process A method for ensuring that all the activities neces-
sary to design, develop and implement a product
Process map or service are effective and efficient with respect to
A graphical representation of the series of actions tak- the system and its performance.
ing place between processes.
48
– Quality management system Top-down
A system that outlines the policies and procedures Flow of information and decisions from upper levels
necessary to improve, control and integrate the to lower levels within an organisation. The opposite is
processes eventually leading to a better perform- bottom-up.
ance.
TQM (Total Quality Management)
Resources A customer focused management philosophy that
Resources include the knowledge, labour, capital, seeks to continuously improve business processes us-
buildings or technology an organisation uses to per- ing analytical tools and teamwork involving all em-
form its tasks. ployees. There are several TQM models, the EFQM,
the CAF, the Malcolm Baldrige (USA), ISO 9004 being
Role model the most commonly used.
Persons or organisations who serve as a model in a
particular behavioural or social role for other persons Transparency
to imitate or learn from. Transparency implies openness, communication, and
accountability. It is a metaphorical extension of the
SMART objectives meaning used in the physical sciences: a „transparent“
Objectives state what an organisation has set out to object is one that can be seen through. Transparent
achieve. It is recommended that objectives should be procedures include open meetings, financial disclo-
SMART: sure statements, the freedom of information legisla-
– Specific – precise about what you are going to tion, budgetary review, audits, etc.
achieve
– Measurable – with quantified objectives Value
– Achievable Value refers to monetary, welfare, cultural and
– Realistic – Are the necessary resources available? moral values. Moral values are considered to
– Timed – within manageable timing be more or less universal, whereas cultural val-
ues may shift between organisations as well as
Stakeholders between countries. Cultural values within an or-
Stakeholders are all those who have an interest, wheth- ganisation should be transmitted and practised
er financial or not, in the activities of the organisation, and also be related to the mission of the organisa-
for example, political decision-makers, citizens/cus- tion. They may be quite different between non-profit
tomers, employees, society, inspection agencies, me- organisations and private businesses.
dia, partners, etc. Government organisations are also
stakeholders. Vision
The achievable dream or aspiration of what an
Strategy organisation wants to do and where it would like to
A long-term plan of prioritised actions designed be.
to achieve a major or overall goal or to fulfil a
mission. The context of this dream and aspiration is
determined by the mission of the organisation.
Survey
To collect data on opinions, attitudes or knowledge
from individuals and groups. Frequently only a cross-
section of the whole population is asked to partici-
pate.

SWOT Analysis
Analysis of the Strengths, Weaknesses, Opportunities
(potential advantages) and Threats (potential difficul-
ties) of and to an organisation.

Term
Period of time in which results should be achieved
– Short term
Refers usually to less than one year
– Medium term
Refers usually to periods of one to five years
ahead
– Long term
Refers usually to periods of more than five years

49

S-ar putea să vă placă și