Sunteți pe pagina 1din 6

Examples of success criteria, indicators and baselines for different types of projects

Contents
1. Energy audits
2. Energy advice
3. Financial support and services
4. Information and education campaigns
5. Metering and feedback
6. Voluntary programmes and commitments

Notes concerning the tables

Your project may have other success criteria than those exemplified here. Examples of other success criteria can include particular social goals like reduction
of fuel poverty or stimulation of employment in a certain region. Please take these examples as indicative only. For further reading and more indicators, we
recommend the following references and sites:
IEA DSM Evaluation Guidebook, Volume 1 (http://www.ieadsm.org/)
Changing Energy Behaviour: Guidelines for Behavioural Change Programmes (http://www.energy-behave.net/pdf/Guidelines_Changing_Energy_Behaviour.pdf)
AID-EEE Guidelines for the monitoring, evaluation and design of energy efficiency policies (http:// http://www.aid-ee.org/)

It may be difficult to define baselines for many of the indicators, and all projects cannot afford to conduct baseline studies. Depending on your resources and
the expectations of your funding bodies, you may consider using proxy data for baselines like:
national and regional statistics
existing general knowledge, attitude and behaviour surveys in your country
expert interviews on the current status at the start of the project
survey with small, random sample of target group
available default data from existing CO2 tools or existing data on the specific consumption of various appliances
1. Energy audits: examples of success criteria, indicators, baselines and ways to measure
Possible success criteria Possible indicators Possible baselines How to measure
Increased customer awareness Number of audits conducted (or share of audited Depends on target group: maybe Counts and records of audits
of energy use facilities in a sector) 0, maybe people already had one:
find out via survey?
Increased customer awareness Attention to and use of audits/ Number of investments Depends on target group: maybe Number of changes
of energy use made 0, maybe people already had one: implemented, Number /
find out by means of survey? (to test amount of investments made
for additionality, find out plans of
investments/changes before the Amount of energy use
project)
Reduced energy consumption Savings potential what measures have been Energy consumption before audit Estimation of savings during
identified and the savings in energy and planning phase of project and
corresponding financial costs and savings (Default data from statistics) evaluation of savings after
Theoretical savings potentials of implemented implementation of measures
measures what measures have been undertaken
and estimate of energy savings thus achieved
Measured savings at the site level shows whether
implemented measures actually reduce the energy
consumption as expected
Verified results usually a statistical study of results
of implemented measures

Number of new energy management practices Existing level of investments, Survey, measurements of
adopted (self-reported behaviour) practices or energy consumption energy consumption
Customers & stakeholders: Customer & stakeholder survey: overall satisfaction Customer & stakeholder Survey including customer
overall satisfaction with the (project, process, outcomes) expectations ratings (and qualitative data)
programme
2. Energy advice: examples of success criteria, indicators, baselines and ways to measure
Possible success criteria Possible indicators Possible baselines How to measure
Reaching a large number of Number of advice contacts, number of people Available advice at the start of the Keeping count and records of
people attending events project customer contacts
Mapping problems and offering Relevance to recipients/participants Status of know-how /information of (Satisfaction) survey using
suitable solutions participants quantitative and qualitative
data
Promotion of energy efficiency Share of new investments generated as a result of Level of f energy investments at the Records of number and
investments and improved the advice1 among those receiving advice start of the project amount of investments
energy management practices
Share of advice recipients reporting new practices Status of recipients practices at the Survey, self-reported
start of the project behaviour
Increased customer awareness Knowledge tests Baseline customer survey: Customer surveys/interviews
and competency, capacity to Self-reports of new practices (also changes in knowledge and practices at the start comparing knowledge and
advise others physical environment that allow new practices) of the project practices before/after project

Customers: lower energy bills, Customer satisfaction with the outcomes of the Customer expectations Customer survey
improved comfort, convenience project
Customers & stakeholders: Overall satisfaction (project, process, outcomes) Customer & stakeholder Survey
overall satisfaction with the expectations
programme

1
Especially for larger investments, it is not likely that all investments made within the target group are directly due to the advice. People considering an investment are more
likely to seek advice. Thus, it is necessary to find out how many of the customers would have made the investment even without the advice.
3. Financial support and services: examples of success criteria, indicators, baselines and ways to measure
Possible success criteria Possible indicators Possible baselines How to measure
Promotion of energy efficiency Number or share of customers making Number at start of initiative Customer contacts and
investments use of support/service Level of investments at the start of the records
initiative
Number/value of investments made
Energy savings from the measures Energy consumption compared to Figures on the total consumption of electricity kWh consumption, gas/oil
applied baseline or heat / figures on specific consumption of consumption
appliances Audit/analysis
Promotion of low-carbon solutions: Increase in the adoption/market share Adoption/market share of low-carbon solutions Sales statistics, market share
e.g. appliances, technology, systems of low-carbon solutions at the start of the project statistics?
of provisions, behavior options CO2 profile Carbon footprint of
households or enterprises
Cost-effectiveness Money and other resources Comparison to other projects/programmes Net Present Value of
used/energy or CO2 emissions saved with the same goal programme impacts i.e., a
sum of the benefits of the
programme during its effective
period divided by the costs of
the programme plus the cost
of capital (interest rate)
Customers: improved comfort, Experience of improved comfort, Baseline assessment (pre-project survey) of Survey /questionnaire on
convenience convenience current feeling of comfort and convenience qualitative data
Customers: lower energy bills, kWh used per month/per year, Monthly energy (or yearly average) of energy Check bills, but take into
used before start of project, statistics/old bills account: free rider or
before measures taken deadweight effects, rebound
effect
Customers & stakeholders: overall Experience overall of satisfaction Customer & stakeholder expectations Customer & stakeholder
satisfaction with the project (project, process, outcomes) survey
4. Information and educations campaigns: examples of success criteria, indicators, baselines and ways to measure
Possible success criteria Possible indicators Possible baselines How to measure
Reaching a particular audience with Products delivered by the campaign, Amount and quality of information existing Number of newspaper/online
the intended message media & partners involved, number of items, number of readers,
people exposed to the message clicks on webpage
Changes in awareness, knowledge, Changes in awareness, knowledge Pre-project survey on the level and quality of Survey, self-report on
attitudes and internalised norms (i.e., attitudes consumers knowledge and skills awareness, attitude;
what people feel they should do) information
Increased information search on Pre-project sales statistics on energy efficient Sales statistics/market share
energy-efficient products products, interviews with salespersons information/ information from
appliance shops
Awareness of energy efficient products
and changes in future decision-making
processes
Changes in behaviour Self-reported behaviour Pre-project survey Survey, self-reports e.g. via
energy diary

5. Metering and feedback: examples of success criteria, indicators, baselines and ways to measure
Possible success criteria Possible indicators Possible baselines How to measure
Increased customer awareness of Attention to and use of feedback Pre-project survey: check of current Comparison of awareness
energy use self-report from survey awareness and use of feedback (if any) before/after project on the
basis of surveys
Reduced energy use Changes in energy use after feedback Energy use before provision of feedback kWh/gas/oil consumption
Overall satisfaction with the project Customer survey: overall satisfaction Customer expectations Customer/stakeholder survey
(e.g. the extent to which it is (project, process, outcomes)
perceived of as useful and interesting
by the recipients)
6. Voluntary programmes and commitments: examples of success criteria, indicators, baselines and ways to measure
Possible success criteria Possible indicators Possible baselines How to measure
Getting energy users on board Number of participants Number before project Participant count

Supporting change Number of participants receiving Number before project Participant count
training etc.

Improvements made Number of improvements made Number before project Counting and keeping records
of improvements made

Energy conservation, CO2 reductions Changes in energy consumption, Energy consumption (CO2 emissions) when kWh/gas /oil consumption
in target group calculated CO2 emissions joining the project resulting emissions
Default data form statistics/calculations Carbon footprint of
household /enterprise

Customers & stakeholders: overall Overall satisfaction (project, process, Customer & stakeholder expectations Customer & stakeholder
satisfaction with the programme outcomes) survey on willingness to
participate again / to realize
the recommendations