Documente Academic
Documente Profesional
Documente Cultură
Briefing Paper
Measuring Smallholder
Impact by Agribusinesses
The business case for supply chain sustainability has Companies often have a commercial incentive to
evolved significantly in recent years. An increasing start data collection, such as obtaining information
number of agribusiness companies have realized from farmers on cash flows in order to reduce side
the importance of incorporating sustainability selling. This can also lead to understanding of
requirements into their supply chain programs in interdependencies with the socio-economic context
order to secure their own brand value, manage legal, of smallholder farming, and drive interventions
regulatory and reputational risks as well as foster that deepen positive impact and promote supply
product innovation and explore new markets. chain sustainability. Findings on impact can also be
While many companies have incorporated smallholder shared with Governments, shareholders and other
farmers into their supply chains, it remains difficult to stakeholders to show how institutions are bringing
access data on how trade is impacting these farmers’ value to communities they work with.
livelihoods. There is a dearth of empirical evidence
on which trading practices and investment vehicles Tracking progress on sustainability and livelihood
can best deliver development benefits to poor farmers conditions at the farm and household level is
while also strengthening commercial efficiency challenging. Smallholder supply chains present
and stability. complex social and economic questions relating to
sustainability. They are characteristically diverse,
containing many producers who may or may not keep
written records and often include a wide range of farm
sizes and livelihood statuses.
1
1. The business case for measuring impact on farmer livelihoods
Companies are looking for cost-effective ways to What is Supply Chain Sustainability?
measure sustainability to increase transparency
about the impact of their supply chains and be Supply chain sustainability is the management of
better informed about when and where investment environmental, social and economic impacts and
in sustainability initiatives is warranted and where the encouragement of good governance practices
it is not. This note describes some of the methods throughout the lifecycles of goods and services.
currently under development for measuring impact The objective of supply chain sustainability is long
on farmer livelihoods within supply chain. It does not term viability of production, which can be achieved
attempt to capture the full range of measurement by ensuring long-term environmental, social and
methods used in poverty alleviation and rural economic value for all stakeholders involved in
development programs. bringing products and services to market
Through supply chain sustainability,
companies protect the long-term viability of their
business and secure a social license to operate.
There are a large range of assessment approaches improve productivity and has a reporting requirement
in terms of their scope and precision. The options for to the donor, may choose and have access to
measurement can be placed along a continuum from resources to carry out a robust household level impact
no measurement at all, to proxy or basic commercial evaluation. However, that may be more difficult if
metrics, to deep-dive rigorous impact assessments a company were paying for the impact evaluation
that are able to attribute change to specific through core business funds.
interventions. There are different costs, timeframes,
and levels of robustness and credibility involved It’s likely that a company plays different roles
(see Figure 1). in different projects which can alter the type of
assessment carried out as well as any additional
The starting point for any company exploring the activities required to enable the assessment to take
different options is to clarify the specific purpose of place and be effective. For instance, as the lead
the assessment and the desired change. With a strong firm in a supply chain with subsidiary companies
theory of change and a clear purpose and audience, which deal more directly with producers, the focus
learning questions will become apparent, which then may be on certification. Whereas in another supply
determine the appropriate indicators to track. This chain, the same company may trade directly with a
process increases the likelihood that data collection farmer organization and be better placed to collect
will be useful and produce actionable results. additional farmer level data. In other contexts, where
a company purchases crops from third parties who
The purpose of measuring impact is strongly manage the entire supply chain, the supply chain
influenced by the context of the investment and its would need to be mapped to understand the players
desired effect. For instance, a company that is part and the relationships before carrying out
of a large donor-supported sustainability project to an impact study.
2
2.The starting point for impact measurement: defining the purpose
Cost
Source: Kuit Consultancy (2015)
3
3.What is being measured and how?
Some companies are shifting from a focus on Different types of data collection system
productivity to profitability (see box). Profitability (or
efficiency) can be measured on the main cash crop • Broadly speaking there are three main types of
or the whole farm operation. Small farmers often data collection system in use:
have a diversified farming system, which includes
both cash and food crops. In addition to farming, • Commercial systems - these capture basic
they may also derive income from off-farm activities. information on trade flows, volumes, prices,
Food crops play an important role in both the qualities and sometimes future crop expectations.
nutrition needs of a household, as well as potentially
generating additional cash flow during the lean • Internal Control systems - these are often added
season. on top of commercial systems and tend to cover
basic household and farm information such
To adequately assess impact of farming on the as: farm size (estimated, or GPS measured),
household’s economic viability, the entire farm and location, household size, education level, yield
non-farm economic activities need to be estimates, number of trainings received, and
taken into account. level of compliance with one or more certification
standard(s).
The following metrics are central to assessing
economic sustainability of a farming operation: • Surveys, deep-dive studies, and case studies
Land area, household size, net incomes of key crops - these deal with a small sample size of the
(revenue-costs), estimated value of self-consumed supply base, but provide a much greater level of
crops, and net off-farm income. detail. Such surveys tend to be donor-driven and
contracted to third party researchers, although
Context matters some companies conduct their own research.
Sustainability, by definition, necessitates balancing Surveys, deep-dive studies and case studies can be
social, environmental and economic factors. An assigned to three categories when comparing cost of
oversimplification of sustainability, by prioritizing implementation and scientific rigour:
economic factors takes a short term perspective
and risks the omission of key factors that can • Case studies - cost savings are achieved by using
compromise long term viability of projects, a small sample size, rigour suffers as control
investments, and reputation. groups are not used and sample sizes tend to be
For example, if yields are increased by clear-cutting too small to be considered representative. Usually
a forest, which results in soil erosion and silted a single measurement is taken.
waterways, this is unlikely to lead to a • Qualitative surveys - sample sizes can be
sustainable outcome. larger, control groups may be used, but not per
Improving incomes may benefit the farming definition. Cost is contained by not relying on
household as a whole, but income and expenditures advanced statistical modelling and pairing of
may not be equitably controlled or distributed among comparable farmers in control and treatment
household members, especially women. groups.
• Deep-dive impact assessments - if properly done
Economic metrics should therefore be both these types of studies provide the best insight
understood and interpreted in a broader social in causal relations of project interventions and
and environmental context. A multi-dimensional observed effects. Larger, representative samples
view of sustainability would include measurement are used. By taking multiple measurements over
of the following impact areas: livelihoods, gender, time change can be observed. The use of control
environmental performance, farm productivity, groups allows change to be attributed to project
access to services and trading relationships. interventions. Cost is driven by sample size and
the use of relatively expensive data analysts.
4
3.What is being measured and how?
assessment tools have been created (see section track change over time. The goal of performance
4). Another way to make measurement affordable measurement is to provide modest (in scale, scope,
is by switching from deep dive studies that assess and cost) approaches to measuring conditions and
impact at a snapshot in time (and compare it to change that complement other more sophisticated
a baseline year), to measuring sustainability and impact measurement techniques. Performance
progress in real time. More frequent monitoring measurement can be useful for a single study to
allows the practitioner to build rapid information measure current conditions of producers within a
feedback loops in order to enable adaptive supply chain (such as average farm productivity at
management, experimentation and learning from the farm level or average household revenue), and
evidence about what works when engaging with for repeated measurements of whether activities are
smallholder supply chains. The biggest return on being accomplished as expected, and whether the
investment of impact measurement is around short main outcomes are moving in the right direction.
term monitoring, particularly around adoption of
promoted practices. This approach can allow for some general analysis
of correlation between the adoption of better
Partnerships with other stakeholders in the management practices and specific outcomes e.g.
supply chain also reduce costs as there are often crop yields, but is not rigorous enough to demonstrate
complementary data requirements across different attribution of outcomes. An example of this approach
companies. The marginal costs of additional data is the annual metrics collected by voluntary standards
points can be low, so it is possible to add in extra systems complemented by the rigorous, third
indicators that meet multiple information needs. party impact evaluations commissioned by ISEAL’s
The lightweight data collection method known Demonstrating and Improving Poverty
as Performance Measurement is designed to Impacts project.
measure status (current stage of conditions) and
The following include examples of methods in use: the PPI in agricultural value chains and raised
some questions, such as whether the PPI can
• Progress Out of Poverty Index (PPI) – this replace household income and asset questions
was developed by Microfinance Risk Management in performance measurement surveys. COSA
L.L.C. and Grameen Foundation. It is a simple conducted a similar study in 2015 built on data
poverty assessment tool that collects objective from four projects in Mexico, Guatemala, Peru and
information to determine household poverty Colombia. The findings supported the PPI’s use
levels. The PPI provides organizations with in agricultural supply chains. In the studies, there
poverty information in terms of globally accepted was a strong negative correlation between net
international poverty lines and nationally income from crops and the poverty rate calculated
recognized poverty lines. Organizations can by the PPI, reinforcing expectations. There was
understand if they are reaching populations living also a clear relationship between the PPI and food
under the $1.90 day/PPP or national poverty lines. security.
If users continue to track poverty status over time,
they can understand whether they are moving out • Farmer Field Books – this method has been
of poverty. used in coffee and cocoa for over 15 years in
around 10 countries covering thousands of
• The PPI tool has been assessed by both farmers. It has been selected as the most capable
Committee on Sustainability Assessment (COSA) farm data collection tool by the Sustainable
and the Sustainable Food Lab (SFL) for its Agriculture Initiative Platform . Costs are reduced
suitability for use in agricultural supply chains. by focusing on a limited number of indicators
SFL carried out a pilot study of the PPI with the and by using data that companies could collect
Kenyan Tea Development Authority. The test themselves to support their project interventions.
increased the SFL’s confidence in the use of
5
4.What are the different methods in use by agribusinesses to measure impact
on smallholder farmers?
6
4.What are the different methods in use by agribusinesses to measure impact
on smallholder farmers?
Embedding a performance measurement program Where there is visibility into the chain, and producers
in the operations of a supply chain can provide key are known, coordinated supply chain engagement is
stakeholders with regular reporting of producer necessary in order to successfully embed the data
level data, which builds company information and collection in the business systems. Practitioners must
knowledge over time and can directly influence work with those often in contact with the producers
management decisions around the effectiveness of to understand their systems and the ways they work
sustainability strategy. Embedding the data collection with smallholders in order to design an approach
in the chain may lead to opportunities for more that does not place too much burden on one party.
frequent data collection than occasional collection For example, Agromite provides farm mechanisation
efforts from outside the system. and associated training to rice farmers in Ghana.
Leveraging this close contact with farmers, they
In supply chains where there is little visibility, it can partnered with Prorustica to also provide training on
be hard to reach producers. There may not be enough the financial aspects of rice farming and in return
traceability to determine which specific producers collect on-farm financial data. Costs are initially
work within the identified supply chain, producers supported by the DFID Connect to Grow programme.
may be selling into multiple markets at once or there
is a commodity exchange system. In these instances, Some opportunities for embedding data collection
embedding data collection within the supply chain is include coordinating it with:
unlikely to be possible. • Training and extension services
• Data collection for certification audits
• Internal Control audits where farmers are
organized in groups that have hired technical
auditing staff
• Ongoing data collection that takes place when
crops are delivered and farmers receive payment.
7
6.Shared approach to performance measurement
Sustainability can be tackled in a non-competitive data for firms, producers, and policymakers to better
space, where companies can share best practices and manage their efforts. ISEAL Alliance works to works
insights for greater impact, especially as it relates to strengthen sustainability standards systems by
to farmer productivity and community development. developing codes of conduct and promoting standards
Shared approaches have the potential to reduce costs as crucial tools to meet sustainability targets among
significantly. business and government.
There are several initiatives taking place that COSA, ISEAL Alliance and the Sustainable Food Lab
are supporting collaborative efforts to ensure are collaborating to promote a shared approach to
consistency and alignment of indicators to measure performance measurement in situations where the
the short, medium, and long term outcomes of same types of learning questions are being asked. A
agriculture systems. For instance, The Committee “shared approach” can be appropriate around the use
on Sustainability Assessment (COSA) is a neutral of common indicators, metrics, survey questions and
and non-profit global consortium with a mission data collection method. This is an ongoing, iterative
to accelerate sustainability in agriculture via the process and new studies are frequently being carried
advancement of transparent and science-based out to test indicators and metrics in smallholder
assessments. Its objective is to provide practical chains. It is expected that collective understanding
measurement tools and to help interpret reliable and agreement will evolve and improve over time.
7.CASE STUDY SABMiller : Impact Measurement Approach and Deep Dive in Uganda
8
7.CASE STUDY SABMiller : Impact Measurement Approach and Deep Dive in Uganda
9
6.Shared approach to performance measurement
10
ANNEX 1 Examples of insights from the IITA impact study on NBL supply chains
Gender and Women’s Empowerment – There are significant opportunities to further promote
According to NBL data, an estimated 40% of the joint participation and decision-making by women and
top ten farmer associations supplying NBL are led men in all aspects of crop production- from ensuring
by women. However in most farming households, adequate women’s representation within aggregators,
it is mostly men who participate in agricultural agents and farmer groups to identifying how delivery
extension services and farmer groups while women’s models for training services can be made more
participation is relatively limited. The study found that suitable for women (e.g. female trainers, inviting
sorghum earnings can increase from $106 per acre men and women to trainings, suitability of timing and
to $124 per acre when husband and wife allocate curriculum etc). It is important to understand the
and manage plots together and both have access to local context and culture so that any efforts towards
agricultural training. gender mainstreaming are appropriate to local norms.
11
ANNEX 2 Key references
COSA. 2015. Testing the “Progress out of Poverty Sustainable Food Laboratory (2014) Using the
Index”: Synthesis Update to 2013-14 Report. The Progress Out of Poverty Index in Agricultural Value
Committee on Sustainability Assessment. Chains. A Case Study in Kenyan Tea
COSA, ISEAL, Sustainable Food Lab. Measuring Sustainable Food Laboratory (2014) Performance
Smallholder Incomes: Towards better alignment and Measurement in Smallholder Supply Chains: A
reporting of farm economic metrics A joint guidance practitioners guide to developing a performance
document.(forthcoming October 2016) measurement approach
Kuit Constancy (2015) Common Data Collection The Sustainable Trade Initiative (2016) Service
and Management Protocol: Using Company Data in Delivery Models: Insights for continuous improvement
Outcome-Impact Assessments and farm impact
Nestlé (2015) The Rural Development Framework. True Price, Deloitte, EY, PwC. (2014) The Business
Findings from Studies in 11 Countries and Implications Case for True Pricing. Why you will benefit from
for our Future Work on Rural Development measuring, monetizing and improving your impact
http://www.nestle.com/asset-library/documents/ http://trueprice.org/wp-content/uploads/2015/02/
library/documents/corporate_social_responsibility/ True-Price-Report-The-Business-Case-for-True-Pricing.
nestle-rural-development-framework-update2015.pdf pdf
Prorustica (2016) Farming as a Business
Training & True Price and IDH (2016) The True Price of Cocoa
Data Collection Method https://www.growafrica.com/ from Ivory Coast
groups/farming-business-training-data-collection- United Nations Global Compact (2015) Supply Chain
method Sustainability. A Practical Guide for Continuous
Improvement https://www.unglobalcompact.org/
docs/issues_doc/supply_chain/SupplyChainRep_
spread.pdf
12
Contributors
13
Grow Africa Smallholder Working Group
Briefing Paper
Measuring Smallholder
Impact by Agribusinesses
www.growafrica.com
www.agra.org
14