Documente Academic
Documente Profesional
Documente Cultură
Summary
If there is one thing that constitutes a challenge to health promotion specialists,
it is how to demonstrate the effectiveness of the approach. The demonstration
of evidence is difficult because of the methods used for its evaluation. This
is more so in Africa where the concept has not been fully adopted. The
development of health promotion in Africa is in the early stages and we
recognize that talking about its effectiveness to generate this evidence might
be premature and a difficult exercise. But several attempts have been made to
generate this evidence as illustrated in this book. In this chapter, we discuss
the methodological steps necessary for the evaluation of health promotion
effectiveness on the continent.
1.0 Introduction
When considering health systems in many occidental countries, it is notable
that those which are successful are vigorously applying the health promotion
concept in their health systems (e.g. Canada, Australia, Northern Europe, etc).
AIthough health promotion effectiveness is quite evident in these countries,
assessing this evidence raises sorne methodological issues (Nutbeam, 2000).
In Africa, on the contrary, the health system is inundated with a myriad of
health challenges emanating from communicable non-communicable and
neglected tropical diseases. Therefore, the question is: Is it easy to talk about
effectiveness and more so its evidence in the African context? We shall see in
the following paragraphs what health promotion is about in the context of the
developed and developing world and what this implies in generating evidence
of its effectiveness. We shall begin by addressing what we mean by the concept
of evidence of effectiveness.
26 . H EA LT H PRO MOT ION E F FEe T 1 VEN E S S: MET H 0 DOL 0 G 1 CAL 1 S SUE S
2.0 Definitions
Evidence: Something is evident when it is apparent, manifest, obvious, palpable,
clear and plain. In other words, evidence is about something that has occurred
with certainty or the product of an observation/experiment (Rootman, 200 1a).
For health promotion interventions, when it cornes to evidence, first it is the
evidence that characterizes the linkages between the determinants ofhealth and
health status. When planning health intervention, it is important to make the
evident link with ail the factors that underpin the health issue being addressed.
This step is very important in helping interventions achieve effective outcomes
or results. In our opinion, many health interventions primarily miss doing
this at the initial stage. This results in implementation of interventions in an
isolated way (without or with little multi-sectorality), and with the limited use
of approaches instead of a combination of approaches as the concept of health
promotion demands. Secondly, evidence is concerned with the effectiveness of
health promotion interventions, which is linked with the interventions' results
at different stages of implementation (McMurtry, 2002).
In the African region, there is a great need to generate health promotion
evidence in order to convince policymakers, health professionals, and other
stakeholders to shift from the traditional way of dealing with health issues.
There is evidence that health promotion has the capability to impact more on
health development, in other words, it is effective.
Effectiveness: Effectiveness refers to when an intervention has an effect
or is able to bring about the intended result(s). This is achieved through
understanding the nature of the intervention, the characteristics of the target
population and the social, political, and environmental context. These can be
examined by assessing whether the intended target population was reached; if
the activities occurred as planned; and if the theory and assumptions underlying
the interventions conformed to health promotion princip les and approaches
(McMurtry, 2002). What this implies is that the outcomeevaluations encompass
various levels of complex activities, such as assessing how participants in the
intervention are faring, or whether they are doing better than a "control"
group, or if the intervention actually caused the intended outcome. A range of
outcomes and evaluation designs can he used to answer these questions as we
shall see further in this chapter.
HEA LT H PRO MOT ION E F FEe T 1 VEN E S S: MET H 0 DOL 0 G 1 CAL 1 S SUE S· 27
form of participation referred to often does not fit with what it is anticipated
in health promotion approaches.
The above observation is similar to the one made by Raeburn and Corbett
(2001) in an analysis of interventions claiming to have involved communities.
These authors could distinguish three types of participation. The first type
is community-based health promotion, the lowest level of community
participation. Here the action is 'done to' the community, with little attempt
to engage it other than to cooperate. This kind of participation does not work
mainly because the community members are not at the centre of the action. It
is the external actors who do everything on their behalf with just an attempt to
involve them. The second type is the community action, which is the middle
level of community participation. It involves at least four sub-categories eaeh
of which represents varying degrees of effort to have active community input
into the health promotion process, but where the agendas are still primarily
under the control of the professionals or researchers. This type should help
obtain sorne results, but as eommunity members are not the main actors,
there is a gap in terms of sustainability and equity, so that at the end of the
intervention, there is no possibility for the partner community to continue
the actions in order to control the health issue they (community and external
actors) were dealing with. The third type is the community development,
which is the highest level of eommunity participation where it distinguishes
three sub-categories, community-controlled (the balance of power is with the
community); community building (development of the quality oflife and liking
of the community); and development of community capacity and strengths
(empowerment). This is considered the best type of community participation.
It focuses on the development of the entire community instead of dealing with
specifie and isolated issues without putting this in the specifie comm unit y
context. It works because community members are the ones implementing
the activities with external actors performing an advisory role. Results from
this kind of participation are considered sustainable and equitable because
community members will have gained sorne expertise and will be dealing with
the specifie needs of their population. In essence these authors were dedaring
that 'Community Developrnent Health Promotion (CDHP) works, and works
splendidly. But we can only draw this conclusion if we widen the concept of
H EA LT H PRO MOT ION E F FEe T 1 VEN E S S: MET H 0 DOL 0 G 1 CAL 1 S SUE S· 29
what we customarily calI health promotion (Raeburn & Corbett, 2001). It can
be argued that the CDHP works because the intervention power is in the hands
of the partner community who understand the issues better than the external
experts.
Given the current drive towards generating evidence of effectiveness,
health promotion practitioners in the sub-Saharan African region should be
seeking to understand the health promotion approaches that would lead to the
desired outcomes. This implies that the current concern of the region should
be to strengthen the capacities in health promotion so that interventions can
take the necessary characteristics, as defined above, in order to allow for an
assessment of effectiveness.
HeaIth promoters and researchers from the African region have entered
this debate recently, which partIy is a reflection of the formative stage of health
promotion on the continent, with the major thrust being on clarification of
concepts and defining the identity of its practitioners. A fairly recent article
indicates that lack of clearly defined indicators for assessing health promotion
programmes is a major challenge in the development of the field in the Region
(Nyamwaya, 2003). Limited resources within the health sector and emphasis on
curative services are other factors that explain the less than adequate attention
given to measuring health promotion effectiveness. To date, only the Republic
of South Africa, besides the WHO regionaI Office for Africa (WHO-AFRO),
has embarked on systematic efforts to address the issue through the health
promotion standards initiative (Nyamwaya, 2003).
to cause at community level the catch of power through the behavior of the
investigator (Baker & Teaser-Polk, 1998; Wyss et al., 1998). EtiologicaHactors
in the complex helath promotion interventions, it is clear that ail important
place must be necessarily granted to the qualitative method (Campbell et al.,
2000; Kemm, 2006; Syme, 2004).
The problem that the evaluation of health promotion effectiveness poses
is often that the interventions do not always have the characteristics of health
promotion as shown by Thomas et al., (2003). That is whyat the beginning
of the health education and sensitization campaigns it is usually impossible
to convincingly explain the effectiveness of health promotion. Health
education by itself does not make it possible to try out the effectiveness of
health promotion. It misses the other pillars ofhealth promotion, for example,
the healthy public policy dimension which supposes the establishment of
legislations and regulations, in other words the conditions favorable to health,
without forgetting advocacy which is a component needed to achieve this.
It would be thus difficult to establish that the approaches and principles of
health promotion failed to impact at aIl on the partner populations (Hoffman
& Jackson, 2003). This is currently the situation in Africa where many of the'
interventions referred to as health promotion are far from being it, because
they do not have aIl the characteristics of health promotion. We are, therefore,
proposing in this chapter sorne steps that can be taken to get evidence of the
effectiveness of health promotion interventions within the region as outlined
below.
Approaches to improve practice in health promotion: Health promotion
actors/players need to ensure the quality of their interventions in order
to fit the criteria of the 'best practioes' which are recognized by several
authors (Reaburn & Corbett, 2001; Glasgow et al., 1999, Iané-Llopis &
Barry 2005; McMurtry, 2002; Rootman, 2001a). These include health
promotion theory, values, principles, goals, ethics, concepts, beliefs,
assumptions, and context (e.g. perceptions and representations of the
partner population).
Scientific rigour in health promotion intervention/research: This
refers to the process of systematically studying a phenomenon, using
an appropriate design and methods to address the problem, and often
34 • HEAlTH PROMOTION EFFECTIVENESS: METHODDlOGICAl ISSUES
same way, the WHO working group on this topic (WHO, 1998) mentioned in
its conclusion that health promotion initiatives should be evaluated in terms
of their processes as weIl as their outcomes. For this working group, the use of
RCT to evaluate health promotion initiatives is in most cases inappropriate,
misleading and unnecessarily expenses. Therefore, there is a need to support
the use of multiple methods, conduct further research into the development
of appropriate approaches to evaluating health promotion initiatives, and to
ensure that a mixture of process and outcome information is used to evaluate
all health promotion initiatives.
Collating and sharing evidence of health promotion effectiveness: It
is time to appreciate the initiative of this book whkh targets Africa
in particular. According to the arguments that we have so far made,
this initiative will certainly contribute to exhibiting the principles of
good practice in health promotion in order to reinforce the need to
ensure, with reference to experience in its application in other areas, a
component in every intervention that deals with gathering the.evidence
of health promotion effectiveness and to disseminate it. This, in our
opinion, could constitute a tool for advocacy with the decision makers
in the different countries of the region. We, however, acknowledge that
there are many challenges of getting evidence of health promotion
effectiveness, as it is the case in other parts of the world.
References
Allison, K. R., & 1. Rootman. (1996). Scientific rigor and cominunity
participation in health promotion research: are they compatible.
Health Promotion International, Il (4), 333-340.
Baker, E. A., & Teaser-Polk, C. (1998). Measuring community capacity: where
do we go from here? Health Education and Behaviour, 25(3), 279-83.
Blackwood, B. (2006). Methodological issues in evaluating complex healthcare
interventions. Journal of Advanced Nursing, 54,612-622.
Campbell, M., Fitzpatrick, R., Haines, A., Kinmonth, A. 1., Sandercock, P.,
Spiegelhalter, D. et al., (2000). Framework for design and evaluation
of complex intervention to improve health. BMJ, 321,694-696.
Campbell, N. C; 'Murray, E., Darbyshire, J., Emery, J., Panner, A., Griffiths,
F. et al; (2007). Designing and evaluating .complex interventions to
improve health care. BMJ, 334, 455-459.
Freimuth, V. (2001). Effectiveness of Mass-Media Health Campaigns. Second
International Symposium on the Effectiveness of Health Promotion,
University of Toronto, May 28, 2001, http://www.utol.onto.ca/chp/
download/2ndSymposium/freimuthpaper.doc
Glasgow, R. E., Vogt, T. M., & Boles, S. M. (1999). Evaluating the public health
impact of health promotion interventions: The RE-AIM framework.
American Journal of Public Health, 89, 1322-1327.
Gnahoui-David, B., Houéto, D. & Nyamwaya, D. (2005). Health promotion
Capacity mapping in Africa. WHO 6th Global World Conference on
Health Promotion, 7th-Il th August 2005, Bangkok (Thailand).
Green, J., & Tones, K. (1997). Towards a secure evidence base for health
promotion. Journal of Public Health Medicine, 21, 133-139.
Hoffman, K., & Jackson, S. (2003). A review of the evidence for the-effectiveness
and costs of interventions preventingthe burden of non-communicable
diseases: How can health systems respondî Latin America and the
Caribbean Regional Office, World Bank.
Jackson, S. F., Edwards, R. K., Kahan, B. &Goodstadt, M. (200 1). An Assessment
of the Methods and Concepts Used to Synthesize the Evidence
40 -HEAlTH PROMOTION EFFECTIVENESS: METHODOLOGICAL ISSUES