Documente Academic
Documente Profesional
Documente Cultură
Education Section
Programme Division, UNICEF
Published by UNICEF
Division of Communication
3 United Nations Plaza
New York, NY 10017, USA
Website: www.unicef.org
Email: pubdoc@unicef.org
CHAPTER 8
Monitoring and evaluating
1
Child-Friendly Schools Manual
Based on this outline of monitoring • rovide information to
P
and evaluation, it can be argued development partners and
that a comprehensive approach to education ministries about
monitoring and evaluating child- impact, outcomes and progress
friendly schools and learning in relationship to child-friendly
spaces should be able to assess school and learning space
their effectiveness and efficiency objectives to help them make
at different levels – from the global informed decisions about the
(multi-country) to the national and programmes;
subnational levels to the school,
• easure the impact of CFS
M
classroom and individual learner.
programmes on national
With carefully designed multiple
education systems;
objectives for different levels, a
comprehensive monitoring and • ignal ways to improve efficiency
S
evaluation should be able to: for better management and help
ensure that money, time, staff
• rovide evidence for advocacy,
P and equipment invested in CFS
national policy dialogue, activities are appropriate and
standard-setting, accountability optimal in terms of achieving
within the public domain, outputs and outcomes;
scaling up, mainstreaming and
• Inspire, empower, enable
replication;
and mobilize schools, their
• rovide evidence to major
P communities and other
investors in education stakeholders to create a common
(governments, development vision and to actively participate
partners) that the CFS model is in an ongoing process of child-
an effective, efficient, equitable friendly school improvement;
way to ensure quality basic
• rack and assess individual
T
education for all children, under
children (‘putting a face’ on
all circumstances, in a manner
each child) in terms of inclusion,
that is relevant, affordable and
health, development, protection,
sustainable;
learning barriers, learning
• Help establish national standards, achievement and special needs.
criteria and indicators for rights-
based education;
• rovide information for evidence-
P
based decision-making that
is predicated on agreed-upon
© UNICEF/NYHQ2006-0736/Noorani
national standards;
• lean information on the costs
G
and benefits of the CFS model as
well as the trade-offs to promote
sound investment in the best
interest of the child in terms of
education, development and the
well-being of the ‘whole’ child;
2
Chapter 8: MONITORING AND EVALUATING
8.2 WHAT NEEDS TO BE MONITORED AND EVALUATED?
3
Child-Friendly Schools Manual
have been achieved, what concrete • ost-effectiveness determines
C
changes have resulted from CFS the cost required for a package
inputs and processes, and whether designed to produce a set of
interventions have been able to agreed-upon outcomes in one
influence the knowledge, attitudes and school. This information is
behaviour of students, school staff, especially valuable in designing
community members and education ‘follow-on’ initiatives to take child-
system officials. Outcome indicators friendly schools and learning
may include information on changes spaces to scale.
in enrolment, repetition and drop-out • Equity refers to non-discriminatory
rates for boys and girls. Under the access and outcomes for children
CFS framework, assessment tools regardless of their sex, ethnic
on outcome indicators must cover group, caste, religion, socio-
additional aspects including child- economic status, geographical
friendly criteria and the enabling location or risk group. Outcome
environment (the optimal conditions evaluation looks at such disparities
for children’s learning, cognitive, social as enrolment, absenteeism and
and psychological development). drop-out rates from the programme
to the school level. Information
• Effectiveness is determined by on disparities is fed into decision-
comparing the actual results against making processes at the
the targets. Outcome evaluations programme and policy level. It also
of child-friendly schools could use informs the school self-assessment
standard MDG/EFA indicators to process for identifying causes
show that the model delivers on and formulating actions to be
what it promises: quality basic incorporated into plans to improve
education for all children. the school’s child-friendliness.
4
Chapter 8: MONITORING AND EVALUATING
8.3 A FOCUS ON DYNAMIC MONITORING AND EVALUATION
5
Child-Friendly Schools Manual
Monitoring progress during the to monitor and evaluate self-learning
implementation process (formative need to be flexible and responsive
evaluation) requires answering such to the school culture as well as local
questions as: How fully do key actors community conditions. These factors
understand the main elements of child- determine how much time and other
friendly schools? How extensively are resources, as well as the necessary
learners, teachers and school heads authority, will be available to support
included in the process of change? Are self-learning through monitoring and
the necessary technical guidance and evaluation. Schools have a vested
full range of resources available for interest in monitoring and formative
implementing the CFS model? How evaluations to determine if they are
fully does the community support the moving along the right path and
change process? What are the barriers whether CFS as an innovation is
to CFS implementation, and how can being given a reasonable chance for
they be addressed? successful implementation.
6
Chapter 8: MONITORING AND EVALUATING
On this basis, schools must rely on as strengths, weaknesses and areas
directives, advice and suggestions of improvement are identified. The
from others on how to improve their school’s CFS development plan
practice. This approach does not should be informed by school-level
provide the necessary motivation, evaluations to ensure that a culture of
incentive or means for schools to take continuous improvement is generated
responsibility and be accountable for and sustained. To achieve this, a
improving education quality. It is also climate of trust and transparency
inimical to progress for CFS models, needs to be established in which key
which by definition involve an ongoing stakeholders buy into the concept of
process of change and improvement evidence-based planning. This is a
along a quality pathway. challenge in countries where there
is a perceived benefit to distorting
For CFS models to be successfully data, not least because education
implemented on a sustainable basis, funding is often on a per capita basis
schools must have the means as well and districts and schools may receive
as the incentives to monitor their own additional resources if they inflate
progress and learn from the process enrolment figures.
in order to take the action necessary
to keep implementation on track. Another type of programme from
For this to happen, child-friendly which child-friendly schools could
schools need to borrow from the learn is the ‘school accountability’
experience and lessons of a range of programme. These involve schools
school-based programmes related to assessing their own progress in
monitoring, evaluation and research delivering results that meet the
for organizational improvement. expectations of different stakeholders
to whom they are accountable.
Programmes and projects that Stakeholders include education
promote schools as self-improving ministries, parents, communities,
organizations have been widely pupils, religious bodies, employers and
documented. Many countries have teachers’ unions. Schools that adopt
tried various versions of ‘school this approach operate proactively,
improvement programmes’ that engaging with diverse stakeholders
involve schools in designing and negotiating the expectations that
development plans in consultation schools should strive to meet and how
with their communities, alumni they can be made more accountable.
groups or the ministry of education.
Institutional development goals are School accountability is a progressive
negotiated, resources are secured, and and demanding approach to school
the school generally monitors progress improvement and is only viable if
of implementation and evaluates the the school head and teachers are
outcomes at specified stages in the sufficiently skilled, motivated and
implementation process. empowered through their relationship
with stakeholders. Ministries of
Where school improvement education need to trust, support and
programmes are linked to the CFS encourage schools that adopt this
model, monitoring and evaluation approach rather than simply impose
within the school should lead an inspectorate regime that dictates
to progress at the individual, standards and demands conformity.
organizational and community levels Such schools also need support and
7
Child-Friendly Schools Manual
technical links with universities and children so disinterested in what
teacher education institutions from is going on? And how can I make
which they can receive guidance things better? Teachers who are
and training to design and implement reflective practitioners understand
a credible school accountability that their role is not to act as a fount
approach to institutional of knowledge, dispensing information
development. and skills that pupils simply have to
absorb successfully.
8.3.3 Teachers as reflective Reflective practitioners are teachers
practitioners who recognize that at the heart of
good practice is the role of being a
Teachers play a pivotal role in the good facilitator of learning. This is
process of promoting change within about engaging minds and initiating
their own classrooms as well as learners into a world of knowledge,
in schools and education systems skills, attitudes and values about
generally. The success of child- which they are intrinsically curious
friendly schools will depend to a and that is part of their heritage as
large extent on the teachers involved. human beings. Teachers all over
Qualifications and experience are very the world successfully perform this
important in this regard, but more miracle daily in their classrooms,
significantly, the pedagogic style using a combination of knowledge
practised by teachers will need to be of subject, pedagogic skills and an
child-centred to address classroom abiding passion for bringing out
learning and school-based practices the best in each learner entrusted to
that put the best interest of children their care.
at the centre of all decision-making
processes. Much of what is required One of the ways in which the role of
to encourage teachers who can the teacher as a reflective practitioner
successfully implement CFS models has been strengthened during
can be achieved through education recent years is by engaging teachers
and training. But critical elements in ‘action research’. This can be
of this teacher profile can best be distinguished from the more esoteric
acquired through a mentoring process and rigorous research processes that
and a self-renewing practice that deal with issues of correlation and
learns from reflection and correction. causality, while developing evidence
This is where genuine involvement for certainty in the field of knowledge
of teachers in the monitoring and building and theory construction.
evaluation process can be beneficial Action research is concerned with a
for child-friendly schools. heuristic understanding of practice
and with building knowledge as a
When a teacher operates as a basis for changing practice and taking
reflective practitioner she or he takes action in real-world situations.
stock regularly and routinely of the
classroom process and its outcomes: In Africa and Asia, versions of
What went right, what went wrong? Collaborative Action Research in
Why do some of the learners still Education (CARE) have been used
not grasp the lesson, why are some successfully to engage teachers
8
Chapter 8: MONITORING AND EVALUATING
and school managers as genuine more routinely through available
partners in monitoring, evaluation training programmes, engage more
and research exercises. In this regard, often with their peers on issues of
great value has been attached to good practice and develop a self-
the unique experience and insight interrogating approach to facilitating
teachers bring to such exercises. Most learning in their school. Promoting
teachers experience a professional this approach to monitoring and
transformation through their evaluation provides evidence for
involvement with action research and making decisions about CFS models,
go on to become more reflective in and it yields benefits in terms
their own classroom practices. They of professional development for
tend to seek professional knowledge teachers and school heads.
9
Child-Friendly Schools Manual
8.4.1 Creating a learning parental mortality, education levels
management system: Case and migration status; primary and
study from Thailand secondary parental occupations and
monthly income; land ownership;
The development of an LMIS family disruption issues (widowhood,
divorce with no remarriage,
can be streamlined by setting up
separation); number of preschool
clearly defined steps. Thailand’s
children in the family; number of
learning management system is
primary and secondary students and
a solid example of what goes into
what school(s) they attend; number
the process (Institute of Nutrition,
of uneducated family members; main
Mahidol University, Thailand, n.d.).
child caregiver; other members of
the household and total household
Step 1 – Educational assessment size; and participation in village
development committees. These
• eachers and children collect
T indicators are closely related to child
student educational scores from protection issues.
every term the student has been
enrolled, using data from existing Step 3 – Analysis
records.
• hese scores are recorded
T Using the three profiles – educational;
as a class educational profile absenteeism, health and nutrition;
(spreadsheet) with numerical and family background – teachers
scores converted into letter identify children who have failed and
grades (A, B, C, D) on a curve for determine what could be causing this
easier reading. failure. The most common reasons
for student failure are:
• eachers then identify children
T
who fail temporarily, sporadically • Low parental education;
or chronically.
• arental occupation (no
P
Step 2 – Individual and family secondary occupation);
assessment • High level of land ownership;
10
Chapter 8: MONITORING AND EVALUATING
family and community development associated factors such as failure rates
activities, school improvement and nutritional status. It also should
programmes or a combination of the set new goals, identify appropriate
two in order to improve the children’s interventions, and determine roles and
learning environment. These activities responsibilities for the school, parents,
may include: community and other stakeholders.
11
Child-Friendly Schools Manual
Philippines: Putting a face to of their children enrolled in school. To
each name validate some questionable entries, we
conducted interviews with students, other
family members and community leaders.
One strategy that helps schools seek
While the data gathering for family
out and assist hard-to-reach, at-risk and
background information was ongoing,
faltering children is the Student Tracking
our school nurse was also doing health
System. The system is being piloted
and nutrition monitoring for all students
in 2,000 of the more than 3,500 child-
– after which, all teachers were asked to
friendly schools in the Philippines. Below
construct the learning profiles of each
are excerpts from an interview with
student, dating as far back as their first
Mrs. Erlinda J. Valdez, the principal of
year in the school.
F. Benitez Elementary School, one of the
pilot schools (UNICEF, 2002 – Teachers
Talking). The teachers in charge summarized all
the data and, together with the grade
chairman, jointly identified learning
1. What is the Student Tracking System?
falterers. Falterers were classified into
three categories: chronic – those who
The Student Tracking System is a system consistently failed; sporadic – those who
of organizing important data about alternately pass and fail; and temporary –
learners – their academic performance, those who failed once but had no history
physical and mental cognition and their of failure. Records of falterers (who were
social background. It puts together a lovingly called ‘stars’, short for ‘students
comprehensive view of the ‘whole’ child at risk’) were analysed. Conclusions of
that allows teachers and administrators the analysis became the basis for the
to understand the total environment in interventions rendered to the children.
which children are learning. In summary, The school is now completing a research
it puts a face and memory to each name. study entitled ‘Faltering at F. Benitez
The system is also an early warning that Elementary School: Causes, effects and
will identify children who need special possible solutions’, which we hope will
attention, are at risk of being abused, or guide our future interventions.
are at risk of faltering and leaving school.
It is a system that determines the pattern
3. What benefits do you get from
and frequency of poor learning and
implementing the Student Tracking
identifies children who need immediate
System?
assistance.
Our experience with the system is
2. When and how did you start
still very new, but we are seeing
implementing the system?
positive behavioural changes among
our teachers. Teachers, by their own
It all started in May 2001, when I and testimonies and as observed by their
two of my colleagues from this school peers and students, have become more
were trained on the system. The patient and understanding of students
training equipped us with the skills and who falter, miss or misbehave in class.
knowledge to create, use and apply In the past, they considered falterers and
the system in our school, using the absentees as problem students; now they
computer-based model. see them as students with problems.
They have also come to know more of
When we came back from the training, their students – their family background
we oriented all teachers on the system, and their special circumstances. This,
advocated to parents and asked for their we believe, is a major step in genuinely
support, particularly in completing the helping students at risk.
family background questionnaire for each
12
Chapter 8: MONITORING AND EVALUATING
We also have noticed closer teacher- recognition of their contribution, we
student relationships now. Some were able to generate support from
students with special problems confide them.
in their teachers and run to the school
for refuge and consolation when their b. Getting correct information from
own families fail to give them the parents – There were many
attention and care they need. Finally, questions in the family background
the system has helped us define our profile that were ‘sensitive spots’ for
school’s research agenda for the next parents, for example, educational
years. Since our school’s goal is to attainment and family income.
provide quality elementary education To get correct information from
to our students, it is incumbent upon parents, we had to befriend them
us to find ways to make this into reality, first, assist them in completing
to find causes of and address high the questionnaires and validate
levels of absenteeism, dropouts and the information gathered by
underachievement. And the system is interviewing their children.
showing us how – it has given us a tool c. Overlapping of reports – The school
to find out the whys of the problems so system requires many reports
we can address the ‘hows’. from the schools and, more often
than not, schools are burdened
4. How did you motivate overworked in preparing these reports. We
teachers to support the system? are, therefore, exploring ways to
integrate all these databases and
When we first introduced the system to reports so that less time and effort
our teachers, they had mixed reactions. is spent in preparing all of them.
Some were supportive, but many were
indifferent, sceptical and unimpressed. 6. What are the lessons learned and the
So we advocated to them, emphasizing future direction?
the potential benefits of the system to
them and to their students. We also • A better understanding of the
ensured that their support of the system students’ family background
translated into additional points in their has much to do with improving
performance evaluation. Furthermore, academic achievement.
we made it a school undertaking to
conduct the research study ‘Faltering at • nowing the child fully helps in
K
F. Benitez Elementary School: Causes, educating him or her well.
effects and possible solutions’, which
• he key to teachers’ support is
T
generated funds for the school.
proper acknowledgement and
recognition of their efforts.
5. What were the challenges you faced
in implementing the Student Tracking
In the next months, we intend to
System?
continue to use and strengthen the
system and complete our study on
The challenges we faced in starting the student faltering. We also plan to
system can be categorized into three: conduct workshops, where all teachers
will jointly identify systematic ways
a. Generating support from teachers – of addressing factors of faltering,
At first, this was hard, as a number absenteeism and dropouts. In the
of teachers were disinterested and meantime, we will also help advocate
unconcerned. But through a creative for the expansion of this initiative to
combination of persuasion and all schools in the Division of Manila.
Source: <www.unicef.org/teachers/forum/0302.htm>.
13
Child-Friendly Schools Manual
8.5 MONITORING AND EVALUATION TO
SUPPORT CFS MAINSTREAMING
At the macro level, those who facilitate used in evaluation, the existing
and advocate for child-friendly schools education system statistics are a good
must generate evidence that supports source of data for core indicators such
further investments in scaling up and as EFA gauges. In evaluating CFS
mainstreaming the CFS model into models, however, it is critical that
education systems. Such evidence child-friendly school principles and
helps persuade governments and other issues are fully incorporated into the
partners to support the necessary design of the evaluation. Credible
investment and be committed to monitoring and evaluation involve
using the CFS model as a means of in-depth probing at the school,
improving the quality of education. community and local government
The type of evidence required comes levels to tease out the variables that
mainly from monitoring and evaluation influence changes attributable to the
exercises. In this regard, two points implementation of the CFS model. In
must be emphasized: Adherence to addition to quantitative data from the
technical evaluation standards is critical education system and other sources,
to ensure the credibility of presented there should be extensive use of
evidence. And the evaluation must be an assortment of qualitative data
done by specialists who are largely and factors – including process and
at ‘arm’s length’ from the groups causal factors – which will need to be
involved in designing, implementing identified and explored as part of the
and advocating for the CFS models. evaluation.
These measures enhance the value of
the evidence in terms of objectivity and Process evaluation assesses the
adherence to technical standards. extent to which planned outputs
were produced on schedule, the
The accepted criteria of reliability, efficiency of resource management
validity and generalizability are in achieving these planned outputs
essential in the design of monitoring and how well the interventions have
and evaluation tools and studies. The been implemented by schools. It also
cost of such evaluations and studies identifies key factors that hinder or
competes with the demand for teaching promote implementation. Process
and learning resources; therefore evaluation of child-friendly schools
it is important to use existing data often includes indicators that assess
gathering and planning processes children’s, communities’ and teachers’
as much as possible. This reduces participation in decision-making.
costs and encourages monitoring and Indicators that focus on processes can
evaluation as part of the process of examine whether student clubs or
mainstreaming CFS models. student councils have been formed or
whether parent-teacher associations
A wide range of data sources is used meet regularly and what role they play
to monitor and evaluate child-friendly in school development plans. Process
schools and spaces in support of indicators also can assess classroom
scaling up and mainstreaming. For practices, methodologies and use of
standard survey techniques typically child-centred learning activities.
14
Chapter 8: MONITORING AND EVALUATING
EXAMPLE QUESTIONS FOR OUTCOME EVALUATIONS
Does the school have policies to improve and maintain a healthy physical
environment? Are policies implemented and enforced?
Do policies address all aspects of the physical environment (air, water, sanitation,
waste, location, hazardous chemicals, transport, food, disease vectors)?
Are goals and objectives well defined, and do they establish criteria to measure
and evaluate intervention activities and outcomes?
Are students, teachers, school health personnel, food service personnel, parents
and community members involved in planning interventions?
Is locally relevant health education integrated into the curriculum and extra-
curricular activities?
Is in-service training provided for the educators who are responsible for
implementing life skills-based environmental health education?
Do teachers feel comfortable implementing the curriculum?
Do school health services periodically screen for environmental health problems?
15
Child-Friendly Schools Manual
official statistics. Besides, numbers to school and to disaggregate data
do not often tell the whole story for according to such criteria as ethnicity,
complex models such as CFS. class and gender. Child-to-child
censuses recently supported by
Any credible CFS evaluation should UNICEF in such countries as Kenya
also make use of case studies of and Uganda are good examples of
good practices, especially if they can utilizing community demographics
be replicated at the classroom and and situations to better understand
school levels in a variety of contexts. school issues. Data from other
Similarly, case studies about child- sectors, including health records from
friendly schools’ positive effect on local public health centres, can also
individual children can be powerful be used to gauge the impact of the
and descriptive evidence to enrich an schools on key MDG health indicators.
evaluation. In general, case studies
are good at anchoring evaluations Longitudinal data would typically
through illustrative slices of reality. be required to measure change
This may be just as important as the over time and assess the impact
most sophisticated statistical analysis of implementing CFS models.
when it comes to convincing decision Alternately, comparative data can be
makers about the benefits of the CFS used for this purpose by selecting
model. a sample of child-friendly schools
and a control group of schools from
In measuring the impact of child- similar socio-economic, ethnic and
friendly schools, qualitative data such geographical settings in order to
as pupil and parental attitudes should measure the impact of CFS models.
preferably be quantified through use This was done in Nigeria’s 2004
of standard instruments such as the CFS-baseline study, which revealed
Likert scale for measuring attitudinal that child-friendly schools were
and affective changes. Studies also more popular than regular schools
need to go beyond the school level to when compared to those in the
assess why children are not coming control sample.
Monitoring the financial outlay for and Uganda through the Books in
child-friendly schools is critical for the Hands of Children campaign. In
accountability, transparency and Uganda, school budgets are posted on
equity. Audit chains can be developed the walls to ensure accountability to
to track inputs throughout the system. communities. This type of monitoring
For example, an audit chain could helps ensure that resources invested in
follow textbook purchases to the CFS are in fact being used as intended.
hands of students. As it tracks the
textbooks’ journey, it could assess Innovations often fail not because
whether the textbooks have reached investments are inadequate but
girls or marginalized children and how because the resources are not used in
effectively teachers use the texts. Such the intended manner to achieve the
‘end-user’ auditing occurs in Kenya desired outcomes. Measuring the cost
16
Chapter 8: MONITORING AND EVALUATING
of CFS is also crucial for demonstrating that UNICEF recently launched will
the financial feasibility of scaling up be an important tool for ‘costing’ the
child-friendly schooling as a rights- minimum learning package for child-
based approach to quality education friendly schooling.
for all. The Essential Learning Package
17
Child-Friendly Schools Manual
strategies and elements of their Consequently, a baseline study
own CFS programmes rather than of classroom interaction patterns,
the ‘ideal package’. In some cases, community participation, school
the resulting pictures are detailed inspection and supervision, attitudes
descriptions of the separate child- towards education – especially girls’
friendly school strands. They are education – and school planning
less informative as snapshots of and management was designed
whether or how these strands and implemented. The baseline
weave together to become more study assessed the impact of past
than the sum of their parts – interventions and provided a starting
something anticipated by the idea point for future impact studies.
of the child-friendly school as an
integrated conceptual and action The baseline assessment utilized
framework. a range of studies employing both
qualitative and quantitative methods.
While child-friendly school and Selection was by random stratified
learning space projects are evolving sample, ensuring that the schools’
and likely improving in terms of communities had similar profiles for
reach and effectiveness, the nature such factors as urban-rural mix.
and impact of this evolution are
not fully evident due to a lack of The evaluation assessed the impact of
good monitoring and evaluation. the CFS initiative in terms of:
Furthermore, the dearth of evidence
from cost-benefit analysis is a • utcomes – enrolment, primary
O
significant constraint to the successful one intake, gender gap, drop-
advocacy and fund-raising that are out rates, repetition, completion,
needed to take child-friendly schools learning outcomes and enrolment
and learning spaces to scale. in early childhood centres;
• rocesses and relationships – the
P
8.7.1 Child-friendly schools quality of interaction between
and learning spaces evaluation pupils and pupils, pupils and
teachers, teachers and supervisors
examples
and inspectors, and the school and
the community as well as attitudes
The child-friendly school initiative
and interaction patterns;
in Nigeria: The ‘Federal Government
of Nigeria-UNICEF Mid-Term Review’ • lassroom interaction – discourse
C
(2004) noted that 286 primary schools analysis and timeline analysis to
nationwide had been accorded child- measure the quality of interaction
friendly status. Various field reports in a subsample of the school,
also detailed the effects of CFS on using video and direct data
enrolment and retention. UNICEF observation as a data-gathering
Nigeria, however, required more data process.
on processes and pupils’ achievement
in child-friendly schools, the overall Viet Nam’s Child-Friendly Learning
impact of these schools, and a clearer Environment project: A major
overview of inputs and activities in emphasis is placed on development
support of child-friendly schools. and application of the Community-
18
Chapter 8: MONITORING AND EVALUATING
based Monitoring and Programme collection of data -> analysis -> school
Assessment System (COMPAS). action planning -> child-friendly
Addressing three priority areas of the learning environment implementation
project – monitoring and evaluation, -> further ‘assessment of progress’
school-based management and data collection. The analysis is used
school-community partnership – both formatively at the local level for
COMPAS is a project-wide data school improvement and as input for
collection system aimed at creating the central database of Viet Nam’s
a centralized database. It is expected Ministry of Education and Training for
to be used on a regular basis to guide planning and resource allocation.
project implementation in Viet Nam.
The Philippines’ Child-Friendly
COMPAS is being developed and School System project: In 2003,
promoted as a mechanism and a the Asian Institute of Journalism
forum that: and Communication, the Philippines’
Department of Education and UNICEF
• Introduces and advocates child undertook case studies to document
rights and child-friendly schools; best practices in CFS implementation.
Using observation and interviews
• Enables school self-assessment written as relatively unanalysed
and planning; vignettes, the case studies provide a
• rovides data that will
P different and interesting perspective
complement provincial, district on the project outcomes – a ‘window’
and local planning; on what users and beneficiaries
believe child-friendly concepts and
• racks children, particularly girls
T practices have produced (Lopez, 2003).
and poor children;
• reates enabling conditions to
C The case studies are grouped in the
further development of the child- following areas:
friendly learning environment;
• aking it work – CFS system
M
• onverges with key interventions
C implementation;
and generates stronger
community participation; • iking school and staying –
L
students;
• Assists principals in managing
the school in more effective, • From teacher with love – teachers;
participatory ways.
• eading by example –
L
administrators;
COMPAS includes baseline surveys
that are conducted in 200 schools • Building together – community;
twice annually, at the beginning
• or the children’s sake – student
F
and end of each academic year. It
tracking.
supports training for local officials in
survey techniques and use of data in
decision-making and management.
COMPAS is intended to work as a
forward-moving cycle: advocacy
and data collection training -> field
19
Child-Friendly Schools Manual
8.8 WHO SHOULD MONITOR AND EVALUATE,
AND WHAT ARE THEIR POTENTIAL ROLES?
20
Chapter 8: MONITORING AND EVALUATING
TABLE 8.1
STAKEHOLDER ROLE PURPOSE REMARKS
The ministry of MOE should be central Ensure linkage between Capacity development
education (MOE) to the whole process M&E of child-friendly may be required.
and its directorates, of monitoring and schools (CFS) and State, district and local
including planning, evaluation (M&E). mainstream data on government authority
examination boards, schools, early childhood (LGA) levels are
inspectorate and key development and non- involved. Focus:
parastatals. formal education centres. Policy and data analysis
for sector.
Other ministries, Advisory, through Ensure that health, water, Other ministries
such as water supply, intersectoral sanitation, energy and could assist in overall
environment, health, committees. gender are given due design and oversight
women’s affairs, social prominence, and provide of the M&E process at
welfare and finance. a minimum package different levels in the
for reducing risk and system and in the actual
adapting to climate M&E process at LGA
change. level.
Major international Could be represented Ensure consensus around UNICEF may or may
development partners in an overall steering overall M&E design and not take lead. Linked
in education. committee or in approach, especially for to overall education
agreement on key selected key indicators. management information
indicators and system (EMIS) and
reporting systems. quality assurance. Field-
based development
partners may be directly
involved at different
levels.
Local government Monitoring schools Ensure that effective Some LGAs have
officials. according to agreed- information is gathered inspectorate or
upon CFS principles, and analysed at this level. supervisor systems as
including efficient well as EMIS.
utilization of funding.
21
Child-Friendly Schools Manual
Religious Consultative or Ensure that children Involving such bodies
organizations. monitoring and understand and embrace is critical in countries
advocacy – they common ethics and where their support is
need to share CFS values and demonstrate required in achieving
principles, which also mutual respect for Education for All (EFA),
need to reflect their fellow students and their for example, Muslim
beliefs. community in line with clerics in Pakistan and
local norms and customs. Northern Nigeria.
Pupils. Consultation and Ensure that CFS criteria Pupils can be involved
monitoring, including are generated by pupils. in school committees or
mapping out-of-school parallel structures and in
children and input into clubs where M&E is part
M&E criteria. of the function.
22
Chapter 8: MONITORING AND EVALUATING
of the programme cycle. The review immediately. Teacher training, for
of these and other key issues is an example, will take a while before it
essential part of capacity-building for influences teacher behaviour, and that
child-friendly schools. in turn means learning outcomes will
not be affected immediately. A period
of at least two years between baseline
8.9.1 How should monitoring and impact studies is normally
and evaluation be built into advisable. The principal baseline can
overall project design? be complemented, however, by rapid
appraisal baselines at the individual
Monitoring and evaluation procedures school level, thereby ensuring that
should be clearly delineated in the each school has its own baseline
overall project design, the Education to assist in drawing up the school
Sector Plan (if the child-friendly school development plan.
is integrated within the plan) and at
the various levels being monitored Monitoring occurs at various levels,
or evaluated – school, community, from the global (using EFA targets)
and local and national governments. to the state and other government
A logical framework approach, or levels, the community, school,
an adaptation, that clearly links classroom and individual child. The
objectives, key indicators and means quality of the school’s record-keeping
of verification (the how) and identifies should be considered an essential
each partner’s role should be used. element of the child-friendly learning
This avoids duplication and ensures environment. Effective, inclusive
that child-friendly schools fit within school management committees
the overall government policy and are indispensable to ensure the
planning structures. community’s involvement in planning
and monitoring school activities.
8.9.2 When should monitoring
and evaluation occur? 8.9.3 Why are baselines
important, and what should they
Monitoring should be ongoing and measure?
involve all stakeholders. Evaluations
should be carried out according One of the problems in ‘selling’ the
to agreed-upon cycles, both in concept of child-friendly schools
mainstream government systems such to development partners and
as annual censuses or biannual panel governments has been the absence
inspection visits and in agreed project of baseline and impact data that
memoranda of understanding when demonstrate the effectiveness of
child-friendly schools are supported activities and inputs on learning
through specific projects. processes and outcomes. Baseline
data can be provided by governments
Impact evaluations that assess through such tools as EMIS, national
changes attributable to child-friendly surveys (including education
schools should allow reasonable sector analyses), inspection reports
time between implementation and documents such as budgets
and assessment. Interventions and expenditure accounts at all
and processes may not take effect governmental levels. This data
23
Child-Friendly Schools Manual
capacity to participate in the process
is essential. To achieve this, training
In Kenya, schools receive
can be linked to broader skills
a cheque directly from the
development through participative
Government for textbooks, and
appraisal approaches. Using well-
school textbook management
tried methods such as Reflect,
committees manage and
which combines needs analysis with
monitor procurement and
literacy development, can bolster the
utilization.
community’s capacity to monitor and
evaluate. Communities then become
partners in gathering, analysis and
should be complemented by more use of data as they inform school
specific data on key CFS indicators development plans.
related to processes, relationships
and outcomes. A critical outcome
that must be measured is the
Kenya, Nigeria, South Africa
impact of the school on students’
and Uganda have incorporated
competencies and skills, including
standard Monitoring Learning
literacy, numeracy and life skills.
Achievement tools into their
Mainstream instruments can be used,
baselines.
such as those included in Monitoring
Learning Achievement surveys.
24
Chapter 8: MONITORING AND EVALUATING
8.9.5 Gauging the impact on the of the school on education in the local
education system as a whole government authority can also be
gauged. Additionally, progress towards
The impact of replicating and sustainability needs to be monitored.
mainstreaming CFS initiatives on UNICEF should have ‘phase-out’ strategies
government systems should be measured. for all schools it supports where child-
Data can be used to help governments friendly learning environments will be
recognize the merits of child-friendly sustained in the medium and long term
school integration into mainstream after external support has ended.
policymaking and planning.
The data gathered on schools should be
If child-friendly school status is awarded included in an overall database such as
on the basis of a school attaining certain DevInfo, which encompasses a wide range
child-friendly benchmarks, motivation of development indicators. In this way,
for improvement will be enhanced. connections can be made between the
On a more local level, the influence of information generated by the education
child-friendly schools on nearby schools sector and data from other sectors. This
should also be measured when the is crucial for measuring progress towards
cluster model is employed. The impact related MDGs.
25
Child-Friendly Schools Manual
For more information, please contact:
Education Section
Programme Division, UNICEF
Published by UNICEF
Division of Communication
3 United Nations Plaza
New York, NY 10017, USA
Website: www.unicef.org
Email: pubdoc@unicef.org
CHAPTER 8
Monitoring and evaluating