Chapter Eleven:

Evaluating and Institutionalizing

OD Interventions

SUBMIT TO:
SUBMITTED BY:
Learning Objectives
for Chapter Eleven
 To understand the issues associated with
evaluating OD interventions
 To understand the process of
institutionalizing OD interventions and the
factors that contribute to it
Definition
 Evaluation: Evaluation is concerned with
providing feedback to practitioners and
organization members about the progress
and impact of the interventions.
 Institutionalization :Institutionalization
involves making a particular change a
permanent part of the organization’s normal
functioning. It ensures that the results of
successful change programs persist over
time.
Types Of Evaluation
 Two distinct type of OD evaluation
First to intended to guide the implementation
of interventions.

Second to assess their overall impact.

 Implementation Evaluation
Feedback Feedback
 Feedback aimed at  Feedback aimed at
guiding determining impact of
implementation efforts intervention
 Milestones,  Goals, outcomes,
intermediate targets performance
 Measures of the  Measures of the
intervention’s intervention’s effect
progress
 Implementation and
Evaluation Feedback
Diagnosis

Design and Implementation of Implementation Evaluation

Implementation Intervention Feedback Feedback
of Interventions Clarify Plan for Measures of Measure
Intention Next Steps the Intervention of
Alternative and Immediate Long-term
Interventions Effects Effects
The Key Issues in Evaluation

 Measurement
Select the right variables to measure
Design good measurements

(1)Operational definition: A good

measurement is operationally defined, it
specifies the empirical data needed, how
they will be collected and how they will be
converted from data to information.
(2)Reliability
Rigorous Operational Definition
○ Provide precise guidelines for measurement:
How high does a team have to score on a
five-point scale to say that it is effective?
Multiple Measures
○ Multiple items on a survey
○ Multiple measures of the same variable
(survey, observation, unobtrusive measure)
Standardized Instruments
Continue……
(3) Validity:
Face Validity: Does the measure “appear”
to reflect the variable of interest?
Content Validity: Do “experts” agree that
the measure appears valid?
Criterion or Convergent Validity: Do
measures of “similar” variables correlate?
Discriminant Validity: Do measures of
“non-similar” variables show no association?
 Research Design
 Internal & External Validity
 Longitudinal Measurement
Change is measured over time
 Comparison Units
Appropriate use of “control” groups
 Statistical Analysis
Alternative sources of variation have been
controlled
 Quasi-experimental research design
Institutionalization
Framework
Organization
Characteristics

Institutionalization Indicators of
Processes Institutionalization

Intervention
Characteristics
Organization Characteristics
 Congruence
Extent to which an intervention supports or
aligns with the current environment,
strategic orientation, or other changes taking
place
 Stability of Environment and Technology
 Unionization
Intervention Characteristics
 Goal Specificity
 Programmability
 Level of Change Target
 Internal Support
 Sponsor
Institutionalization Processes
 Socialization
 Commitment
 Reward Allocation
 Diffusion
 Sensing and Calibration
Indicators of
Institutionalization
 Knowledge
 Performance
 Preferences
 Normative Consensus
 Value Consensus