Sunteți pe pagina 1din 26

Strategic Information Systems Planning Success: An Investigation of the Construct and Its

Measurement
Author(s): Albert H. Segars and Varun Grover
Source: MIS Quarterly, Vol. 22, No. 2 (Jun., 1998), pp. 139-163
Published by: Management Information Systems Research Center, University of Minnesota
Stable URL: http://www.jstor.org/stable/249393
Accessed: 26/05/2010 06:43

Your use of the JSTOR archive indicates your acceptance of JSTOR's Terms and Conditions of Use, available at
http://www.jstor.org/page/info/about/policies/terms.jsp. JSTOR's Terms and Conditions of Use provides, in part, that unless
you have obtained prior permission, you may not download an entire issue of a journal or multiple copies of articles, and you
may use content in the JSTOR archive only for your personal, non-commercial use.

Please contact the publisher regarding any further use of this work. Publisher contact information may be obtained at
http://www.jstor.org/action/showPublisher?publisherCode=misrc.

Each copy of any part of a JSTOR transmission must contain the same copyright notice that appears on the screen or printed
page of such transmission.

JSTOR is a not-for-profit service that helps scholars, researchers, and students discover, use, and build upon a wide range of
content in a trusted digital archive. We use information technology and tools to increase productivity and facilitate new forms
of scholarship. For more information about JSTOR, please contact support@jstor.org.

Management Information Systems Research Center, University of Minnesota is collaborating with JSTOR to
digitize, preserve and extend access to MIS Quarterly.

http://www.jstor.org
StrategicIS Planning

Abstract
Strategic Information
Systems Planning Strategic information systems planning (SISP)
requires significant outlays of increasingly
Success: An scarce human and financial resources. Yet,
there exists very little understanding of how
Investigation of the the success of this planning activity is mea-
sured. Using classical frameworks for mea-
Construct and Its surement development as well as contempo-
rary statistical techniques for assessing dimen-
Measurement1 sionality, this study theoretically develops and
empirically tests a measurement model of
SISP success. The results suggest that SISP
success can be operationalized as a second-
order factor model. The first order constructs
of the model are termed alignment, analysis,
By: Albert H. Segars cooperation, and improvement in capabilities.
Department of Management These factors are governed by a second-order
The Kenan-Flagler Business School construct of SISP success. The results of the
Campus Box 3490, McColl Building study are framed as a tool, for benchmarking
The University of North Carolina at planning efforts as well as a foundation for
operationalizing a key dependent variable in
Chapel Hill SISP research.
Chapel Hill, NC 27599-3490
U.S.A.
al_segars@unc.edu
Introduction
Within information systems (IS) literature,
much attention has been devoted to develop-
Varun Grover
ing methodologies for conducting strategic
Department of Management Science planning. These methods are designed to aid
College of Business Administration IS planners in aligning their strategies with
those of the organization (King 1988), identify-
University of South Carolina
ing opportunities to utilize information tech-
Columbia, SC 29208
nologies (IT) for competitive advantage (Ives
U.S.A. and Learmonth 1984; McFarlan 1984; Porter
vgrover@ darla.badm.sc.edu and Millar 1985; Wiseman 1985), and/or ana-
lyzing internal processes and patterns of data
dispersion throughout the organization
(Brancheau and Wetherbe 1986; Davis 1982;
Keywords: IS strategic planning, planning Goodhue et al. 1992; Zachman 1982).
effectiveness, second-order factor model- Increasingly, it has become apparent to
ing, structural equation modeling observers in the field that such characteriza-
tions of planning are narrow (Das et al. 1991;
Sambamurthy et al. 1993), or simply inaccu-
ISRL Categories: A110611, EF02, EF04, rate (Earl 1989, 1993). Further, it has been
EI10225 suggested that strategic planning activities
within IS have much similarity with larger orga-
lIzak Benbasat was the accepting senior editor for this nizational systems of strategic planning
paper. (Henderson et al. 1987; Hufnagel 1987;

MIS Quarterly/June 1998 139


StrategicIS Planning

Venkatraman 1985; Venkatraman and that achievement along a single first-order


Henderson 1994) and, therefore, should be dimension of planning success is a necessary
conceptualized, operationalized, and evaluat- but not sufficient condition for success along
ed in similar terms. the higher-order dimension of planning suc-
cess. Within the context of strategic planning,
Strategic IS planning (SISP) activities require it is likely that a similar structure of interrelated
substantial resources in terms of managerial constructs with different theoretical definitions
time and budget. Therefore, the process must constitute the measurement space of planning
deliver benefits beyond the resources neces- success. In order to assess the extent and
sary to sustain it in order to contribute positive- specific nature of benefits rendered by SISP
ly to organizational effectiveness. Yet, quantifi- activities, these broad dimensions of effective-
cation of the benefits of planning cannot be ness must be theoretically and operationally
reduced to simple financial measures such as defined. The development of such multi-
return on investment, payback, or internal rate dimensional conceptualizations can (1) cap-
of return. As has been noted, SISP (like overall ture multiple aspects of SISP success that
strategic planning) renders many benefits that may be subsumed within general (single scale)
are intangible (King 1988). Therefore, measur- measures, (2) provide insight into the nature
ing how well SISP was done this year and how of interrelationships among success dimen-
planning has improved over time is a complex sions, and (3) provide a more accurate diag-
exercise and must incorporate consideration of nostic tool to assess SISP activities within
these intangible process contributions. organizations. Until such concepts are devel-
Although evaluative frameworks, such as that oped, the varying criteria of planning effective-
developed by King (1988), are an important ness among studies will inhibit the generaliz-
starting point in measuring strategic planning ability and accumulation of research findings
success, there have been few efforts undertak- that attempt to identify effective approaches to
en within IS literature to formally develop strategic planning. In addition, IS managers
empirically-based definitions of this important will be without a framework within which the
performance characteristic. As has been organizational resources devoted to strategic
observed, it is likely that some organizations planning activities can be more easily and
realize aspects of planning effectiveness that accurately justified.
are not realized by others (and vice-versa)
(Goodhue et al. 1992). Such findings are lost This study theoretically develops and statisti-
when effectiveness is captured within a single cally tests a measurement model of SISP suc-
aggregated scale. Although a limited number cess.2 Incorporating both classical frameworks
of studies have captured SISP effectiveness for developing measures and contemporary
as more than a single, "is your planning sys- statistical techniques for assessing dimension-
tem effective," scale (Premkumar and King ality, the intent of the research is to develop a
1991, 1992), the focus of these studies has theoretical and operational construct space for
been directed on process and/or organization- latent factors that may be indicative of SISP
al characteristics that impact SISP. As a result, success. The remainder of the study is orga-
limited theoretical or practical justification is nized in five sections. The first section exam-
ines theoretical perspectives for measuring
provided for the content of SISP effectiveness
measures. planning success. The primary purpose of this
section is to build a rationale and theoretical
Recent work provides both a theoretical and basis for defining "success" with respect to
operational basis for conceptualizing measure- strategic planning. The second section exam-
ment models of planning success ines literature within IS and strategic manage-
(Raghunathan and Raghunathan 1994). Within ment as a means of defining a theoretical and
the context of general IS planning, this work operational construct space of SISP success.
demonstrates that planning success seems to
be a complex system of interrelated con- 2Theterms"planningsystem success" and "planningsystem
structs. A major implication of this research is effectiveness"are used interchangeablyin this paper.

140 MIS Quarterly/June 1998


StrategicIS Planning

Here, the objective is to develop and describe However, there are general objectives which
the item measures and underlying factors that all strategic planning systems should strive to
may constitute a measurement model of SISP obtain. Therefore, this measurement perspec-
success. The third section empirically exam- tive is useful both for its intuitiveness and ease
ines the psychometric properties of the mea- of operation. Within the context of general
surement models. Using confirmatory factor managerial planning, this perspective has
analysis, the validity and reliability of each been tapped in developing constructs of plan-
scale is tested as a means of assessing the ning systems success (see Venkatraman and
distinctness of each construct as well as the Ramanujam 1987; see also Raghunathan and
presence of complex and/or unreliable item Raghunathan 1994). Through literature review,
measures. The fourth section formally assess- six important goals for planning (enhancing
es the structure of interrelationships among managerial development, predicting future
latent variables. Specifically, the efficacy of a trends, short-term performance, long-term per-
second-order factor model in capturing the formance, gathering relevant information, and
variation among the first-order constructs is avoiding problem areas) were identified and
empirically tested. The concluding section their validity empirically demonstrated in cap-
describes potential limitations and implications turing the extent of "key" objective fulfillment
of the study for both research and practice. (Venkatraman and Ramanujam 1987).

Theoretical Perspectives for Comparativejudgment


Assessing the Success of This evaluative perspective compares the
effectiveness of a particular system with other
Strategic Planning "similar systems" (typically those set up in
An examination of literature within IS and comparable organizations) (Earl 1989). The
strategic management reveals four distinct typical question in this mode is How does our
approaches for assessing the effectiveness of system's performance compare against similar
strategic planning, "goal-centered judgment," systems that are operating in comparable
"comparative judgment," "normativejudgment," organizations? Within this mode of planning
and "improvement judgment." assessment, effectiveness may be implied
through the ability of the system to anticipate
events that were not anticipated by competi-
tors. Conversely, a less effective planning sys-
Goal-centeredjudgment tem may fail to forecast trends or events that
have been readily identified by competitors.
Goal-centered judgment seeks to assess the While this perspective is also very intuitive, it is
degree of attainment in relation to targets. A many times difficult to actually implement.
typical question in this mode is To what extent Gathering accurate and timely information
are the multiple objectives (or goals) of plan-
regarding comparable systems can be difficult
ning fulfilled? This approach is perhaps the if not impossible. Additionally, it may be an
most intuitive and widely applied metric for invalid basis of comparison if comparable sys-
measuring strategic planning success tems are under-achieving (i.e., the firm's plan-
(Venkatraman and Ramanujam 1987). It has ning regresses to mediocrity).
also been underscored in evaluative frame-
works within IS planning literature. This evalu-
ative dimension has been termed "IS planning
effectiveness" (King 1988) and referred to as Normativejudgment
"measurement against purpose" (Steiner
1979). Organizations may differ in terms of A relevant assessment question within the nor-
number and specific goals for planning. mative perspective is How does our system's

MISQuarterly/June1998 141
StrategicIS Planning

performance compare against that of a theo- system adaptability, these metrics can give IS
retically ideal system? In essence, the system managers useful insight in determining how
is compared to "standards of the field" rather SISP has improved in terms of resource use
than the unique planning goals of the organi- and organizational contribution. Other work
zation (King 1983). Such an approach is more incorporates this perspective in operational
amenable to research contexts if literature definitions of planning system success
and/or expert opinion can readily identify these (Venkatraman and Ramanujam 1987;
"standards" of good planning. Such standards Raghunathan and Raghunathan 1994).
should be as encompassing as possible while
independent of environmental and organiza- Although each of these perspectives is a legiti-
tional contexts. Within strategic management mate approach for assessing planning system
and IS literature, several "key" planning stud- success, some are more relevant for specific
ies have utilized this evaluative perspective planning methodologies while others are more
(Goodhue et al. 1992; King 1983; relevant for broader planning system dimen-
Venkatraman and Ramanujam 1987). For sions (Venkatraman and Ramanujam 1987).
example, five criteria for assessing the suc- Comparative and/or normative perspectives
cess of strategic data planning have been are more easily applied to methods such as
identified (Goodhue et al.1992). These stan- strategic data planning because the technique
dards of successful planning (implemented will usually occur over a measurable time hori-
systems, development of a data architecture, zon and will tend to have a narrower focus and
guidelines for development priorities, reengi- set of outcomes (Goodhue et al. 1992). In con-
neering, and education/communication) are trast, characteristics of goal fulfillment and
then used to evaluate the efforts of sample adaptability provide a more applicable mea-
cases and suggest reasons for the existence surement perspective for process dimensions
(and non-existence) of planning success. of planning systems which tend to be ongoing,
broader in focus, and exhibit a variety of out-
comes (Raghunathan and Raghunathan
1994). Given the broader perspective of this
Improvementjudgment research, the perspectives of "goal-centered
judgment" and "improvement judgment" are
Within this perspective, a typical question is chosen as the theoretical bases for conceptu-
How has the planning system adapted to
alizing SISP success. Collectively, these per-
changing circumstances? In other words, the spectives represent the "ends" (the output of
focus is on assessing how the planning system the planning system) and "means" (adaptability
has evolved or adapted over time in supporting of the process) view for evaluating planning
organizational planning needs. This approach system benefits and, as important, are consis-
is particularly useful in cases where the sys- tent with much of the evaluative literature with-
tem is in its initial stages and has yet to reach in SISP (Brancheau and Wetherbe 1986; Earl
steady state (Lorange and Vancil 1976). 1993; Hufnagel 1987; King 1983, 1988;
However, within any context, the assessment McLean and Soden 1977). Working within
of a system's capacity to improve is an impor- these perspectives, a theoretical and opera-
tant indicator of effectiveness. King (1988) tional construct space for SISP success is
relies heavily upon this perspective in his
developed.
framework for evaluating SISP. In essence,
that work suggests that planning evaluators
examine patterns in (1) the relative efficiency
in use of financial and personnel resources A Theoretical Domain of
devoted to SISP, (2) the actual use of strate-
gic plans, (3) the contribution of SISP to orga- SISP Success
nizational performance, and (4) changes in IS
strategy resulting from changes in business As noted in prior research (DeLone and
strategy. When examined through the lens of McLean 1992), it is likely that many aspects of

142 MISQuarterly/June1998
StrategicIS Planning

effectiveness with respect to IS and IS man- industry experience), and four IS academics
agement are complex. In essence, multiple, (each with significant publication activity within
interrelated success dimensions which are SISP). After two rounds of review, a set of 28
themselves measured by multiple indicators objectives remained. In general, each expert
are more likely to capture changes in perfor- agreed that this set of objectives represented
mance than an all-encompassing scale item or relevant and relatively distinct goals for SISP.
set of financial measures. Research suggests
that extensive literature review and expert To create a theoretical structure for the objec-
opinion provide a sound foundation upon tives, the authors and panel of experts inde-
which a theoretical domain (or construct pendently and then collectively grouped them
space) of complex variables can be formed based on similarity. Upon two iterations of
(Churchill 1979). From this theoretical domain, classification by the authors and panel in addi-
an operational basis for assessing the status tion to one round of formal interview between
and change in complex phenomenon can be the authors and panel, three broad dimensions
defined. Following similar studies in strategic of objective fulfillment were deemed adequate
management and IS (Joshi 1989; Straub 1989; in providing structure for the identified objec-
Venkatraman 1989), this study frames theoret- tives. These dimensions are termed alignment,
ical and operational dimensions of SISP suc- analysis, and cooperation. In the paragraphs
cess within the paradigm developed by that follow, the content domain of each of the
Churchill (1979). three dimensions and relevant literature is
summarized. This is followed by a review of
Utilizing the perspectives of "goal-fulfillment" the fourth dimension, improvement in capabili-
and "improvement in capabilities" as theoreti- ties, which is based on the "improvement judg-
cal underpinnings, an extensive review of IS ment" perspective discussed above.
literature was conducted to (1) identify various
SISP objectives and (2) identify any underly-
ing dimensions that would provide structure for
the resulting objectives. The journals that Alignment
formed the basis for the literature review
include MIS Quarterly, Information Systems It is generally accepted that one of the key fac-
Research, Decision Sciences, The Journal of tors for successful IS planning is the close link-
Information Systems, Management Science, age of the IS strategy and business strategy
IBM Systems Journal, The Proceedings of the (Baets 1992; Bowman et al. 1983; Das et al.
International Conference on Information 1991; Henderson and Venkatraman 1993;
Systems, Communications of the ACM, Henderson et al. 1987; King 1978). This link-
Information & Management, Harvard Business age or alignment helps facilitate acquisition
Review, and Sloan Management Review. and deployment of information technology that
These journals are cited in several studies as is congruent with the organization's competi-
leading research outlets within the field of IS tive needs rather than existing patterns of
(Gillenson and Studz 1991; Pinsonneault and usage within the organization (Bowman et al.
Kraemer 1993). Over 150 articles appearing 1983). Some authors also suggest that such
between 1980 and 1994 were independently alignment heightens the stature of IS within the
examined for content that addressed objec- organization, thus facilitating the financial and
tives of SISP. Through this analysis, over 50 managerial support necessary to effectively
objectives for SISP were identified. To verify implement innovative systems (Chan and Huff
completeness of this listing and consolidate 1992; Das et al. 1991; Henderson et al. 1987).
redundancies, "experts" were asked to add Alignment may be manifested through an
overlooked objectives, take away those that no understanding of organizational objectives by
longer seemed relevant, and identify objec- top IS planners (King 1978; Lederer and
tives that may be identical. These experts Mendelow 1987; Lederer and Sethi 1988;), a
included seven senior IS executives, four doc- perceived need to change IS objectives in light
toral students (each ABD with significant of changes in corporate strategy (Das et al.

MISQuarterly/June
1998 143
StrategicIS Planning

1991; King 1988), mutual understanding level of coordination concerning development


between top managers and IS planners standards and IT use among organizational
(Boynton and Zmud 1987; Earl 1989), and a sub-groups. Such actions reflect the impor-
heightened view of the IS function within the tance of creating a partnership between IS and
organization (Henderson and Sifonis 1988; user groups for successful implementation
King 1978; Lederer and Sethi 1988). efforts (Henderson 1990; Henderson and
Sifonis 1988).

Analysis
Improvementin capabilities
When IS planners undertake a concerted effort
to better understand the internal operations of While focusing on the fulfillment of key objec-
the organization in terms of its processes, pro- tives provides a useful metric for assessing the
cedures, and technologies, a degree of analy- outcomes of SISP, it provides little insight into
sis is realized. Much current SISP literature the capability of the planning process to adapt
has focused on issues surrounding "self analy- to changing circumstances. In other words, it is
sis" (Boynton and Zmud 1987; Brancheau et equally importantto assess how the process of
al. 1989; Hackathorn and Karimi 1988; planning has adapted over time in order to
Henderson et al. 1987; Lederer and Sethi gain a fuller determination of planning system
1988). In essence, the IS organization seeks effectiveness (a central tenet of the improve-
to better understand the processes, power ment judgment perspective). This effective-
bases, and existing technologies which char- ness criterion has been formally defined and
acterize the firm. Many of the objectives relat- operationalized as improvement in capabilities
ed to this broad dimension seek to find the (Venkatraman and Ramanujam 1987). As
most effective ways to operate and compete noted in that study, an effective planning sys-
with information technology. Other objectives tem should improve over time in its basic
seek to build an "architecture" of integrated capabilities to support the organization. Within
applications and databases across the func- the context of SISP, the organizational learn-
tional boundaries of the organization. In gener- ing that accompanies planning experience
al, effective analysis should provide a clear should result in improved capabilities to
understanding of how information is used with- achieve alignment between IS and business
in the organization and uncover critical devel- strategies, analyze and understand the busi-
opment areas. ness and its associated technologies, foster
cooperation and partnership among functional
managers and user groups, anticipate relevant
events and issues within the competitive envi-
Cooperation ronment, and adapt to unexpected organiza-
tional and environmental changes.
When general agreement concerning develop-
ment priorities, implementation schedules, and
managerial responsibilities is reached, a
This level of
degree of cooperation is attained. An Operational Definition of
cooperation is important in order to reduce
potential conflict which may jeopardize the SISP Success
implementation of strategic IS plans
(Henderson 1990). In essence, IS planners Given the development of a theoretical domain
must ensure that "key"coalitions and bases of of SISP success, formal conversion of the con-
power within the organization are supportive of struct definitions into measurable scales can
the process and content of SISP. Additionally, be undertaken. In general, the overriding goal
it is important to obtain a general level of of this task is to insure that the meaning asso-
agreement on development priorities and a ciated by the researcher with each item is the

144 MISQuarterly/June1998
StrategicIS Planning

same as that associated with it by the targeted tors. On average, the objectives associated
respondent. In addition to defining content with alignment were correctly classified at a
domain, panels of experts and potential rate of 89%. The rate of correct classification
respondents can offer much insight into poten- was 80% for objectives associated with analy-
tial problems resulting from ambiguous or sis and 78% for those associated with cooper-
poorly defined scale operationalizations ation. The overall percentage of correct classi-
(Churchill 1979). Additionally, the Q-sort tech- fication was a rather strong 82%. Individual
nique (Moore and Benbasat 1991), in which items that were correctly classified at a rate of
experts and/or potential respondents group 90% or greater were retained for further analy-
items according to their similarity, can provide sis. These 23 items seem to exhibit consistent
a powerful means of confirming the underlying meaning across the panel and therefore were
structure of complex variables and establishing adopted as measures of their associated con-
their validity. This procedure is especially rec- structs. Although this analysis did not incorpo-
ommended when new scales are being devel- rate multiple rounds of sorting typically used in
oped. Given the sparse empirical work in this Q-sorts (Moore and Benbasat 1991), these
area, it was determined that both expert opin- results seem to provide strong preliminary evi-
ion and Q-sorting should be utilized as a dence of construct validity and therefore no
means of accurately defining the theoretically further analysis was deemed necessary for
derived construct space of SISP success. item refinement or development. The first three
sections of Table 1 outline the specific mea-
sures of "goal fulfillment" generated through
the Q-sort and item refinement exercises.
Q-sortingand item refinement
As noted earlier, a fourth factor, "improvement
Approximately six weeks after the final round in capabilities," reflects the ability of the plan-
of domain development and refinement, a Q- ning system to continuously improve in its sup-
sort instrument that provided a description of port of organizational functioning. Research
the hypothesized constructs as well as a ran- has been conducted to empirically validate
dom listing of the 28 objectives for SISP was measures of this planning success measure
developed. These objectives were recast in within the context of general planning (see
the form of single sentences and were provid- Venkatraman and Ramanujam 1987; see also
ed on pages separate from the construct Raghunathan and Raghunathan 1994). These
descriptions. The construct descriptions con- measures include the ability to identify problem
sisted of a single paragraph and were all con- areas, ability to generate new and novel ideas,
tained on a single page. The instrument was ability to identify new business opportunities,
pre-tested by two professors of marketing and ability to adapt to unanticipated changes.
research and was then administered to the Such capabilities have also been identified
original panel of experts as well as five addi- within IS literature as important components of
tional senior IS executives. The instructions, evolving planning systems (King 1988).
which were provided on the cover sheet, Utilizing these measures along with the key
asked the respondent to indicate which con- objective criteria of alignment, analysis, and
struct was most closely associated with each cooperation, measures of planning capabilities
scale item or if such matching was indeter- are derived. These scale items are presented
minable. The respondent was allowed to refer- in the final section of Table 1.
ence the page of construct descriptions as
often as needed and was encouraged to note In preparation for large-scale data collection,
instances of ambiguity or lack of clarity in the all items and the survey instrument were pre-
wording of scale items. tested by 23 senior IS executives. Similar to
the targeted respondent of the survey, each of
Results of the Q-sort exercise seem to confirm these managers was actively involved in
the adequacy of the developed scale items in strategic IS planning, and each had significant
capturing the prespecified goal-fulfillment fac- experience within the field of IS management.

MISQuarterly/June
1998 145
StrategicIS Planning

Table 1. Initial Item Measures for Goal Fulfillment and Improvement Constructs of SISP

Item Measures of Planning Alignment


(Seven-Point Scale Anchored by "EntirelyUnfulfilled"and "EntirelyFulfilled")
AL1 Understanding the strategic priorities of top management.
AL2 Aligning IS strategies with the strategic plan of the organization.
AL3 Adapting the goals/objectives of IS to changing goals/objectives of the organization.
AL4 Maintaining a mutual understanding with top management on the role of IS in supporting
strategy.
AL5 Identifying IT-related opportunities to support the strategic direction of the firm.
AL6 Educating top management on the importance of IT.
AL7 Adapting technology to strategic change.
AL8 Assessing the strategic importance of emerging technologies.
Item Measures of Planning Analysis
(Seven-Point Scale Anchored by "EntirelyUnfulfilled"and "EntirelyFulfilled")
AN1 Understanding the information needs of organizational subunits.
AN2 Identifying opportunities for internal improvement in business processes through IT.
AN3 Improved understanding of how the organization actually operates.
AN4 Development of a "blueprint"which structures organizational processes.
AN5 Monitoring of internal business needs and the capability of IS to meet those needs.
AN6 Maintaining an understanding of changing organizational processes and procedures.
AN7 Generating new ideas to reengineer business processes through IT.
AN8 Understanding the dispersion of data, applications, and other technologies throughout the
firm.
Item Measures of Planning Cooperation
(Seven-Point Scale Anchored by "EntirelyUnfulfilled"and "EntirelyFulfilled")
C01 Avoiding the overlapping development of major systems.
C02 Achieve a general level of agreement regarding the risks/tradeoffs among system projects.
C03 Establish a uniform basis for prioritizingprojects.
C04 Maintaining open lines of communication with other departments.
C05 Coordinating the development efforts of various organizational subunits.
C06 Identifying and resolving potential sources of resistance to IS plans.
C07 Developing clear guidelines of managerial responsibility for plan implementation.
Item Measures of Planning Capabilities
(Seven-Point Scale Anchored by "Much Deterioration"and "Much Improvement")
CA1 Abilityto identify key problem areas.
CA2 Abilityto identify new business opportunities.
CA3 Abilityto align IS strategy with organizational strategy.
CA4 Abilityto anticipate surprises and crises.
CA5 Abilityto understand the business and its information needs.
CA6 Flexibilityto adapt to unanticipated changes.
CA7 Abilityto gain cooperation among user groups for IS plans.

146 MISQuarterly/June1998
StrategicIS Planning

All organizations were visited by one of the interest" in, strategic IS planning.
researchers and face-to-face interviews were Overwhelmingly, firms of larger size, with high-
conducted with each manager. Assessments er levels of geographic complexity, and with
were made on the items, constructs, and com- higher levels of "information intensity" (e.g.,
prehensiveness of the instrument. Some items insurance companies, banks, large manufac-
were slightly refined and a preliminary assess- turers), actively engaged in SISP. Additionally,
ment indicated that there was a high degree of the activity tended to be most concentrated in
internal consistency among scale items. the highest levels of the management hierar-
chy. Based on this and other information gath-
ered in the field interviews, it was determined
that the senior IS executive (vice president,
Data collection and the role of an CIO, director) represented the most accurate
organizationalinformant source of organizational information regarding
SISP. Further, it was determined that smaller,
In many empirical studies, the measurement of structurally simple, and less information-
organizational characteristics has typically uti- intense organizations may be unable to pro-
lized a "key informants" methodology. In vide responses of interest.
essence, this method of data collection relies
on a select set of members for providing infor- Working within this context, the East Edition of
mation about a social setting. Such informants the Directory of Top Computer Executives was
are not chosen at random; rather, they are adopted as an initial sampling frame of poten-
chosen because they possess special qualifi- tial respondents. This index includes the
cations such as status, experience, or special- names, titles, addresses, and phone numbers
ized knowledge. In survey research, targeted of top computer executives in the eastern half
respondents assume the role of a key infor- of the United States. Due to fundamental dif-
mant and provide information on an aggregat- ferences in profit motive and subsequent focus
ed unit of analysis by reporting on group or of planning activities between private and pub-
organizational properties rather than personal lic firms (Lederer and Sethi 1988), all hospi-
attitudes and behaviors (Venkatraman 1989). tals, educational institutions, and governmental
The use of key informants has been a popular agencies were removed from the initial sam-
approach within empirical IS studies pling frame. The sampling frame was further
(Pinsonneault and Kraemer 1993). However, reduced through elimination of firms whose
in the absence of a strategy to obtain accurate senior IS managers did not hold the job title of
data, results can be confounded, leading to CIO, VP, director of MIS, or director of strate-
erroneous conclusions (Huber and Power gic planning. From this resultant sampling
1985; Hufnagel and Conca 1994). frame of over 1,000 potential respondents, a
random sample of 550 was chosen.
A particularly damaging confound in utilizing
an organizational informant is a lack of knowl- A cover letter and survey instrument were
edge by the respondent. Therefore, within the mailed to each member of the sample. To
context of this study, it was important to identi- encourage immediate response, a dollar bill
fy organizations that actively engage in SISP was attached to each cover letter. To encour-
and to identify respondents within those orga- age accurate response, each potential partici-
nizations who are emotionally involved with, pant was promised a customized report of the
and most knowledgeable about, the activity. research findings that would profile the respon-
With this in mind, over 20 organizations were dent's firm relative to the entire sample, their
visited to determine the types of firms which respective industry, firms of comparable size,
undertook strategic IS planning, the level in the and firms with similar years of experience in
organizational hierarchy at which most of the SISP. Within two weeks, 65 responses (11.8%
planning activity was concentrated, and the of surveys mailed) were received. Within three
organizational member most knowledgeable weeks, an additional 128 responses (23.2% of
about, and with the highest amount of "vested surveys mailed) were received, for a collected

MISQuarterly/June1998 147
StrategicIS Planning

total of 35.1%. Within five weeks, an additional (1993) and Anderson (1987), as well as
58 surveys (10.5 % of the total mailed) were Gerbing and Anderson (1988). A recent study
received for a collected total of 45.6%. The (Segars 1997) reconciles and illustrates the
remaining surveys were collected in the sixth theoretical and empirical underpinnings of
and seventh week after the initial mailing for a these early works within the context of IS
total response of 47.63%. This response rate research. This resulting framework suggests
is markedly higher than that usually realized in that each of the measured factors be modeled
comparable IS studies (Pinsonneault and in isolation, then in pairs, and then as a collec-
Kraemer 1993; Premkumar and King 1992; tive network. Proceeding in this manner pro-
Raghunathan and King 1988) and can perhaps vides the fullest evidence of measurement effi-
be attributed to the targeted nature of the mail- cacy and also reduces the likelihood of con-
ing and the incorporated incentives. Nine founds in full structural equation modeling
responses contained incomplete data or were which may arise due to excessive error in
otherwise unfit for analysis and were subse- measurement (Anderson 1987; Anderson and
quently eliminated, thereby yielding an effec- Gerbing 1988; J6reskog 1993; Segars and
tive response rate of 46.8%. The collected Grover 1993). Working within this context, the
sample consists primarily of manufacturers CALIS procedure of SAS (version 6.12) was
(48.2%) followed by finance/insurance entities utilized as the analytical tool for testing statisti-
(17.4%) and wholesale/retail (14.2%) and is cal assumptions and estimation of the mea-
skewed toward larger firms with about 95% surement and structural equation models dis-
having sales over $100 million and 54% with cussed in the following sections.
sales over half a billion dollars. The majority
(73%) of the respondents are either just below
or two levels below the CEO. In sum, the data
collection process yielded 253 distinct assess-
Checks forstatisticalassumptions
ments of the 30 scale items listed in Table 1.
Two important assumptions of confirmatory
factor modeling are multivariate normality and
model determinacy (or identification). Because
multivariate normality is difficult to test, it is
Empirical Assessment of recommended that univariate normality among
Construct Measurement variables be initiallytested. In essence, estab-
lishing univariate normality among of a collec-
As developed, each of the item clusters (or tion of variates helps gain, though not guaran-
scales) in Table 1 represents an a priori mea- tee, multivariate normality (Hair et al. 1992).
surement model of the theoretical construct Such testing can be accomplished through
space of SISP success. Given this theory-dri- examination of the moments around the mean
ven approach to construct development, the of each variate's distribution (Bollen 1989).
analytical framework of confirmatory factor Among the variables of this study, analysis of
analysis (Bollen 1989; Joreskog 1993) pro- these statistics suggests no serious departures
vides an appropriate means of assessing the in univariate normality. As a further test of this
efficacy of measurement among scale items statistical assumption, several multivariate
and the consistency of a prespecified structur- tests of skewness and kurtosis were examined
al equation model with its associated network (Mardia 1970). Checks of these statistics also
of theoretical concepts. In essence, the expec- suggest no serious departures from multivari-
tation is that each of the developed scales in ate normality or excessive kurtosis.
Table 1 will uniquely measure its associated
factor and that this system of factors will mea- As structural models become complex, there is
sure an overarching or second order factor of no guaranteed approach for ensuring that
planning system success. General procedures model identification has been obtained (Bollen
for assessing theory within the realm of confir- 1989). However, there are a number of diag-
matory analysis are suggested by J6reskog nostics that can be utilized in gathering evi-

148 MIS Quarterly/June 1998


StrategicIS Planning

dence of identification. Perhaps the most over-simplified may be capitalizing on "chance"


readily obtainable measure comes from the rather than reflecting true sources of variation
estimation program itself. CALIS performs a in the observed covariance matrix (Chin and
simple test for identification during the estima- Todd 1995). Therefore, extreme caution must
tion process and alerts the user of possible
be exercised when modifications are incorpo-
identification problems. In all models estimat-
rated. Further, the efficacy of significantly
ed in the present analysis, no such warnings
were observed. However, this test is not altered models must be scrutinized when they
robust in capturing all instances of unidentified have been modified in the absence of theory
models (J6reskog 1993). Another method of or when they have not been confirmed with an
testing identification involves multiple estima- independent data set.
tion of the structural model with differing start-
ing values. Programs such as CALIS, which The measurement properties for the final mod-
estimate parameters of structural models, pro- els of alignment, analysis, cooperation, and
vide the researcher with a means of specifying capabilities are presented in Table 2. As
an initial value for any coefficient. If a starting shown, relatively little adjustment to the theo-
value is not specified, the program automati- rized models of Table 1 is required as a result
cally computes them through likelihood or of measurement modeling. In the initial phase
least-squares techniques. If the model is iden-
of isolated model estimation, only items AL1
tified, the solution of each model should con-
and AL2 of alignment and AN2 of analysis
verge at the same point each time. Such an
approach was undertaken in each of the esti- were deleted due to a lack of reliability. No
mated models of this analysis. In all cases, items associated with the hypothesized mod-
solutions converged at the same point and els of cooperation or capabilities were eliminat-
were identical, thereby providing strong evi- ed. In the subsequent tests for discriminant
dence of model identification.
validity (discussed in the following section),
item AN5 of analysis was also deleted due to a
significant cross-loading with the construct
Convergentvalidityand alignment. Overall, the parameter estimates, fit
unidimensionality indices, and observed residuals imply that the
revised models of Table 2 are a good fit for the
Upon the estimation of measurement models observed correlations among their respective
for alignment, analysis, cooperation, and capa- items. In each case, the X2 value is relatively
bilities, it is possible to directly assess mea- low (i.e., not significant at p < 0.10) and the
surement efficacy. As noted in previous
GFI and AGFI are well above 0.90. RMSR is
research (Gerbing and Anderson 1988), model
0.03 (or less) and all indicator reliabilities are
fit measures, in particular X2,provide direct sta-
tistical evidence of both convergent validity sufficiently high and statistically different from
and unidimensionality. Further evidence of zero. The residual matrix for each model con-
these properties is gained through high and tains no values significantly different from zero
significant factor loadings as well as low resid- and the composite reliabilities of each con-
uals between the observed and implied covari- struct are all about 0.90. In each instance, the
ance matrices. In instances where the initial
average variance extracted (AVE) is above
models proposed by the researcher do not fit
0.50, indicating that the variance captured by
the data, examination of indicator loadings, t-
the respective construct is larger than the vari-
values, and the residual matrix can provide
ance due to measurement error (Fornell and
insight into possible model improvement
Larcker 1981). In sum, the fit statistics seem to
(MacCallum 1986; Segars and Grover 1993).
Importantly, simplifying models by removing suggest that each scale is capturing a signifi-
items may create identification problems cant amount of variation in these latent dimen-
(Bollen 1989). Additionally, a model that is sions of strategic planning success.

MISQuarterly/June1998 149
StrategicIS Planning

Table 2. Final Measurement Properties of Planning Success Measures

Alignment
Item Mean Standard Deviation ML Estimate (X) t-Value P-Level
AL3 4.30 1.10 0.89 17.82 p < .001
AL4 4.41 1.11 0.86 16.87 p <.001
AL5 4.48 1.11 0.84 16.23 p <.001
AL6 4.30 1.10 0.84 16.14 p < .001
AL7 4.42 1.10 0.83 15.84 p <.001
AL8 4.31 0.96 0.74 13.40 p < .001
Measures of Model Fit Refinement(s) From Initial Model
X2 (9) = 19.05 (p = 0.02) AL1 and AL2 deleted due to lack of item
Goodness of Fit = 0.97 reliability.
Adjusted Goodness of Fit = 0.93
Root Mean Square Residual = 0.01
Factor Reliability = 0.93
Average Variance Extracted = 0.70
Analysis
Item Mean Standard Deviation ML Estimate (k) t-Value P-Level
AN1 4.46 0.96 0.73 12.85 p < .001
AN3 4.44 1.00 0.73 13.05 p < .001
AN4 4.47 1.08 0.79 14.54 p< .001
AN6 4.10 0.92 0.80 14.72 p < .001
AN7 4.18 0.97 0.80 14.65 p < .001
AN8 4.42 1.06 0.71 12.40 p < .001
Measures of Model Fit Refinement(s) From Initial Model
X2 (9) = 16.37 (p = 0.06) AN2 deleted due to lack of item reliability
Goodness of Fit = 0.97 AN5 deleted due to significant cross-loading
Adjusted Goodness of Fit = 0.94 with Alignment.
Root Mean Square Residual = 0.02
Factor Reliability = 0.89
Average Variance Extracted = 0.58
Cooperation
Item Mean Standard Deviation ML Estimate (X) t-Value P-Level
C01 4.66 1.21 0.68 11.87 p <.001
C02 4.22 1.03 0.78 14.28 p < .001
C03 4.22 1.21 0.76 13.88 p <.001
C04 4.73 0.98 0.78 14.48 p < .001
C05 4.38 0.98 0.81 15.14 p < .001
C06 4.16 0.93 0.77 13.97 p < .001
C07 4.23 1.08 0.79 14.69 p < .001
Measures of Model Fit Refinement(s) From Initial Model
X2(14) = 22.01 (p = 0.08) No items deleted.
Goodness of Fit = 0.97
Adjusted Goodness of Fit = 0.95
Root Mean Square Residual = 0.02
Factor Reliability = 0.91
Average Variance Extracted = 0.60

150 MISQuarterly/June1998
StrategicIS Planning

Table 2. Continued

Capabilities
Item Mean Standard Deviation ML Estimate (X) t-Value P-Level
CA1 4.88 0.81 0.80 14.97 p < .001
CA2 4.64 0.82 0.69 12.12 p <.001
CA3 4.97 1.01 0.79 14.62 p < .001
CA4 4.35 0.83 0.67 11.51 p < .001
CA5 5.02 0.85 0.81 15.18 p < .001
CA6 4.53 0.91 0.72 12.75 p < .001
CA7 4.80 0.93 0.71 12.50 p < .001
Measures of Model Fit Refinement(s) From Initial Model
X2 (14) = 24.31 (p = 0.04) No items deleted.
Goodness of Fit = 0.97
Adjusted Goodness of Fit = 0.94
Root Mean Square Residual = 0.03
Factor Reliability = 0.90
Average Variance Extracted = 0.56

Assessment of discriminantvalidity validity is strongly inferred when AVE for each


construct is greater than the squared correla-
Discriminant validity is inferred when measures tion between constructs. Such results suggest
of each construct converge on their respective that the items share more common variance
true scores which are unique from the scores with their respective constructs than any vari-
of other constructs (Churchill 1979). ance the construct shares with other con-
structs. As suggested in previous research,
Empirically, this is achieved when the correla-
tions between any two dimensions are signifi- this heuristic may be overly restrictive in some
cantly different from unity (Bagozzi et al. contexts and should be used as a supplemen-
1991). Such evidence can be obtained through tary means of assessing the degree of discrim-
the comparison of an unconstrained model inant validity (Fornell and Larcker 1981).
that estimates (or "frees") the correlation (P)
between a pair of constructs and a constrained In the present analysis, testing discriminant
model which fixes the value of the construct validity through pairwise X2 difference tests
correlation to unity. The difference in X2 requires the estimation of 12 covariance struc-
between these models is also a X2variate with tures (six constrained, six unconstrained) and
evaluation of six X2differences. As noted earli-
degrees of freedom equal to one. A significant
X2 difference implies that the unconstrained er, initial analysis of indicator reliabilities and
model is a better fit for the data, thereby sup- modification indices across the paired tests
porting the existence of discriminant validity suggested that one item (AN5) exhibits a high-
(Anderson 1987; Bagozzi and Phillips 1982; ly significant cross-loading with the construct
Bagozzi et al. 1991; Gerbing and Anderson of alignment, hence, this item was eliminated
1988; Venkatraman 1989). Such tests are con- from further analysis and all affected paired
ducted between all possible pairs of constructs tests were recalculated. All other items exhibit-
within the theoretical system. Once discrimi- ed characteristics of unidimensional measure-
nant validity has been established through ment as evidenced by the x2 values associated
paired tests, a more refined indication of the with the unconstrained models (Gerbing and
"extent of discrimination" between construct Anderson 1988). In all cases, the normed x2
pairs can be gained through comparison of the value is well below the suggested cutoff of five
AVE for each construct with the estimated cor- (Anderson 1987; Bagozzi et al. 1991; Gerbing
relation between constructs. Discriminant and Anderson 1988), suggesting that the

MISQuarterly/June1998 151
StrategicIS Planning

scales contain properties of internal and exter- cooperation and capabilities. As shown in
nal consistency. In addition, the observed reli- Table 3, correlations among these dimensions
abilities of indicators remained virtually invari- are statistically significant and of high magni-
ant (?.01) across the estimated unconstrained tude, suggesting the existence of such a struc-
models providing additional evidence of solu- ture. In other words, while each of these
tion stability. dimensions is distinct, success along one
implies success along the others. Previous
Table 3 contains the results of the pairwise x2 research notes that this operational perspec-
difference tests among constructs. As shown, tive represents a theoretically strong basis for
all x2 differences are significant at p < .001. capturing complex effectiveness measures
Hence, each scale seems to capture a con- (DeLone and McLean 1993; Raghunathan and
struct that is significantly unique from other Raghunathan 1994). Importantly, the reported
constructs providing evidence of discriminant correlations are not a rigorous test of such
validity. Importantly, the estimated correlation effects. However, a "second-order" factor mod-
between all construct pairs is below the sug- eling perspective can capture these correla-
gested cutoff of 0.90 (Bagozzi et al. 1991; tions and "explain"them using a higher order
Fornell and Larcker 1981), implying distinct- construct that is an integrative latent represen-
ness in construct content. However, compari- tation of SISP success. In essence, this struc-
son of the AVE of construct pairs to the ture is expected to resemble a factor model
squared correlation between pairs suggests with correlations among the first-order con-
that alignment and analysis as well as analysis structs (alignment, analysis, cooperation, and
and cooperation are highly associated and capabilities) being governed by a second-order
may not exhibit strong properties of discrimi- factor "SISP success." The efficacy of such a
nant validity. The AVE for all other construct structure can be tested using a comparative
pairs is well above the squared correlations methodology for higher-order factor models
between constructs, suggesting strong proper- (Bollen 1989; J6reskog 1993; Marsh and
ties of discriminant validity. In sum, the find- Hocevar 1985).
ings seem to suggest that the indicators of the
final models in Table 3 are unidimensional and
that each construct is relatively distinct in con- A comparisonof baseline and
tent. However, the discriminant validity is var-
ied among constructs with the content domain covariationmodels
of alignment and analysis as well as analysis
and cooperation being less distinct than that of The baseline model for testing the existence of
other construct pairs. Such results can be SISP success implies that alignment, analysis,
expected given that each of the constructs are cooperation, and capabilities are associated
themselves posited indicators of the higher- but not governed by a common latent phenom-
order construct, SISP success. enon. In other words, such a model suggests
that these constructs are independent in their
prediction of SISP success. Accordingly, this
model, illustrated in Figure 1, was estimated
using the correlation matrix of construct indica-
Evaluating a Covariation tors observed in the sample (see Appendix A).
Model of SISP Success The observed x2 for this baseline model was
420.02 (df = 293; p = .000). Although this fig-
As theorized, SISP success is a higher-order ure seems abnormally high with respect to the
phenomenon that is evidenced through high isolated and paired modeling of the previous
performance across multiple dimensions. section, it must be reconciled with the rather
Interestingly, the observed correlations among large degrees of freedom inherent in the com-
the hypothesized dimensions of planning suc- bined model. Normed x2, the most commonly
cess seem to suggest that effectiveness in used metric in these situations, is 1.43, imply-
SISP is an aggregate of alignment, analysis, ing good model fit and no evidence of over-fit-

152 MIS Quarterly/June 1998


StrategicIS Planning

Table 3. Results of Discriminant Validity Tests: Planning Success Constructs

Constrained Unconstrained
Test ML Estimate T-Value Model X2 Model X2 X2Difference
Alignment with
Analysis 0.84 34.02*** 188.42 (54) 48.64 (53) 139.78***
Cooperation 0.78 26.19*** 364.14 (65) 100.76 (64) 263.38***
Capabilities 0.59 12.60*** 624.88 (65) 114.82 (64) 510.06***
Analysis with
Cooperation 0.89 42.26*** 141.80 (65) 73.11(64) 68.69***
Capabilities 0.64 14.51*** 450.41 (65) 113.89 (64) 336.52***
Cooperation with
Capabilities 0.65 15.02*** 503.81 (77) 123.19 (76) 380.62***
***Significantat p < .001

ting (Joreskog 1993). Importantly, the normed value of X2 is 1.43, indicating good
observed item loadings and correlation esti- model fit and no evidence of over-fitting. The
mates of Figure 1 mirrorthe estimates report- calculated target coefficient between the base-
ed in Tables 2 and 3. Such results seem to line and hypothesized models is a very high
confirm the strength of measurement inherent 0.99. This value suggests that the addition of
within the scale items and the stability of the the second-order factor does not significantly
factor solution. increase X2.Therefore, since the second-order
model represents a more parsimonious repre-
As illustrated in Figure 2, the alternative model sentation of observed covariances (four paths
posits a second-order factor governing the cor- in contrast to six correlations), it should be
relations among alignment, analysis, coopera-
accepted over the baseline as a "truer"repre-
tion and capabilities. The theoretical interpreta- sentation of model structure.
tion of this higher-order factor is an overall trait
of SISP success. Importantly, the second- Further empirical support for acceptance of the
order factor of this model is merely explaining higher-order factor structure is found in the
the covariation among first-order factors in a magnitude and significance of estimated para-
more parsimonious way (i.e., one that requires meters as well as the amount of variance
fewer degrees of freedom). Therefore, even explained by the structural equations. All struc-
when the higher-order model is able to explain tural equation parameters are of high magni-
the factor covariations, the goodness-of-fit of tude and exhibit significantly high t-values.
the higher-order model can never be better Specifically, the paths between SISP success
than the corresponding first-order model. In and its underlying first-order dimensions are
this sense, the first-order model provides a tar- 0.86 for alignment, 0.97 for analysis, 0.92 for
get or optimum fit for the higher-order model. It cooperation, and 0.68 for capabilities. These
has been suggested that the efficacy of sec- parameter estimates are analogous to the relia-
ond-order models be assessed through exami- bilities of observed indicators to posited con-
nation of the target (T) coefficient [T= X2(base- structs. Therefore, their high magnitude and
line model)/x2 (alternative model)] (Marsh and consistency provides strong evidence of con-
Hocevar 1985). This coefficient has an upper vergent validity and unidimensionality for the
bound of 1.0 with higher values implying that second-order construct of SISP planning suc-
the relationship among first-order factors is cess. Perhaps the most convincing evidence of
sufficiently captured by the higher-order factor. this model's predictive strength is the observed
In the present analysis, the observed X2for the total coefficient of determination. This statistic
second-order factor model is 421.79 (df = is a very strong 0.96, suggesting that a large
295). Adjusting for degrees of freedom, the amount of variance among the constructs is

MISQuarterly/June
1998 153
Strategic IS Planning

.46 --- AL3 .88

.47 > AL4

.49 -- AL5

.55 - AL6

.54 > AL7

.66 ---> AL8

.69 --- AN1

.67 - AN3

.60 > AN4

.58 > AN6

.60--- AN7

.67 - AN8

.72 > C01 '

.61 > C02 -

.66 -- C03

.60 > C04

.61-- C05

.64 - C06

.60 > C07

.58 - CA1

.72 - CA2

.58 ---- CA3

.73 - CA4

.58 ----- CA5


Chi Square (293) = 420.02 (p<.0001)
.68 > CA6 Goodness of Fit (GOF) = 0.89
.70 -- CA7 Adjusted GOF = 0.87

Figure 1. First-Order Factor Model of Strategic Planning Success

154 MIS Quarterly/June 1998


Strategic IS Planning

--
.46 - > AL3 .88

.47 - > AL4 .8


.84
.49 - > AL5
AL5
.549 <-.84 Alignment
.55 - AL6 -<

.54 - AL7

.66 > AL8

.69 > AN 1 71 .86

.67 - AN3 .
.60 > AN4
0 807
--.....~.9
58
.58 - ---> -C AN6 * - \

.60 - > AN7 Adjusted


.73 GOF\ \.

.72 2- CO1 69( pI


61 >C02 \2

.66 >- C03 .75


.60 C04< 79
.60 Cooperation /
.80
.61 C5 /

.64- CO C79

.60 > C07 .68

.72 -- >- CA2 .69

.58 - >CA3 8
'67
.73 __ .CA4
C A4
)0-- <Capabilities

.58 81
5> CA5
72 Chi Square (295) = 421. 79 (p<.0001)
.68 - >CA6
CAR Goodness of Fit (GOF) -= 0.89
.70 ---> CA7 GOF = 0.87
Adjusted

Figure 2. Second-Order Model of Strategic Planning Success

MIS Quarterly/June 1998 155


StrategicIS Planning

captured by the structural equations. Therefore, Implicationsforpractice


on both theoretical and empirical grounds, the
conceptualization of SISP success as a multidi- Planning is typically described in academic as
mensional measure consisting of alignment, well as practitioner communities as a funda-
analysis, cooperation, and improvement in mental managerial activity. Unfortunately, the
capabilities seems justified. contributions of managerial activities such as
planning are many times difficult to quantify in
practice. Yet, for the activity of planning to be
formally and accurately evaluated, desired out-
Implications, Limitations, comes should be known and constantly recon-
ciled with realized outcomes. The results of this
and Avenues of Future study imply that planning objectives associated
Research with (1) aligning IS strategies with organiza-
tional strategies, (2) understanding the
As noted previously, an important agenda processes, procedures, and technologies of the
within IS research is the development of vali- business, and (3) gaining the cooperation of
various management and end-user groups pro-
dated measures for effectiveness criteria
vide a useful framework for structuring desired
(DeLone and McLean 1992). Such measures outcomes of strategic IS planning. In addition,
are needed for two reasons. First, these crite-
objectives associated with improvement in
ria provide a necessary metric for accurately capabilities provide a potentially important per-
assessing the value and performance of infor- spective for assessing the adaptability of the
mation technologies along with their associat- planning system in meeting planning needs. In
ed structures for management. In many sum, managerial planners should find the
instances, practicing managers have no struc- scales associated with these success dimen-
tured set of criteria upon which to gauge the sions a useful tool for rationalizing and refining
activities associated with IS. Too often, the process of planning. These broad dimen-
sions can also provide a useful set of themes
assessment may be developed in terms of
what is most easily measurable, such as per- for strategic planning that helps build common
dialog and coordination among planners.
formance-to-budget, return on investment, or
cost-overruns. This method of evaluation may
Along with structuring a planning agenda, a
ignore many intangible benefits of IS resulting potentially importantissue among IS executives
in erroneous conclusions regarding its current is measuring the perceived value of strategic
value and poor decisions regarding future planning efforts among constituents within and
management practices and investment. A sec- outside the IS function. Do organizational con-
ond rationale for improved performance mea- stituents believe that higher levels of alignment,
sures is research related. Many studies within analysis, and cooperation are realized through
IS utilize simplistic and rather varied measures SISP activities? Do members of other functional
in capturing aspects of effectiveness (DeLone areas believe that SISP activities have adapted
and McLean 1992). In general, the lack of con- to changing competitive conditions? Without an
empirically sound context for measuring these
sistency among studies has hampered conclu-
beliefs, erroneous conclusions regarding the
sions regarding the effectiveness of informa-
monitoring, evaluation, and reconciliation of
tion systems and practices associated with
planning efforts can result. Given the apparently
their management. Therefore, validated perfor-
strong measurement properties of the scales
mance measures are needed from the stand- developed in this research, their use within the
point of establishing consensus among organization may provide a more accurate con-
researchers in the field and thereby facilitating text for identifying perceptions of SISP that are
consistency in operationalization and cumula- held by organizational members. Such data
tive research tradition. may be useful in addressing specific deficien-

156 MISQuarterly/June1998
StrategicIS Planning

cies in the planning process or in more effec- more prescriptive approaches for conducting
tively marketing planning activities within and and evaluating SISP.
outside of the IS function.
While the content of planning success certainly
has the most directly applicable implications
for those interested in SISP, the structure of
Implicationsforresearch this factor model may have useful implications
for other measures of IS effectiveness.
While activities and roles of IS professionals Specifically, the empirical framework of higher-
have become better defined through rigorous order factor analysis is utilized in this study to
research, the development of effectiveness statistically structure the theoretical concept of
measures has lagged behind in terms of defini- planning system success. This factor structure
tional and operational rigor. In many research has been useful in contexts of psychology and
contexts, planning success is often captured marketing research for modeling complex
as a single or small collection of scales that attributes such as general intelligence
measure effectiveness in terms of "successful" (Joreskog 1993) and customer satisfaction
or "unsuccessful." Such scales are appealing (Bagozzi and Phillips 1982). Previous research
for their simplicity in administration and ease of has noted that the second-order factor model
analysis. However, because of their encom- is likely to underlie many aspects of perfor-
passing nature, many varying aspects of plan- mance on both individual and organizational
ning success are hidden in the measure. levels (DeLone and McLean 1992; Marsh and
Further, a formal analysis that can rigorously Hocevar 1985). Given the strong empirical evi-
assess the accuracy of measurement cannot dence supporting the conceptualization of
be undertaken. The results of this study seem planning success, it seems likely that higher-
to confirm the contention that planning suc- order factor models may be useful in structur-
cess is multidimensional (King 1988). ing other attributes of IS performance.
Therefore, rather than viewing SISP through Incremental model testing, as adopted in this
an overly simplistic lens, it seems more appro- study, provides a structured methodology for
priate to frame studies within the context of researchers interested in rigorously establish-
broader and multiple dimensions of planning ing the viability of hypothesized second-order
success. For example, the examination of a performance factors.
particular planning methodology or approach
should consider the specific focus of the
process along with the resources required for Limitations
sustaining it. Perhaps a resource-intensive
methodology achieves very high levels of plan- Consistent with all studies that address IS-
ning success as defined in this study. In the based performance metrics, this research has
absence of a broader view of success, some attempted to bring a theoretical and operational
research designs may conclude that the plan- definition to a rather complex managerial con-
ning effort is a failure. In order to capture the cept. Such endeavors are ambitious in nature
"full story," theoretically driven measures that and therefore contain some inherent limitations.
capture complex outcomes of managerial Perhaps the most significant potential limitation
activity are needed as a supplement to finan- of the present study is the range of developed
cial ratios and cost figures. An important impli- constructs for SISP success. In general, no
cation for researchers is that these measures claim is (or can be) made by this study to have
need not be "soft"nor nebulously defined. The captured every aspect of this rather complex
empirical examination of relationships between phenomena. To its credit, the research design
planning approach, measures of planning suc- of this study has incorporated multiple rounds
cess, and measures of resource intensity of theory building through literature review and
potentially represents a fundamental shift in expert opinion. In addition, a rigorous method-
research design that is needed to develop ological approach of theory testing has been

MISQuarterly/June
1998 157
StrategicIS Planning

adopted that seems to confirm the adequacy of els and the overwhelming empirical support for
measurement. However, no psychometric tech- each of the models, limitations attributable to
nique can adequately address the complete- sample size do not seem particularly threaten-
ness or breadth of measurement. Therefore, it ing in this analysis. However, its potential
is entirely possible that other dimensions of effect on measures of fit should be acknowl-
SISP success exist but are not conceptualized edged in similar research contexts.
in the presented models.
Other limitations of the study may be potential
Another potential limitation concerns the response bias associated with the "single infor-
nature of the sample utilized in this analysis. mant" and lack of model refinement through
As noted earlier, the sampling method of this independent sample testing. Within this study,
study is that of convenience. The survey of this a single organizational respondent was used
study was targeted to organizations that were as an informed source of information regarding
likely to have defined processes for SISP and levels of IS planning success. While such
senior executives with vested interest in practice is typical of IS survey research
process outcomes. Although the utilized sam- (Pinsonneault and Kraemer 1993), it is by no
pling frame has been widely-used in similar means an ideal method of data collection
studies and contains organizations which likely (Hufnagel and Conca 1994). Multiple infor-
participate in the activity of interest, no claim of mants and structured methods of triangulation
external validity for this study's findings can be are perhaps the best method of obtaining the
made. Instead, these findings can only be gen- most accurate data regarding organizational
eralized to the population of firms within the properties. However, such methods potentially
sampling frame. This state of affairs in no way limit the number of issues that can be
renders the results of the study irrelevant or addressed and also limit the amount of useful
limited. The firms within the sampling frame data that can be collected. Nonetheless, possi-
are members of either the Fortune 1000 manu- ble biases associated with self-reporting by IS
facturing or Fortune 1000 service groupings managers must be considered when interpret-
and are typically the entities of most interest in ing the results of this study.
IS research due to their technological sophisti-
cation. However, the sample is limited to Finally, "true"confirmation of theoretical mod-
domestic organizations and is biased toward els is best obtained through model re-estima-
larger manufacturing and service entities. tion on an independent or holdout sample. Due
Therefore, generalizing the observed patterns to the sophistication of SISP success in terms
of planning and success to organizations of of number of indicators and factor complexity,
other nations or beyond the sampling frame model re-estimation was not feasible.
may be problematic. Therefore, while the findings seem strong in
terms of content and construct validity, the
Along with the nature of the sampling frame, results of this study must be viewed as prelimi-
sample size may represent a limiting aspect of nary and in need of further confirmation.
this research. In general, it is recommended
that five data points be collected for every esti-
mated parameter in a structural equation
model (Hair et al. 1992). Although the collect- Areas of futureinquiry
ed sample of 253 is considered adequate in a
general sense (Bearden et al. 1982), complex While this study has provided further theoreti-
models (many indicators, many factors) such cal and operational definition to many aspects
as the ones depicted in Figures 1 and 2 may of SISP success, it has by no means
require even larger sample sizes. In general, answered all questions concerning this impor-
when models are complex and samples are tant managerial activity. A potential avenue of
small, the hypothesized model will be rejected future research is replication of this study
too often (Bearden et al. 1982). Given the con- across a broader sampling frame or across a
sistent convergence across all estimated mod- selected sample of international entities. The

158 MISQuarterly/June1998
StrategicIS Planning

findings of such work would provide additional Approach," Psychological Bulletin (103:3),
validity for these findings as well as provide 1988, pp. 411-23.
additional empirical support for theoretical Baets, W. "Aligning Information Systems With
studies in the area. Such studies might also Business Strategy," Journal of Strategic
build theory by incorporating additional plan- Information Systems (1:4), 1992,
ning system dimensions which are reflective of pp. 205-13.
new or evolving managerial practices and/or Bagozzi, R. P., and Phillips, L. W.
incorporate additional dimensions of planning "Representing and Testing Organizational
system success which are reflective of newer Theories: A Holistic Construal,"
performance issues. Administrative Science Quarterly (27),
September 1982, pp. 459-489.
Another needed area of inquiry concerns the Bagozzi, R. P., Yi, Y., and Phillips, L. W.
evolution of planning systems over time. In "Assessing Construct Validity in
other words, future research should attempt to Organizational Research," Administrative
identify patterns of planning system success Science Quarterly (36), September 1991,
as organizations become more experienced in pp. 421-458.
strategic IS planning. Such work would provide Bearden, W. O., Sharma, S., and Teel, J. E.
interesting insight into the evolutionary path of "Sample Size Effects on Chi Square and
strategic IS planning in terms of the type of Other Statistics Used in Evaluating Causal
system adopted within particular evolutionary Models," Journal of Marketing Research
stages, the length (time) of each stage, and (19), November 1982, pp. 425-430.
motivations for moving between stages. Bollen, K. A. Structural Equations With Latent
Although this study implies that systems Variables, Wiley, New York, 1989.
should exhibit characteristics of alignment, Bowman, B. J., Davis, G. B., and Wetherbe, J.
analysis, cooperation and improvement in C. "Three Stage Model of MIS Planning,"
capabilities over time, it says little about how Information & Management (6:3), 1983, pp.
these systems evolved or how they may fur- 11-25.
ther evolve. Empirical work in this area may Boynton, A. C., and Zmud, R. W. "Information
help answer these questions and would have Technology Planning in the 1990's:
enormous prescriptive implications for prac- Directions for Practice and Research," MIS
tice. Hopefully, the results of this study can Quarterly(11:1), March 1987, pp. 59-71.
provide a solid theoretical and operational Brancheau, J. C., Schuster, L, and March, S.
basis for research focused on differentiating T. "Building and Implementing an
the efficacy of varying planning configurations Information Architecture," Database (19:2),
and for studies that determine migratory paths 1989, pp. 9-17.
of planning system design and redesign for Brancheau, J. C., and Wetherbe, J. C.
"Information Architectures: Methods and
ever-changing technological and competitive
contexts. Practice," Information Processing and
Management (22:1), 1986, pp. 453-43.
Chan, Y. E., and Huff, S. L. "Strategy: An
Information Systems Research
References Perspective," Journal of Strategic
Information Systems (4:1), 1992,
Anderson, J. C. "AnApproach for Confirmatory pp. 191-201.
Measurement and Structural Equation Chin, W. W., and Todd, P. A. "On the Use,
Modeling of Organizational Properties," Usefulness, and Ease of Use of Structural
Management Science (33:4), 1987, Equation Modeling in MIS Research: A
pp. 525-41. Note of Caution," MIS Quarterly (19:2),
Anderson, J. C., and Gerbing, D. W. June 1995, pp. 237-246.
"StructuralEquation Modeling in Practice: A Churchill, G. A. "A Paradigm for Developing
Review and Recommended Two-Step Better Measures of Marketing Constructs,"

MISQuarterly/June1998 159
StrategicIS Planning

Journal of Marketing Research (16), Henderson, J. C. "Plugging Into Strategic


November 1979, pp. 64-73. Partnerships: The Critical IS Connection,"
DeLone, W. H., and McLean, E. R. Sloan Management Review (31:3), 1990,
"Information Systems Success: The Quest pp. 7-18.
for the Dependent Variable," Information Henderson, J. C., and Sifonis, J. G. "The
Systems Research (3:1), 1992, pp. 60-95. Value of Strategic IS Planing:
Das, S. R., Zahra, S. A., and Warkentin, M. E. Understanding Consistency, Validity, and IS
"Integrating the Content and Process of Markets," MIS Quarterly (12:2), June 1988,
Strategic MIS Planning With Competitive pp. 187-200.
Strategy," Decision Sciences (22:1), 1991, Henderson, J. C., and Venkatraman, N.
pp. 953-984. "Strategic Alignment: Leveraging
Davis, G. B. "Strategies for Information Information Technology for Transforming
Requirements Determination," IBM Organizations," IBM Systems Journal
Systems Journal (21:1), 1982, pp. 4-30. (32:1), 1993, pp. 4-16.
Directory of Top Computer Executives. Applied Henderson, J. C., Rockart, J. F., and Sifonis,
Research Co., Phoenix, AZ, 1994. J. G. "Integrating Management Support
Earl, M. J. "Approaches to Strategic Systems Into Strategic Information Systems
Information Systems Planning Experience Planning," Journal of Management
in Twenty-One United Kingdom InformationSystems (4:1), 1987, pp. 5-24.
Companies," in Proceedings of the Tenth Huber, G. P., and Power, D. J. "Retrospective
Annual International Conference on
Reports of Strategic-level Managers:
Information Systems, J. I. DeGross, J. C. Guidelines for Increasing Their Accuracy,"
Henderson and B. F. Konsynski (eds),
Strategic Management Journal (6:2), 1985,
Boston, 1989, pp. 271-277. pp. 171-180.
Earl, M. J. "Experiences in Strategic
Hufnagel, E. M. "Information Systems
Information Systems Planning," MIS Lessons From Strategic
Planning:
Quarterly(17:1), March 1993, pp. 1-24.
Planning," Information & Management
Fornell, C., and Larcker, D. F. "Evaluating
With (12:3), 1987, pp. 263-270.
Structural Equation Models
Hufnagel, E. M., and Conca, C. "User
Unobservable Variables and Measurement
Response Data: The Potential for Errorand
Error,"Journal of Marketing Research (18),
Biases," Information Systems Research
February 1981, pp. 39-50.
(5:1), 1994, pp. 48-73.
Gerbing, D. W., and Anderson, J. C. "An
Ives, B., and Learmonth, G. P. "The
Updated Paradigm for Scale Development
Information System as a Competitive
Incorporating Unidimensionality and Its
Assessment," Journal of Marketing Weapon," Communications of the ACM
Research (25), May 1988, pp. 186-192. (27:2), 1984, pp. 1193-1201.
Gillenson, M. L., and Studz, J. D. "Academic J6reskog, K. G. "Testing Structural Equation
Issues in MIS: Journals and Books," MIS Models," in Testing Structural Equation
Quarterly (15:4), 1991, pp. 447-452. Models, K. A. Bollen and L. S. Long (eds.),
Goodhue, D. L., Kirsch, L. J., Quillard, J. A., Sage Publications, Newbury Park, CA,
and Wybo, M. D. "Strategic Data Planning: 1993.
Lessons From the Field," MIS Quarterly Joshi, K. "The Measurement of Fairness and
(16:1), March 1992, pp. 11-34. or Equity Perceptions of Management
Hackathorn, R. D., and Karimi, J. "A Information Systems Users," MIS Quarterly
Framework for Comparing Information (13:3), September 1989, pp. 343-358.
Engineering Methods," MIS Quarterly King, W. R. "Strategic Planning for
(12:2), June 1988, pp. 203-220. Management Information Systems," MIS
Hair, J. F., Anderson, R. E. Tatham, R. L., and Quarterly (2:1), March 1978, pp. 27-37.
Black, W. C. Multivariate Data Analysis King, W. R. "Evaluating Strategic Planning
With Readings (3rd ed.), Macmillan Systems," Strategic Management Journal
Publishing, New York, 1992. (4:3), 1983, pp. 263-277.

160 MIS Quarterly/June 1998


StrategicIS Planning

King, W. R. "How Effective Is Your Information Long Range Planning (24:4), 1991,
Systems Planning?" Long Range Planning pp. 41-58.
(21:2), 1988, pp. 103-112. Prenikumar, G., and King, W. R. "An Empirical
Lederer, A. L., and Mendelow, A. L. Assessment of Information Systems
"Information Resource Planning: Planning and the Role of Information
Overcoming Difficulties in Identifying Top Systems in Organizations," Journal of
Management's Objectives," MIS Quarterly Management Information Systems (9:2),
(11:3), September 1987, pp. 389-399. 1992, pp. 99-125.
Lederer, A. L., and Sethi, V. "The Raghunathan, T. S., and King, W. R. "The
Implementation of Strategic Information Impact of Information Systems Planning on
Systems Planning Methodologies," MIS the Organization," Omega (16:2), 1988,
Quarterly (12:3), September 1988, pp. 85-93.
pp. 445-461. Raghunathan, B., and Raghunathan, T. S.
Lorange, P., and Vancil, R. "How to Design a "Adaptation of a Planning System Success
Strategic Planning System," Harvard Model to Information Systems Planning,"
Business Review (54:2), 1976, pp. 75-81. Information Systems Research (5:3), 1994,
MacCallum, R. "Specification Searches in pp. 326-340.
Covariance Structural Modeling," Sambamurthy, V., Venkataraman, S., and
Psychological Bulletin (100:1), 1986,
DeSanctis, G. "The Design of Information
pp. 107-120. Technology Planning Systems for Varying
Mardia, K. V. "Measures of Multivariate
Organizational Contexts," European Journal
Skewness and Kurtosis With Applications," of Information Systems (2:1), 1993,
Biometrika (57:3), 1970, pp. 519-530.
pp. 23-35.
Marsh, H. W., and Hocevar, D. "Applicationof A. H. the
Segars, "Assessing
Confirmatory Factor Analysis to the Study of Measurement: A
of Self-concept: First and Higher Order Unidimensionality
Factor Models and Their Invariance Across Paradigm and Illustration Within the
Context of Information Systems Research,"
Groups," Psychological Bulletin (97:3),
Omega (25:1), 1997, pp. 107-121.
1985, pp. 562-582.
McFarlan, F. W. "Information Technology Segars, A. H., and Grover, V. "Re-examining
Ease of Use and Usefulness: A
Changes the Way You Compete," Harvard Factor Analysis,"
Business Review (62:2), 1984, pp. 98-103. Confirmatory MIS
Quarterly (17:4), December 1993,
McLean, E. R., and Soden, J. V. Strategic
pp. 517-525.
Planning for MIS, John Wiley, New York,
1977. Steiner, G. A. Strategic Planning: What Every
Moore, G. C., and Benbasat, I. "Development Manager Must Know, The Free Press, New
of an Instrument to Measure the York, 1979.
Perceptions of Adopting an Information Straub, D. W. "Validating Instruments in MIS
Technology Innovation," Information Research," MIS Quarterly (13:2), June
Systems Research (2:3), 1991, 1989, pp. 147-169.
pp. 192-222. Venkatraman, N. "Research on MIS Planning:
Pinsonneault, A., and Kraemer, K. L. "Survey Some Guidelines From Strategic Planning
Research Methodology in Management Research," Journal of Management
Information Systems: An Assessment," Information Systems (2:3), 1985,
Journal of Management Information pp. 65-77.
Systems (10:2), 1993, pp. 75-105. Venkatraman, N. "Strategic Orientation of
Porter, M. E., and Millar, V. E. "How Business Enterprises: The Construct,
Information Gives You Competitive Dimensionality, and Measurement,"
Advantage," Harvard Business Review Management Science (35:8), 1989,
(63:1), 1985, pp. 149-160. pp. 942-962.
Premkumar, G., and King, W. R. "Assessing Venkatraman, N., and Henderson, J. C.
Strategic Information Systems Planning," Strategic Management and Information

MISQuarterly/June1998 161
StrategicIS Planning

Technology, JAI Press, Greenwich, CT, is an active consultant to both industry and
1994. government.
Venkatraman, N., and Ramanujam, V.
Success: A Varun Grover is an associate professor of IS
"Planning System
and in the Management Science Department at
Conceptualization Operational Model,"
Science the University of South Carolina. He holds a
Management (33:6), 1987,
B.Tech. in electrical engineering from the
pp. 687-705.
Indian Institute of Technology, an MBA from
Wiseman, C. Strategic Information Systems,
Southern Illinois University, Carbondale and a
Richard D. Irwin, Homewood, IL, 1985.
Ph.D. degree in MIS from the University of
Zachman, J. A. "Business Systems Planning
and Business Information Control Study: A Pittsburgh. Dr. Grover has over 80 refereed
articles published on IS planning, telecommu-
Comparison," IBM Systems Journal (21:1), nications and electronic commerce, reengi-
1982, pp. 31-53.
neering, and strategic information systems in
journals such as Information Systems
About the Authors Research, MIS Quarterly, Journal of
Management Information Systems, Decision
Albert H. Segars is an associate professor Sciences, IEEE Transactions on Engineering
Management, Database, Information &
in the Kenan-Flagler Business School at the
Management, California Management
University of North Carolina at Chapel Hill.
Review, Communications of the ACM, Long
He holds masters and bachelors degrees
Range Planning, Journal of Information
from the University of North Carolina and a
Systems, Interfaces, Omega, and numerous
Ph.D. in MIS from the University of South others. He recently co-edited a book on busi-
Carolina. Dr. Segars' areas of interest ness process change and two special sec-
include strategic planning, organizational tions on reengineering in Journal of
transformation through information technolo-
Management Information Systems. He has
gies (IT), telecommunications management, also served as special editor for issues of
and methodological approaches for studying Database and Decision Sciences. He is a
the impact of IT on people, organizations, recipient of the Outstanding Achievement
and industries. His recent articles on these Award from the Decision Sciences Institute
and other topics can be found in MIS and has twice received the college's Alfred G.
Quarterly, Decision Sciences, The Database Smith Award for Excellence in Teaching. Dr.
for Advances in Information Systems, and Grover recently served as the IS track co-
Information & Management. Dr. Segars is the chair for the 1996 National DSI Conference
recipient of the 1995 Society for Information and is currently on the editorial board of five
Management's (SIM) best paper award and journals.

162 MISQuarterly/June1998
Appendix A
Observed Correlation Matrixof Planning Success Measure
AL3 AL4 AL5 AL6 AL7 AL8 AN1 AN3 AN4 AN6 AN7 AN8 C01 C02 C03 C04 C05 C06 C07 CA1
AL3 1.0
AL4 .79 1.0
AL5 .76 .72 1.0
AL6 .72 .70 .70 1.0
AL7 .73 .69 .67 .73 1.0
AL8 .62 .63 .62 .65 .63 1.0
AN1 .49 .49 .52 .49 .50 .43 1.0
AN3 .55 .53 .54 .52 .51 .49 .56 1.0
AN4 .58 .59 .59 .56 .56 .50 .62 .61 1.0
AN6 .59 .58 .59 .55 .57 .49 .56 .57 .61 1.0
AN7 .57 .57 .55 .56 .57 .48 .53 .56 .62 .68 1.0
AN8 .53 .49 .54 .52 .52 .46 .52 .51 .53 .57 .59 1.0
C01 .49 .52 .51 .43 .47 .52 .47 .45 .51 .54 .47 .46 1.0
C02 .54 .55 .53 .49 .49 .50 .49 .49 .55 .57 .52 .54 .57 1.0
C03 .51 .52 .48 .46 .46 .41 .40 .49 .52 .50 .50 .45 .49 .62 1.0
C04 .56 .58 .50 .52 .49 .51 .52 .50 .59 .56 .57 .53 .57 .61 .61 1.0
C05 .53 .53 .45 .50 .51 .47 .51 .45 .56 .55 .53 .53 .57 .58 .60 .64 1.0
C06 .51 .44 .52 .49 .48 .50 .51 .51 .54 .56 .56 .58 .48 .58 .57 .60 .64 1.0
C07 .55 .52 .53 .53 .55 .51 .48 .50 .56 .57 .55 .53 .50 .63 .61 .58 .66 .63 1.0
CA1 .41 .39 .41 .40 .38 .38 .33 .34 .40 .39 .35 .43 .36 .41 .30 .35 .37 .34 .36 1.0
o}
CA2 .33 .31 .30 .43 .30 .35 .30 .27 .33 .29 .31 .30 .24 .42 .28 .29 .31 .27 .31 .58
CO CA3 .51 .43 .45 .44 .46 .45 .26 .36 .42 .43 .46 .52 .39 .47 .42 .37 .45 .47 .44 .68
CA4 .34 .25 .29 .37 .29 .28 .30 .32 .35 .39 .32 .32 .34 .42 .39 .34 .36 .30 .32 .53
CA5 .41 .35 .34 .36 .37 .45 .41 .38 .40 .41 .41 .43 .44 .46 .35 .41 .42 .42 .47 .65
0 CA6 .34 .35 .35 .34 .34 .31 .29 .34 .39 .45 .39 .32 .39 .42 .38 .38 .38 .29 .37 .52
CA7 .35 .32 .34 .33 .34 .35 .32 .31 .40 .35 .34 .34 .30 .44 .32 .29 .31 .33 .39 .56

C;

S-ar putea să vă placă și