Sunteți pe pagina 1din 9

A Roadmap for Enterprise Integration

Dennis Smith, Liam O’Brien, Mario Barbacci François Coallier


Software Engineering Institute Département de génie électrique
Carnegie Mellon University École de technologie supérieure
4500 Fifth Avenue 1100, rue Notre-Dame Ouest
Pittsburgh, PA 15213 USA Montréal, Québec
+1 412 268 6850 Canada H3C 1K3
{lob, dbs, mrb}@sei.cmu.edu fcoallier@ele.etsmtl.ca

systems can provide better business value by sharing data,


communicating results, and improving overall
functionality. Integration of information systems is
Abstract expensive and time consuming. Between 20% and 40% of
labor costs can be traced to the storage and reconciliation of
The ability to provide integration between business data. In addition, 70% of code in corporate software
functions that may be supported across multiple systems is dedicated to moving data from system to system
applications is a critical need for modern organizations. [1]. The challenge has always been how to realize this goal.
However, problems often emerge from overly ambitious or Over the past quarter century, there have been a number of
imprecise requirements resulting from inadequate plans for conceptual approaches and technology solutions that have
integrating different systems (legacy or otherwise). This addressed the problem of enterprise integration. However, a
paper analyzes the field of enterprise integration and comprehensive solution is not yet available. This paper
provides an analysis of the extent of the problem and reviews a set of current approaches to address enterprise
current trends that address the problem. It identifies gaps in integration, discusses why many previous efforts have
the field, outstanding research issues, and provides an failed, and suggests how an integrated approach may
initial roadmap toward a solution. provide the kind of benefits that have eluded the systems
world for the past 25 years.

1 Introduction Background

Enterprise Integration has the goal of providing timely and Despite the large investments that are made, many
accurate exchange of consistent information between integration efforts fail for a number of technical,
business functions to support strategic and tactical business organizational and management, and migration planning
goals in a manner that appears to be seamless. The initial reasons. The technical issues include the following:
automated applications that were developed during the • Legacy systems originated from unplanned, stovepipe
1950s and 1960s tended to focus at the level of an development or were developed as batch, single tier.
organizational unit. Over time, the scope of requirements • Data is specific to the applications and was not
has increased, along with an unfortunate tendency for the designed for sharing.
information systems to become brittle, difficult to manage, • The legacy systems were not initially designed for
and hard to understand. This in turns led to the inability of new quality-attribute requirements and are being
users to integrate critical new applications into the existing affected by needs for interoperability, performance,
solution set, or to mix-and-match the capabilities provided security, and usability.
by the systems to solve new problems.
• The scope for the integration effort is not adequately
As automated systems became more pervasive within defined.
organizations, and as organizations reorganized, split or • Decisions are made without performing adequate
were acquired and reacquired over the years, the need for analyses (sometimes referred to as “management by
integration between applications over a broad enterprise magazine”).
has become increasingly important, and in fact is often a
critical success factor for the survival of the enterprise.
The organizational and management issues include the
Rather than acting as independent programs, integrated need to obtain and maintain sponsorship and financial

Proceedings of the 10th International Workshop on Software Technology and Engineering Practice (STEP’02)
0-7695-1878-8/02 $17.00 © 2002 IEEE
commitment at all levels of the organization for the • W. L. Gore & Associates sued Deloite Consulting for
duration of a potentially lengthy integration project; the breach of contract, fraud and negligence to recover
need to break a project up into subprojects so that $3.5 million in fees; also names PeopleSoft for
consistent, intermittent milestones can be measured; and certifying incompetent party.
the need to communicate effectively. • SunLite Casual Furniture sued Deloitte in Arkansas for
In addition issues involved in migration planning are often maliciously “indoctrinating in SunLite a total
poorly understood. These include a consideration of dependency on D&T that D&T hoped would result in
migrating databases and data, understanding user issues, lucrative fees for years to come.”
providing training, and developing both temporary and • FoxMeyer Drugs blames “botched implementation of
long-term bridges between legacy systems and the newer SAP's F/3 software for pushing it into bankruptcy back
applications. in 1996.” Suing Andersen and SAP for $500 million,
also only spending $30 million for the project.

The Significance of Enterprise Integration Two analyses [4, 5] attribute the reasons for failures to 7
primary reasons:
The problem of enterprise integration is equally significant
1. Miscommunication
within the government and corporate world. Within the
U.S. federal government, every federal government 2. Hazy goals
organization has been mandated by the Clinger–Cohen Act
of 1996 [2] to appoint a Chief Information Officer (CIO). 3. Poor project management
The CIO has the responsibility of “developing, maintaining
4. Scope creep
and facilitating the implementation of a sound and
integrated information technology architecture” for the 5. Modifying ERP software prior to pilot testing
agencies.
6. Inadequate training
Within the corporate world business survival often depends
on the ability to effectively integrate applications across the 7. Insufficient implementation support
value chain of the business. One critical success factor in
Dell’s rise to prominence over such established companies
as IBM and Compaq has been its ability to provide 2 Planning for Enterprise Integration
integrated and efficient end-to-end service including order
entry, tracking, fulfillment, back-end processing and EI requires developing an overall plan to determine the
customer support. While enterprise integration is critically scope of a set of projects and then implementing this plan
important for all modern organizations, it is mandatory for with a sound technical approach. Both of these activities
some types of organizations, such as those that rely on e-
are crucial for the success of EI. We next briefly describe
business.
the overall planning activity and the activities associated
Although executives specify enterprise integration as a with implementing the plan.
critical goal, the track record of implementations has been Planning for enterprise integration is most often associated
spotty. A number of publicly documented failures [3] with the development of enterprise architectures. Enterprise
include: architecture planning is the process of defining
• Hershey Foods Corp., $115 million SAP installation to “architectures” for the use of information in support of the
replace “scores of legacy programs running everything business and the plan for implementing those architectures
from inventory to order processing to human These “architectures” are high level definitions of the data,
resources”; during busiest season of the year applications, and technology needed to support the
(Halloween), “Hershey warehouses piled up with business. The result of the process is a long-range plan to
undelivered Kisses, Twizzlers and peanut-butter cups. support the overall goal of enterprise integration.
The upshot: third-quarter sales dropped by a Most approaches to enterprise architecture planning
staggering 12.4 percent … and earnings were off 18.6 approaches are based on a framework originally proposed
percent.” by Zachman [6] that creates a matrix with data, functions
• Whirlpool, Dow Chemical, Boeing, Dell Computer, and network as the columns and a set of different views
Apple Computer and Waste Management experienced (contextual, conceptual, logical, physical and detailed
similar disappointment. representation ) as rows. Planning decisions involve logical

Proceedings of the 10th International Workshop on Software Technology and Engineering Practice (STEP’02)
0-7695-1878-8/02 $17.00 © 2002 IEEE
clustering of data and business processes into applications. 2. driving the enterprise architecture down to low levels
These approaches, which are widely used, enable the of detail
important task of developing a high level integration a. this results in losing the focus of the
blueprint. They also offer a method for discussing issues at enterprise architecture as well as modeling
different levels of detail, and for isolating information low levels of detail that will only need to be
requirements from their dependencies on existing legacy repeated when actual systems are developed.
systems. b. it also results in focusing on the functionality
of individual systems rather than the
Unfortunately, the label “architecture” has resulted in
interconnections between them.
confusion rather than clarity. These “architectures” provide
a starting point for understanding the problem domain, but
An Example of the Scope of an Enterprise Architecture
do not provide the foundation for software development
that software architecture does. An enterprise architecture
has a very different scope from a software architecture. The Figure 1 illustrates an example of an enterprise
software architecture is the structure or structures of a architecture. This figure represents an enterprise
system, which comprise software elements, the externally architecture (derived from [8]) for a general
visible properties of those elements, and the relationships telecommunications application.
among them [7]. Thus, a software architecture should begin
Figure 2 illustrates an example of an enterprise architecture
where the enterprise architecture ends.
context model [13] which deals with various business
There are also several problems with the current set of issues, represented by strategic planning, which drive, the
approaches. The linkage to the software architecture model. The enterprise architecture provides the blueprint
required to implement the plans is often left for future for scoping future IT applications. This leads to a set of
work, resulting in a disjunction between the planning stage specific projects which are developed and managed
and the implementation stage. In general, there is not clear according to the standard organizational development
guidance on this step. As a result, initial plans are often processes. As shown in Figure 2, the detailed analysis and
developed which later flounder for lack of a clear development activities are performed in the follow-on
connection to actual system development and for the lack activities, and not as part of the enterprise architecture.
of a detailed implementation plan. Few enterprise
architecture plans have actually been implemented
successfully. In addition, most approaches to enterprise 3 Implementing the plan
architecture planning assume a structured development
approach, and there have not been systematic updates
reflecting object-orientation. Implementing the plan for enterprise integration requires a
set of projects that rely on a systematic approach for
One way to plan for enterprise integration is to develop an representing business, information, and technology
enterprise architecture that represents how major perspectives; a systematic method to plan for specific
information systems across the enterprise fit together. The tactical solutions, including budgets and project plans; and
architecture identifies the scope of individual systems and an understanding of infrastructure issues, such as
the boundaries between them. Thus, an enterprise processors and storage, networking, data management, and
architecture is essentially a planning activity, rather than a management and staffing. The management and
development activity. organizational issues are critical for enterprise integration.
In practice, however, this distinction between planning and In this paper, we will focus primarily on technical issues.
development is often ignored. Organizations focus on the To understand the relationship between the technical issues,
wrong sets of issues in developing an enterprise we developed an integration model, which is shown in
architecture, and as a result get little value from it. There Figure 3.
are two basic problems that often occur in practice:
1. overscoping the enterprise architecture, resulting in an
open-ended effort that is too ambitious to ever
successfully implement

Proceedings of the 10th International Workshop on Software Technology and Engineering Practice (STEP’02)
0-7695-1878-8/02 $17.00 © 2002 IEEE
Figure 1: Example of an Enterprise Architecture

Enterprise IT Processes Context M odel

Strategic Planning
Enterprise Architecture
G o ve r n a n c e
Program and Integration Managem ent
M a nagement Dim ensio ns
Governance
Scope/Change
Risks
Schedule
Costs

Quality
Resources
Communications
Impacts
Vendor
Architecture
Assets

D e li v e r y
Project PROJECT Project
Initiation Closure
V&V
Engineering

Pure W aterfall
Product

Spiral
M odified W aterfall
Evolutionary Prototyping
Staged D elivery
CO TS So ftw are
Code-and -Fix
Design-to -Schedule
Design-to
Delivery -Tools
Ap proaches
Quality Assurance and C h ange M ana gem ent
O p er ation s
IT Proce ss M anagem ent and Support
a n d S u p p o rt
Infrastructure and Asset M anagem e nt
Operations and Support

Figure 2: Example of an Enterprise Architecture Context Model


Figure 1: Exam ple of an E nterprise Architecture Conte xt M odel

Proceedings of the 10th International Workshop on Software Technology and Engineering Practice (STEP’02)
0-7695-1878-8/02 $17.00 © 2002 IEEE
validation, and integrity of data and what translations need
to be applied to the data for exchange between applications
within the enterprise or between the enterprise and outside
systems.
Requirements and
Principles Control Integration deals with different types of messaging
between applications and how these messages are handled
based on different modes of communication and protocols.
Business Integration Connectivity relates to workflow, data, and service
connectivity and is handled by application bridges and

Application Integration
gateways, message-handling services, and basic
Quality Attributes

Presentation communication protocols.


Integration
Quality Attributes involve architectural decisions that
influence quality characteristics such as performance,
Data Control dependability, and security. Quality attributes span several
Integration aspects of the integration model. When the software
Integration architecture is specified, designers need to determine the
extent to which architecture decisions influence quality
attributes, the extent to which techniques used for one
Connectivity quality attribute support or conflict with those of another
attribute, and the extent to which multiple quality-attribute
requirements can be satisfied simultaneously.
Quality-attribute issues do not get enough attention in
Figure 3: Integration Model enterprise integration. Quality-attribute requirements are
usually defined too late in the development process. One
The Technical Issues problem is to determine how business requirements and
drivers translate into quality-attribute requirements.
Requirements and Principles deal with determining the Application Integration deals with getting different
business drivers and guiding principles that help in the applications to work together using mechanisms such as
development of the enterprise architecture. Each functional automatic event notification, flow control, and content
and non-functional requirement should be traceable to one routing. Transactional integrity and application-context
or more business drivers. Organizations are beginning to transformation across applications are important aspects of
become more aware of the need for capturing and application integration. Application integration spans
managing requirements. Use-case modeling is one of the several layers of the integration model. Clear techniques
techniques that is used for doing this. are not available for making decisions about which
applications to integrate and determining the nature of the
Business Integration concerns the design and modeling of problem. Applications on the same server may be easier to
business processes. Processes represent how the user sees integrate, as cross-network integration can be complicated
the system. They are often highlighted when companies by different operating system versions, network delays, and
merge. Business process reengineering (BPR) decisions are differing protocols.
often made in the context of enterprise integration.
This model is elaborated in more detail in [9].
Presentation Integration involves with integration of
corporate knowledge and business processes to enable an
enterprise to share applications, services, and core
competencies among the enterprise’s main constituents:
4 Enterprise Resource Planning Solutions
employees, customers, partners, and suppliers. (ERPs).
Data Integration deals with aspects of integrating data
within an enterprise. It deals with how data is modeled and Enterprise resource planning (ERPs) solutions are
the meaning of the data. It deals with normalization, integrated, technology-based solutions that provide support

Proceedings of the 10th International Workshop on Software Technology and Engineering Practice (STEP’02)
0-7695-1878-8/02 $17.00 © 2002 IEEE
for standard enterprise needs in such areas as finance, • Identifying all relevant stakeholders and involving
human resources, and logistics. A number of vendors them throughout the project
provide ERP solutions, including PeopleSoft, SAP, Baan,
and Oracle. ERPs are popular because they offer the • Ensuring there is a common understanding of the
promise of enabling an organization to leverage the problem to be solved
research and development efforts of the ERP vendors.
Functional areas such as taxes, purchasing, and human • Determining that the initiative is commensurate
resource management have a significant amount of with the maturity of the organization’s software
commonality between organizations, and there are strong practices
arguments for purchasing a ready solution rather than
developing an application from scratch. • Define all aspects of the software architecture and
ERPs can make good sense for an organization. However, its constraints on existing and new systems
the benefits are far from automatic. In fact, a number of
disasters in ERP implementations have occurred. A • Perform a thorough analysis of legacy systems,
decision to implement an ERP requires careful analysis of their interfaces, and changes required
the following factors:
• Break the problem into bite size chunks that are
• an understanding of the gap between the
phased in incrementally
underlying object, data, or functional models of
the ERP solution and those currently supported by
an organization’s legacy systems (often substantial • Do a pilot effort before committing to a large scale
effort is required to customize the ERP or change plan
the organizational processes to match those of the
ERP)
• an understanding of specific ways in which the 6 A Roadmap to Future Progress
ERP will interface with legacy systems, other
ERPs, and future development efforts
• an understanding of migration issues, such as user As we have seen, the demand for enterprise integration is
training, data migration, phasing in of the ERPs, broad. This affects all organizations, and addressing
and phasing out of the legacy systems enterprise integration can often be a key to meeting the
• development of realistic cost and schedule strategic goals of the organization. This section summarizes
estimates reflecting realistic expectations the positive trends and gaps related to technology issues
and organizational issues. It then outlines the steps that
need to be taken in order for significant progress to be
made.
5 Disciplined Migration Planning
Technology Issues
Enterprise integration can also be considered to be a
complex migration problem. Although the initial step of A workshop on enterprise integration conducted at
developing an enterprise integration plan establishes a CASCON2001 highlighted a number of the technology
blueprint for the final goal, in general these efforts have not trends that have been converging and that offer the
developed adequate plans. In general there is an potential of making substantial progress in addressing the
assumption, which may be unrealistic, that legacy systems problem of enterprise integration. It also identified
will be replaced over a period of time. As a result, such outstanding issues that need to be addressed before
efforts have sometimes been big bang approaches – without substantial progress can be made.
substantial intermediate deliverables. There is a need to
The positive trends include:
have a greater focus on migration plans from current legacy
systems and to clearly relate the perceptions and needs of
• Net-centric computing
end users to the long-range plans that are developed.
Bergey, O’Brien and Smith [10] have addressed the issue • Web as a portal to corporate data
of migration planning, and recommend addressing a set of • Implications of eCommerce
issues, including:
• Java enabled portability across hardware platforms and
operating systems

Proceedings of the 10th International Workshop on Software Technology and Engineering Practice (STEP’02)
0-7695-1878-8/02 $17.00 © 2002 IEEE
• Maturity of Enterprise Application Integration (EAI) processing on a WAN (latency, wide-scale
middleware (Websphere, Component Broker, Vitria, transaction, scalability)
.NET) and platforms (such as Eclipse) for the effective
• A need to recognize that integration cannot be
integration of tools [11] mandated, legislated or assumed. It needs to be
• Potential of mark-up languages (such as XML) for nurtured. There is often a lack of understanding of the
linking structured and non-structured data [12]. cost of integration at upper management levels. Cost,
risks, and potential harm need to be fed back to the
Despite this progress, the overall status of the field is
upper levels.
immature. The issues of planning and scoping continue to
hamper many efforts. There is significant confusion • A common failure to clearly define the scope of an
between the roles of different types of architectures. As a "enterprise" to integrate. This can result in a shifting
result, organizations sometimes go into too low a level of definition of the enterprise, overlapping organizations,
detail in developing an enterprise architecture, leading to a and turf battles. There is a great deal of pressure to
failure to adequately specify the scope, as well as a define an enterprise too broadly, and thus to make it
duplication of the effort that will later be applied to difficult to partition the problem into manageable
defining the software architecture. Although middleware entities.
technologies have matured significantly, clear guidelines
are not yet available about when to use different types of • A need to recognize that any technology solution
technologies. As a result, some organizations have made should derive from business drivers using technology
decisions in a haphazard manner and have sometimes as an enabler, as opposed to viewing technology as a
focused on vendor-driven approaches without adequate primary driver. Many failures result from a
analysis. Some ERP products are heavily promoted as a “technology first” or “solution first” approach, and
total solution to enterprise integration. However, substantial from the failure to adequately address organizational
modifications are often required to the ERP product for it to and cultural issues.
work in a specific organization. In addition, interfaces with
legacy systems and other ERP products can be problematic. • There is often a failure to take a long term view. Some
of the factors include the practice of rapid rotation of
Organizational Issues leadership, budget instabilities, and failure to plan for
long-term maintenance and upgrading costs.
The organizational issues are significant. An enterprise-
• A need to consider the total cost of ownership for an
integration effort affects an entire organization, and it is
ERP solution. The total cost includes not only the
necessary to have long-term management support and
ERP software cost but the other associated costs
financial commitment, realistic plans, and systematic
migration planning. including integration, training, system analysis,
customization, maintenance, etc. The associated costs
The outstanding organizational issues and problems may be of the order of magnitude of 5 to 7 that of the
include: software cost.
• a need for an effective methodology for enterprise • There can be a tension between the requirement of
integration including a clear distinction between the developing an enterprise architecture and the
scoping that an enterprise architecture provides and pragmatic demands of individual ERP/COTS
the detailed blueprint for development that a software solutions, leading to the impression that technology is
architecture for an application provides. This includes the solution.
clear guidelines for the deferral of details from the
enterprise architecture to the software architecture • When making a decision on an ERP, low level
analysis of the details needs to be done to determine a
• lack of generic solutions to integration problem
match in some cases changing existing business
(integration solutions tend to be local)
processes to match those of an ERP may be the most
• the extraction of interfaces from existing systems and cost-effective approach. However, this needs to be
identification of side effects done with careful analysis which unfortunately does
not occur often.
• need for clear guidance for management decision
making • There is a strong need for a coordinated migration
plan for the existing systems to move towards
• need for overall solution to distributed transaction
integration

Proceedings of the 10th International Workshop on Software Technology and Engineering Practice (STEP’02)
0-7695-1878-8/02 $17.00 © 2002 IEEE
• Addressing the technology issues of data integration,
control integration and presentation integration

Foundations for Future Progress • Decision rules for making choices on the types of
technology that are most appropriate for specific types
of efforts. Although many technology solutions are
A number of recent trends provide a foundation that can
available, there are not easily accessible guidelines for
lead to future success. Middleware technologies have
advanced rapidly over the past 10 years, and these enable when to use different types of solutions.
more options for integration than had been previously • Understanding when ERP solutions are appropriate,
available. The maturing of markup languages such as XML and when they are not appropriate
enable more effective integration, particularly between
structured data, such as data from databases, and non- • Breaking down an overall project into realistic parts
structured data, such as email.
• Developing realistic sets of plans for the effort
The Web can serve as a common front end for integrating a
variety of applications, and it can enable effective • Addressing issues of contracting, funding and
presentation integration. Web services are maturing as an oversight management within organizations. This is
important mechanism for integration of legacy systems, especially relevant for government organizations.
new applications and ERPs. The emergence of enterprise
portals over the past several years demonstrates the strong • Migration and integration of legacy systems
interest and need for effective presentation integration. In
addition, ERP applications, while still displaying
significant problems, have become more mature, and their
interfaces are better able to share data with other References
applications.
1. Zachman, J. “Enterprise Architecture: The Issue of the
7 Conclusions: Moving From Present Reality
Century.” Database Programming and Design, March,
to Desired State 1997.
2. U.S. Public Laws. Public Law 104-106, 1996.
There is a significant gap between the desired state of
seamless integration and present reality. In order to bridge 3. Osterland, A. ERP Disasters. CFO, The Magazine for
this gap the following critical issues need to be addressed: Senior Financial Executives, Jan. 2000.
4. Nash, K. “Companies Don’t Learn From Previous IT
• Determining an effective scope for an integration Snafus”, Computerworld, October, 2000.
effort as well as the development of a proven method
for developing an effective scope for integration 5. McAlary, S. “Three Pitfalls in ERP Implementations”,
The Managers Publication of Data Solutions, March,
efforts. Currently, many efforts flounder because they
2000.
fail to define an effective scope. Often current efforts
develop very ambitious scopes that are difficult, or 6. Zachman, J. “A Framework for Information Systems
impossible to successfully implement. Architecture,” IBM Systems Journal, Vol 26, No. 3,
1987.
• Aligning the integration effort with the mission and
7. Bass, L., Clements, P. and Kazman, R. Software
high-level goals of the enterprise, and developing
Architecture in Practice. 2nd. Ed. Addison Wesley.
commitment and sponsorship at the appropriate levels 2003.
• Understanding the appropriate role of an enterprise 8. Telemanagement Forum. eTOM Business Process
architecture, and its relationship to a software Framework. Available online at:
architecture http://www.waywise.at/files/eTOM%20Model.pdf.
• Understanding appropriate role of frameworks and 9. Kontogiannis, K., Smith, D., and O’Brien, L. On the
standards Role of Services in Enterprise Application Integration.
Proceedings of STEP 2002. IEEE Press. 2003.

Proceedings of the 10th International Workshop on Software Technology and Engineering Practice (STEP’02)
0-7695-1878-8/02 $17.00 © 2002 IEEE
10. Bergey, J., O’Brien, L. and Smith, D. DoD Software 12. Finkelstein, C. and Aiken. P. Building Corporate
Migration Planning. Carnegie Mellon University, Portals using XML. McGraw-Hill, 1999.
Software Engineering Institute, CMU/SEI-2001-TN-
13. Coallier F. and Garceau B., An Integrated Enterprise
012.
IT Process Model, (unpublished).
11. Britton, C. IT Architectures and Middleware. Addison-
Wesley, 2000.

Proceedings of the 10th International Workshop on Software Technology and Engineering Practice (STEP’02)
0-7695-1878-8/02 $17.00 © 2002 IEEE

S-ar putea să vă placă și