Informatica PowerCenter

How to extend the enterprise data integration capabilities

to include virtual data integration services

Pei Yung Chan

Product Manager
peiyung.chan@powerdataib.com
1

Corporate Overview

2

2

at a Glance

1993

Headquarters:

Redwood City, CA

Employees:

1,300+

Offices:

N. & S. America,
Europe, Asia Pacific

Revenue:

$391 million (2007)

$350

3-year Compound
Annual Growth Rate:

21% per year

Market share leader

((Gartner Dataquest)
q
)

$300

Customers:

2,950+

91 of Fortune 100

80%+ of Dow Jones

Government organizations in 20 countries

Partners:

$400

$250
$200

Over 400 major SI, ISV,

OEM and On Demand

Singular focus on Data Integration

Products and Services

$450

Founded:

$150
$100
2004

2005

2006

2007

Leader in Data Integration

Company

Offering

Customers

Founded in 1999

Over 80 employees

Technology

Professional Services & Education

INFA Technical Support in EMEA & LATAM

5 out of the 10 biggest companies (by revenue) Telefnica, Endesa, Cepsa, Iberdrola, Carrefour

9 of the main companies listed in Ibex 35 (Banesto,

BSCH, Corporacin Mapfre, Endesa, Iberdrola, Inditex,
Sogecable, Telefnica)

Offices

Madrid, Barcelona

Lisboa

Buenos Aires

Santiago de Chile

PowerData Customers
Insurance

Financial
Services

Pharma &
Healthcare

Retail &
Services

Telco

PowerData Customers
Telco

Public
Sector

Energy

Other
verticals

Enterprise Data Integration

7

7

The Information Economy

Enabled Through Data

On-demand Enterprise
(SaaS)

Traditional
Enterprise

Partner Trading
Enterprise (B2B)

SEPA
NAACHA
HIPAA

On-demand Integration

Enterprise Data Integration

Data Quality Across the Whole Enterprise

B2B Data Integration

The Information Economy

Key Customer Business Imperatives

Business
Imperatives

Improve
Decisions &
Regulatory
Compliance

Modernize
Business &
Reduce IT
Costs

Facilitate
Mergers &
Acquisitions

Improve
Customer
Service &
Operational
Efficiency

Outsource
Non-core
Functions

Increase
Partner network
Efficiency

IT
Initiatives

Business
Intelligence &
Regulatory
Reporting

Legacy
Retirement

Application
Consolidation

Customer,
Customer
Supplier,
Product Hubs

BPO
Saas

B2B
Integration

Data
Consolidation

Master Data
Management

Data
Synchronization

B2B Data
Exchange

Projects

Data
Warehouse

Data
Migration

The Information Economy

Key Customer Business Imperatives

Data
Warehouse

Data
Migration

Data
Consolidation

Master Data
Management

Hand Coding

Data
Synchronization

B2B Data
Exchange

= Less for more

The extended enterprise data everywhere

On-Demand

Application

Database

Unstructured

B2B
SWIFT

Data
Warehouse

10

Data
Migration

Data
Consolidation

Master Data
Management

Data NAACHA
Synchronization

SEPA

B2B Data
Exchange

HIPAA

Gain Business Value From Data

Common Project Lifecycle: Do More With Less

Data
Warehouse

11

Data
Migration

Data
Consolidation

Data
Master Data
Management Synchronization

B2B Data
Exchange

Why Informatica?

12
12

Informatica
The Data Integration Platform To Enable Business Imperatives

Improve
Decisions &
Regulatory
Compliance

Modernize
Business &
Reduce IT
Costs

Facilitate
Mergers &
Acquisitions

Improve
Customer
Service &
Operational
Efficiency

PowerExchange

B2B Exchange

13

Outsource
Non-core
Functions

Increase
Partner network
Efficiency

PowerCenter

Data Explorer

Data Quality

B2B Exchange

La visin de Informatica
Integracin de Datos
EIM, Content
Management

Complex
Data
Exchange

Data Grid

Metadatos
Data
Profiling

Data

(SAP, Siebel, TIBCO, Biztalk,

)

Time

Changed
Data
Capture

ETL

F d
Federation
ti
DWL

EAI

Mainframe
Scheduling

Auditing

Team Base
Develop/

DB
(Oracle, Microsoft, IBM, )

BI

14

Real

Quality

(BO, SAS, Microstrategy,

Hyperion, Cognos )

Aplicaiones y
Midleware

High
Availability

Web
Services
(SOA)

Data Federation
Right Time Data Integration

15
15

Why Enterprise Information Integration?

The Value Proposition of EII or Data Federation
BI TOOLS

16

PORTALS

Need for on-demand current data

from volatile operational systems

Large volume of data costly to

replicate and copying disallowed

No upfront requirements and

incremental development needed

Real time access to data needed

Real-time
without data movement or copying

Creates a virtual data layer that

serves as a single data source

Direct updates to source data are

necessary

Why Extract-Transform and Load?

The Value Proposition of ETL or Data Consolidation
BI TOOLS

17

PORTALS

Need for historical or more stable

data

Complex queries, large volumes of

data, with persisted results

Upfront end-user requirements

available with complete details

Can t tolerate any impact on

Cant
operational systems

Involves complex data integration

(transformation, etc.)

Direct updates to source data not

a requirement

Why Blended Data Integration?

The Value Proposition of a Hybrid Approach
BI TOOLS

18

PORTALS

Delivers holistic information i.e.

both historic and current

Provides choice of data integration

modes for flexibility

Delivers right-time data - real-time,

near real-time, batch

Enables rapid prototyping followed

by validation phase

Provides a blended architecture

with flexibility for specific needs

Supports highly optimized data

delivery by any access mode

The Informatica Advantage

Integrated Platform - Blended Right-Time Data Integration

Integrated functionality from leading data integration provider

Provides single environment for batch and real-time use cases

Optimized performance for both physical and virtual modes

Extends data access capabilities to a broad range of clients

Provides flexibility of data access - SQL, Web Services

Enables both platform and database independence

Ensures high developer and data analyst productivity

Architected for SOA by providing a data abstraction layer

19

Use cases

20
20

Blended Data Integration Use Cases

Drivers and Competitive Differentiation

Use Case Scenarios

DW Extension

Driver

Mergers and
Acquisitions
New Apps On
Onboarding

Value Prop.

Efficient Consolidation

Best of Breed

Flexible Data Federation

Light Footprint

Richer BI/Reporting
Environment

Easy to Use

New Data Source

Extension
2

Data Services

SOA

Data Breadth
Proven Installs

Service Enable Data

Complement Process
Services

21

Competitive
Differentiation

Easy Integration w/ Other

SOA Components
No Stack Required

Use Case 1
Data Warehouse Extension for Operational BI

Operational BI Tools

Portals

22

Operational
Databases

Business Unit 2

Business Unit 1

Data Federation Caching, Query Optimization

DW/DM

Power Center
ETL
Job

Use Case: Data Warehouse Extension

Well Management Reporting at Large Oil & Gas Producer

Situation and Requirements

Data Federation

Virtual view of well status, rig status and financial

information that improves real-time operational
decisions to Operational Portal and Work
Management Reporting System

10% increase in well revenue-performance and

efficiency
50% reduction in development time for
complex integration projects
20% improvement in individual field Engineer efficiency

ERP DW

23

Reporting DM
PowerCenter

Results

Source Applications

Operational Store

PowerCenter

Solution

PowerCenter

10,000 wells, 1,800 ETL jobs with 110m records

moved nightly; SLA window 6pm to 6am
Well Engineers are too burdened by data search,
collection and reporting
Wells are primary business assets utilization and
revenue must increase
Complex environment with massive data volumes
and many disparate data sources (operational and
historical)
Complex skill requirements, from engineer to dispatch

PowerCenter

Operational BI
Reporting Tool

Use Case 2
Data Services/Portals & Composite Applications

Portals

Composite Applications
SOA Data Services

SQL

Power Center
Data Federation Caching,
Caching Query Optimization

(Real Time)

Operational
Databases

24

Use Case: Data Services

Drug Discovery Application at Pharmaceutical Company

Situation and Requirements:

Solution:

Scientific Workbench that combines disparate data

Research Scientists
Drug Discovery Application

SQL

Data Services

Data Federation

PowerCenter
(Real Time)

Results:

25

Changing business needs from research scientists

Prototyping Rapid Applications Development tools with
flexibility of data integration and access
Complex analytics delivered on-demand from many
sources
SOA compliance
Share research data across the company
Structured and semi-structured data

50% reduction in development time for complex

data integration projects
SOA-compliance, with data services in the format
required by data users
Data quality improved through Rapid prototyping
Reduced cost of operational infrastructure

Packaged Apps
XML data

HTTP
files

Operational
Store

Historical Data

Technical Overview

26
26

What does the PowerCenter Data

Federation Option do?

Leaves enterprise data where it naturally lives

Establishes a virtual data layer that applications can treat
as a single data source

Executes on-demand queries to retrieve and integrate
data from a variety of systems
Operational systems
Data warehouse

Employs query optimization, caching, and prudent design

to ensure performance

27

How does it Work at Design-Time?

Step 1: Build the View

Data Federation Option View

(A View contains Metadata

on the actual data source
format, type, location,
access, etc.)

Data Source 1

28

Data Source 2

How does it Work at Run-Time?

Web Services

Portals

BI Tools

Step 3: Deliver Data

(Combined data creates
meaningful information)
Data Federation Option View

Step 1: Build the View

(A View contains Metadata
on the actual data source
format, type, location,
access, etc.)

Step 2: Aggregate Data

(Queries are optimized
for speed and efficiency)

Data Source 1

29

Data Source 2

Wrap-up

30
30

Wrap-up

Advanced performance design

Cost-based query optimization

Data path tuned for high-volume throughput
Extensive and flexible caching

Broad data source and delivery options

Sources: JDBC/ODBC, SOAP/WSDL, LDAP, HTML and flat files
Delivery options: JDBC, ODBC and SOAP

Acknowledged as easiest to install and use

Database-independent

Informatica Data Services
Model-driven (Data Objects) service development
Rich data access/transformation capabilities
SQL and web services access with a single engine from Informatica
31

Muito obrigado

32
32