Goldengate NewGG Features

1
Copyright 2012, Oracle and/or its affiliates. All rights reserved.
Oracle GoldenGate 11g

Release 2 New Features
Irem Radzik, Director of Product Marketing
Nick Wagner, Distinguished Product Manager
The following is intended to outline our general product direction. It is intended

for information purposes only, and may not be incorporated into any contract.
It is not a commitment to deliver any material, code, or functionality, and should
not be relied upon in making purchasing decisions. The development, release,
and timing of any features or functionality described for Oracle s products
remains at the sole discretion of Oracle.
Program Agenda
Introduction to Oracle GoldenGate
New Features in Oracle GoldenGate 11gR2
Summary & Learn More
Q&A
Introduction to Oracle
GoldenGate
Enterprise Replication with Oracle GoldenGate

Leader in real-time data integration solutions
Over 2100 customers as of 2012 including Fortune 500
companies, representing Financial Services,
Communications, Healthcare, Public Sector, Retail, Utilities
industries
4 of top 5 largest commercial banks
3 of top 3 busiest ATM networks
5 of top 5 financial data services companies
5 of top 5 telecommunications providers
3 of top 5 largest food & drug stores
Oracle GoldenGate
Low-Impact, Real-Time Data Integration & Transactional Replication
New DB/
HW/OS/APP
Legacy Systems
Log-based
Changed Data
Oracle & Non-Oracle
Database(s)
Message Bus
Fully Active
Distributed
DB
High Availability/ Disaster

Recovery
Reporting
Database
Query & Report Offloading
Data
Warehouse
ODS
Data Integrator
Zero Downtime Upgrade

& Migration
Real-time BI, Operational

Reporting, MDM
Global
Data
Centers
Data Synchronization within

the Enterprise
Message
Bus
Event Driven Architecture,

SOA
Oracle GoldenGate Modular Architecture
LAN / WAN / Internet

Over TCP/IP
Source
Oracle & Non-Oracle
Database(s)
Bi-directional
High performance, even in high-volume systems

Low impact on the infrastructure
Non-intrusive
Flexible, supports heterogeneous systems
Reliable, resilient against interruptions, outages
8
Target
Oracle & Non-Oracle
Database(s)
Overview of New Features
Integrated Capture
Enhanced Conflict Detection & Resolution
Support for Global Deployments
Security and Performance
Extensibility
Manageability and Monitoring
Expanded Heterogeneity
Integrated Capture
Overview
Integrated Capture for Oracle Database
Moves GoldenGates capture capabilities closer

to the Oracle Database engine.
Enables 100% support for capture and delivery
of compressed objects within Oracle Database
and Oracle Exadata
10
Oracle
GoldenGate
11gR2
Integrated Capture
Overview
Brings GoldenGate Capture (Extract) closer to the RDBMS engine
Leverages Proprietary Oracle Database Mining API
Parallelism in mining and transforming redo records into LCRs
Improved RAC coordination and automated node handling
Tighter integration and faster development of new Oracle features
Multi Threaded
Uses producer thread to capture REDO record and consumer thread to process the
REDO records.
Performance gain from parallel processing
11
Integrated Capture
Overview
On Source
Supports multiple deployment configuration

Source : Source database and Integrated Capture
process are in the same machine

Downstream
Downstream : Source database and Integrated
Capture process are in the different machine
Easy transition for existing GoldenGate
customers
Customers may choose which option they prefer
based on their requirements.

12
Architecture: Real-Time Mode

Source database and Integrated Capture process are in the same machine
User/Application changes
Record
changes
Capture
changes
Redo Logs
Oracle Database
Source Machine
13
LCR1
LCR2
LCR3
.
.
.
Logical Change
Records
Capture
Integrated
Extract
Trail
File
..
Architecture: Real-Time Downstream Mode

Source database and Integrated Capture process are in different machine
Record
changes
Continuous REDO
Shipping
Redo Logs
Oracle Database
Source Machine
14
Capture
changes
LCR1
LCR2
LCR3
.
.
.
Ca
Standby
ptur
Logical Change
Redo Logs
Records
eOracle Database
Downstream Machine
Capture
Integrated
Extract
Trail
File
..
Architecture: Downstream Archive Log mode

Source database and Integrated Capture process are in different machine
Record
changes
Capture
changes
Ca
ptur
Logical Change
Records
eOracle Database
Archive Logs
Redo Logs
Oracle Database
Source Machine
15
LCR1
LCR2
LCR3
.
.
.
Downstream Machine
Capture
Integrated
Extract
Trail
File
..
Integrated Capture - What You Need To Know

Category
16
Description
Exadata
Capture support for EHCC compression
Compression
Capture support for OLTP, Segment compression
Distributed
Transactions
XA-RAC, PDML
RAC
Dynamic Node Awareness
New Datatypes
XML OR, XML Binary
LOB
Full and Partial read from REDO log
Deployment
Online and Downstream capture support
DDL
Captures tables created with column level password

specification
Oracle Database Versions Supported in GG 11gR2

Database Version
Capture
(aka Classic
Capture)
Integrated
Capture
17
Supported Features
10.2
Supported
11.1.0.7
TDE/TSE, Fetch support for SecureFiles
11.2.0.2
11.2.0.3
10.2 *
Supported
11.1.0.7 *
Supports TDE/TSE
11.2.0.2 *
Supports TDE/TSE,XA RAC, Compression

Fetch support for Securefiles, ADTs, VARRAYS, Nested
Tables, Object Tables
11.2.0.3
Supports TDE/TSE, XA RAC, Compression, XML OR, XML

Binary
Fetch support for Securefiles, ADTs, VARRAYS, Nested
Tables, Object Tables
Classic Capture
When to Consider Classic Capture
If you dont need XML types, XA on RAC, compressions etc.
Future Direction
Classic Capture will be around for long time
Core specific features, bug fixes and patches will be available on both Captures
Oracle specific features will be only available in integrated extract.
Adding Oracle specific feature exclusively to classic extract will not be possible.
18
Enhanced Conflict Detection & Resolution (CD&R)

Overview
Automated detection and resolution of data

conflicts for active-active or multi-master
deployments.
Robust, easier to code, and less time to
implement.
19
Oracle
GoldenGate
11gR2

Overview
Replaces expensive hand-coding of CD&R rules with easy and
expandable rules.
Options to use pre-built methods to resolve conflicts
- Overwrite, Ignore, Discard, Usemax and Usemin
Supported datatypes
- NUMERIC, DATE, TIMESTAMP, CHAR/NCHAR, VARCHAR/ NVARCHAR
Supports heterogeneous deployments
20
CDR Parameters (Capture/Extract)

GETBEFORECOLS
Used in TABLE statement on the extract side.
Specified columns before image will be included in the trail file for updates and/or
deletes.
Forces NOCOMPRESSUPDATES and NOCOMPRESSDELETES
Syntax
GETBEFORECOLS(
ON UPDATE
ON DELETE
ALL | KEY | KEYINCLUDING <col>[,]) | ALLEXCLUDING (<col> [,]) )

Example:
GETBEFORECOLS(
ON UPDATE KEYINCLUDING (name, address, balance),
ON DELETE KEYINCLUDING (name, address, balance));
21
CDR Parameters (Delivery/Replicat)

COMPARECOLS
Used in MAP statement on the Delivery/Replicat side
Specified columns will be compared for update operation or delete operation.
Usually application specific critical columns to be specified in this list, to check if the
conflict exist.
Before image of the columns must be present in the trail record for updates and
deletes, else error will be thrown, replicat will abend. (i.e. GETBEFORECOLS)
Syntax
COMPARECOLS(
ON UPDATE
ON DELETE

Example:
COMPARECOLS(
ON UPDATE KEYINCLUDING (name, address, balance),
ON DELETE KEYINCLUDING (name, address, balance));
22
CDR Parameters (Delivery/Replicat)

RESOLVECONFLICT
Used in MAP statement on the replicat side.
Contains syntax for various conflict scenarios
Root level support is not available
Syntax
RESOLVECONFLICT ( CONFLICTTYPE,
(resolution_method_name, resolutiontype (cols), COLS (resolution column list))
(resolution_method_name, resolutiontype (cols), COLS (resolution column list))
.)
23
Conflict Detection and Resolution: Example

(think RESOLVECONFLICT ( [conflict type], ([column groups],
[resolution])
MAP source.Order, TARGET target.Order,
COMPARECOLS (ON UPDATE KEYINCLUDING (Modified_TS),
ON DELETE KEYINCLUDING (Modified_TS)),
RESOLVECONFLICT (INSERTROWEXIST, (DEFAULT, USEMAX (Modified_TS)),
RESOLVECONFLICT (UPDATEROWMISSING, (DEFAULT, IGNORE)),
RESOLVECONFLICT (UPDATEROWEXISTS, (DEFAULT, USEMAX (Modified_TS)) ,
RESOLVECONFLICT (DELETEROWMISSING, (DEFAULT, IGNORE)),
RESOLVECONFLICT (DELETEROWEXISTS, (DEFAULT, DISCARD)) ;
24

Overview
Global Deployment Support
Allows Oracle GoldenGate to support

databases using multi-byte/Unicode object
and column names.
25
Oracle
GoldenGate
11gR2

Overview
GoldenGate deployment in a non-English environment
Supports European Accent characters, Multi-byte characters
Automatic conversions of transactional data across different character
set environments
Native error messages, supports case sensitivity
Database object name support
Non US-ASCII Character Support (both DDL/DML)
Database Like Object Level Case Sensitivity Support
26
Security
Overview
Security
The Most Secure Version of GoldenGate

Oracle GoldenGate 11gR2 supports Federal
Information Protection Standard (FIPS) and
BLOWFISH encryption algorithms to provide
secure data movement across systems and
regions
27
Oracle
GoldenGate
11gR2
Security
Overview
Support FIPS compliant encryption algorithm in addition to current
BLOWFISH algorithm
On disk encryption for trail file
In password encryption
When transferring data across the network
NOTE: Only supported on Linux, Windows, and Unix.
IPv6 support
Mandate from the government
The existing GoldenGate library of IPC routines is based on IPv4. All existing
GoldenGate calls using IPv4 AP were changed to use IPv6 APIs.
28
Encryption in GoldenGate 11g Release2

GGSCI
Manager
Interactive
Interface
Manager
Interactive
Interface
LAN / WAN / INTERNET

Over TCP/IP
Source
Database
Parameter Files
TCP/IP
Target
Database
PASSWO
RDS
PASSWO
RDS
29
GGSCI
Parameter Files
BLOWFISH, AES128, AES192,AES256
Performance
Overview
Performance Improvements
Performance improvements for data replication

across geographically separated systems in
high-latency networks
30
Oracle
GoldenGate
11gR2
Performance
Overview of Data Pump Improvements
Prior to Oracle GoldenGate 11gR2
Synchronous data communication between
Data Pump and remote collector process
Oracle GoldenGate 11gR2

Acknowledgement message can be skipped for
every data sent
Remote collector does not send an
acknowledgement to the Data Pump unless a
packet contains a flag requesting a response.
31
Extensibility
Overview
Extensibility
Using Event Markers allows GoldenGate

implementations to be extended to kick-off
actions based on an incident (DML,DDL, data
value)
32
Oracle
GoldenGate
11gR2
Extensibility
Overview
Event Marker Systems
Enables the Oracle GoldenGate processes to take a defined action based
on an event record in the transaction log or in the Trail
Supported Event Actions
TRACE, LOG, CHECKPOINT BEFORE, IGNORE, DISCARD, SHELL,
ROLLOVER, REPORT ABORT, CHECKPOINT AFTER, FORCESTOP,
STOP
Robust option for customers requiring non-standard processing

based on specialized events.
33
Event Marker System
ACTIONS
TRACE
LOG
CHECKPOINTBEFORE
IGNORE
DISCARD
ROLLOVER
REPORT
ABORT
CHECKPOINTAFTER
FORCESTOP/STOP
Event
record
Event
record
SHELL with
parameters
Event
record
SUSPEND
DDL
Source
Database
34
Transaction Logs
LAN / WAN / INTERNET

Over TCP/IP
Target
Database
Extensibility
Overview
Event Action
SUSPEND and RESUME
Description
When a data record met qualification criteria (using FILTER) for
processing, a suspension of the process allows a 'stoppage' in the
processing without losing active context.
To terminate the SUSPEND state of a process, a RESUME command
needs to be sent via GGSCI
DDL Events
SHELL with Parameters
35
Triggers DDL event record, if the DDL is either eligible to be written to trail
file by extract process, pump process or be executed by replicat process.
SHELL event actions takes arguments. Each argument will be evaluated
and expanded into a COLUMN value, a literal string, or any of the OGG
internal functions at run time. The final command being sent to SYSTEM
call will be the fully expanded version of each parameter
Manageability & Monitoring

Overview
Monitoring
The new Oracle GoldenGate Monitor product

provides complete view of the GoldenGate
implementations.
Integration with Oracle Enterprise Manager
36
Oracle
GoldenGate
11gR2
Management Pack for Oracle GoldenGate

Monitoring
Oracle GoldenGate Monitor
37
Advanced monitoring, alerting

(SNMP support), lag graphs, and
historical repository.
Based on new agent

infrastructure, which will be the
foundation for all future
integration projects. Supports
GoldenGate 11.1.1.1.1+
Management Pack for Oracle GoldenGate

Monitoring
Enterprise Manager Plug-in
Oracle Preferred monitoring tool,
covers entire Oracle stack

Database, Storage, FMW etc
For customers, who prefers to drill
into DB sessions, OS stats, etc, apart

from monitoring GoldenGate process
Included in Management Pack
38
Overview
Expanded data type support for existing

supported platforms
Added native log based capture from IBM DB2
on iSeries and Delivery to PostgreSQL

39
Oracle
GoldenGate
11gR2
Overview
Platform
Description
IBM i-series (AS/400)
Capture support
PostgreSQL
Delivery support
Teradata
Multibyte DDL
SQL Server
CLR datatypes, Geometry, Geospatial datatypes
Sybase
Computed Columns
New datatypes - BIGINT, Unsigned Integer, Optimized
LOB management
40
MySQL
MySQL 5.5, New Data type UINT64
IBM z/OS
Performance improvement during Initial load
DB2 iSeries Capture

Supported Datatypes
Numeric (BIGINT, DECIMAL, DOUBLE, FLOAT, INTEGER, NUMERIC,
REAL, SMALLINT)
String, Binary (CHAR, BINARY, VARCHAR, VARBINARY)
Large Objects (BLOB, CLOB, DBCLOB, GRAPHIC, VARGRAPHIC)
Times and Dates (DATE,TIME, TIMESTAMP)
Un supported Datatypes
DATALINK, UDT, DECFLOAT and XML
41
Summary: Oracle GoldenGate 11gR2

Largest Number of New Features Ever Released
Integrated Capture
Security & Performance
Extensibility
Manageability & Monitoring
42
Oracle
GoldenGate
11gR2
Key Oracle GoldenGate Sessions at OOW

Tuesday October 2nd
Real World Operational Reporting Customer Panel
11:45am Moscone West 3005
High-Volume OLTP with Oracle GoldenGate: Best Practices from Comcast
1:15pm Mascone West3022
Everything You Need to Know about Oracle GoldenGate Monitor
5pm Moscone West 3005
Wednesday October 3rd

Best Practices for High Availability with GoldenGate on Oracle Exadata
11:45am Moscone South 102
Oracle GoldenGate Case Study: Real-Time Operational Reporting

Deployment
1:15pm Mascone West 2003
Oracle GoldenGate Best Practices for Conflict Detection and Resolution
5pm Moscone South 102
Tuning and Troubleshooting Oracle GoldenGate on Oracle Database
43
3:30pm Moscone West 3005
Oracle GoldenGate Hands-On-Labs

Wednesday October 3rd
Introduction to Oracle GoldenGate Veridata
10:15am Marriott Marquis - Salon 1/2
Thursday October 4th
44
Deep Dive into Oracle GoldenGate
11:15am Marriott Marquis - Salon 1/2
Join the Data Integration Community

Twitter
twitter.com/ORCLGoldenGate
LinkedIn
Oracle Data Integration
Facebook
facebook.com/OracleDataIntegration
Oracles Data Integration blog

blogs.oracle.com/dataintegration
Oracles Data GoldenGate YouTube channel

youtube.com/oraclegoldengate
Oracle.com/goto/dataintegration
45
46
47

Goldengate NewGG Features

Încărcat de

Informații document

Drepturi de autor

Formate disponibile

Partajați acest document

Partajați sau inserați document

Opțiuni de partajare

Vi se pare util acest document?

Este necorespunzător acest conținut?

Drepturi de autor:

Formate disponibile

Goldengate NewGG Features

Încărcat de

Drepturi de autor:

Formate disponibile

1

Copyright 2012, Oracle and/or its affiliates. All rights reserved.

Oracle GoldenGate 11g

Copyright 2012, Oracle and/or its affiliates. All rights reserved.

The following is intended to outline our general product direction. It is intended

Copyright 2012, Oracle and/or its affiliates. All rights reserved.

Copyright 2012, Oracle and/or its affiliates. All rights reserved.

Copyright 2012, Oracle and/or its affiliates. All rights reserved.

Enterprise Replication with Oracle GoldenGate

Copyright 2012, Oracle and/or its affiliates. All rights reserved.

Copyright 2012, Oracle and/or its affiliates. All rights reserved.

High Availability/ Disaster

Query & Report Offloading

Zero Downtime Upgrade

Real-time BI, Operational

Data Synchronization within

Event Driven Architecture,

Oracle GoldenGate Modular Architecture

LAN / WAN / Internet

High performance, even in high-volume systems

Copyright 2012, Oracle and/or its affiliates. All rights reserved.

Overview of New Features

Copyright 2012, Oracle and/or its affiliates. All rights reserved.

Moves GoldenGates capture capabilities closer

Copyright 2012, Oracle and/or its affiliates. All rights reserved.

Copyright 2012, Oracle and/or its affiliates. All rights reserved.

Supports multiple deployment configuration

process are in the same machine

Downstream : Source database and Integrated

Capture process are in the different machine

Easy transition for existing GoldenGate

based on their requirements.

Copyright 2012, Oracle and/or its affiliates. All rights reserved.

Architecture: Real-Time Mode

Copyright 2012, Oracle and/or its affiliates. All rights reserved.

Architecture: Real-Time Downstream Mode

Copyright 2012, Oracle and/or its affiliates. All rights reserved.

Architecture: Downstream Archive Log mode

Copyright 2012, Oracle and/or its affiliates. All rights reserved.

Integrated Capture - What You Need To Know

Capture support for EHCC compression

Capture support for OLTP, Segment compression

Dynamic Node Awareness

XML OR, XML Binary

Full and Partial read from REDO log

Online and Downstream capture support

Captures tables created with column level password

Copyright 2012, Oracle and/or its affiliates. All rights reserved.

Oracle Database Versions Supported in GG 11gR2

Copyright 2012, Oracle and/or its affiliates. All rights reserved.

TDE/TSE, Fetch support for SecureFiles

TDE/TSE, Fetch support for SecureFiles

TDE/TSE, Fetch support for SecureFiles

Supports TDE/TSE,XA RAC, Compression

Supports TDE/TSE, XA RAC, Compression, XML OR, XML

Copyright 2012, Oracle and/or its affiliates. All rights reserved.

Enhanced Conflict Detection & Resolution (CD&R)

Automated detection and resolution of data

Copyright 2012, Oracle and/or its affiliates. All rights reserved.

Enhanced Conflict Detection & Resolution

Supports heterogeneous deployments

Copyright 2012, Oracle and/or its affiliates. All rights reserved.

CDR Parameters (Capture/Extract)

ALL | KEY | KEYINCLUDING <col>[,]) | ALLEXCLUDING (<col> [,]) )