Oracle 11g Database

New Features

Blaine Brothers

<Insert Picture Here>

Whats New in Oracle Database 11g

Blaine Brothers Sr. Technical Consultant Oracle Public Sector

The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions. The development, release, and timing of any features or functionality described for Oracles products remain at the sole discretion of Oracle.

Continuous Innovation
Audit Vault Oracle 8i Oracle 8 Oracle 7 Oracle 6 Oracle 5 Oracle 2
Database Vault
Grid Computing Automatic Storage Mgmt Self Managing Database

XML Database Oracle Data Guard Real Application Clusters Flashback Query Virtual Private Database
Built in Java VM Partitioning Support Built in Messaging Object Relational Support Multimedia Support

Oracle 10g Oracle 9i

Data Warehousing Optimizations Parallel Operations Distributed SQL & Transaction Support Cluster and MPP Support MultiMulti-version Read Consistency Client/Server Support Platform Portability Commercial SQL Implementation

Oracle Database 11g Highest Quality R&D

Over 1500 developers and testers spread across eight development labs around the world 479 Development Projects Over 235,000 functional tests run daily on a grid of over 2000 processors Triple the number of cross-functional tests run versus Oracle Database 10g Over 15,000,000 hours of testing Exhaustive battery of security tests

Oracle 11g - Real Innovations

SecureFiles Advanced Compression Online Upgrades and Patching OLAP-based Materialized Views Workload Capture and Replay Real Application Testing Total Recall Real Application Clusters Performance Management Physical Standby Real-Time Query

        

<Insert Picture Here>

Oracle Database Scalability and Performance

Oracle Partitioning
10 years of innovation
Core functionality Oracle8 Oracle8i Oracle9i Oracle9i R2 Oracle 10g Range partitions, global range index Hash and composite range-hash partitioning List partitioning Composite range-list partitioning Global hash indexes

Oracle 10g R2 1M partitions per table Reference Partitioning Virtual column partitioning Automatic interval partitioning New composite partitioning: range-range, list-range, list-list, list-hash

Benefits of Partitioning

ORDERS

ORDERS

ORDERS Europe USA

Jan Large Table

Difficult to Manage

Feb

Jan

Feb

Partition
Divide and Conquer Easier to Manage Improve Performance

Composite Partition
Higher Performance More flexibility to match business needs

New in Oracle Database 11g

Automated Partitioning: Interval

CW_CASES

CW_CASES

Jan

Feb

Jan

Feb

Mar

New in Oracle Database 11g

Automated Partitioning: Reference

Orders Inventory Orders Line Items Jan Orders

Feb Back Orders Pick Lists Orders

Mar

New in Oracle Database 11g

Business Driven Partitioning: New Composite

CW_CASES
>5000

CW_CASES
>5000

CW_CASES
Gold

10005000

10005000

Silver

Jan

Feb

USA

EUR

USA List-List

EUR

Range-Range
Date by order value

List-Range

Region by order value Region by type

Virtual Columns & Partitioning

Create table t1 ( c1 number, c2 number, c3 as (c1+c2) virtual) ANSI syntax Look just like regular columns from SQL perspective Support for indexes, constraints, statistics, histograms Used by expression evaluation when applicable 11g can partition on virtual columns

New in Oracle Database 11g

Partition Advisor

ORDERS

ORDERS

ORDERS Europe USA

Jan

Feb

Jan

Feb

Partitio i g Advisor
Packaged Apps Custom Apps

SQL Workload SQL Advisor SQL Access Structure A alysis A alysis

New!

SQL Pla u i g

Partition Analysis

Considers entire query workload to improve query performance Advises on partitioning methods
Range (equal-interval), range key and interval Hash, hash key

SQL Profile

SQL Advice

Indexes & MVs

Partition Advice

Well-t ed SQL Schema

Integrated, non-conflicting advice with Indexes, MVs

New in Oracle Database 11g

Advanced Compression

Compress Large Application Tables

Transaction processing, data warehousing

Compress All Data Types

Structured and unstructured data types

Typical Compression of 2-3 X

Cascade storage savings throughout data center

Compression for Mainstream

Oracle 9i compresses table data only during bulk load
Data warehousing, ILM

Table compression is now viable for all applications

Compress during random updates

Typical compression ratio of 2x to 3x Database directly reads compressed data bypassing decompression overhead Strategy - Compress 10 largest tables in a database
Reduce table data by half, increase CPU usage 5%

Savings cascades into test, dev, standby, mirrors, archiving, backup, etc.

Growing Data Volumes

100

80

Database Size (TB)

60

40

Size of the largest data warehouse in TopTen Programs

245% Increase just from 2003 to 2005

20

0 1998

1999

2000

2001

2002

2003

2004

2005

Source: 2005 TopTen Program, November 2005 Winter Corporation, Waltham, MA, USA

So how do we control storage costs?

Lets take example of 13.5 terabytes If 1gb storage = $72
$3,000,000 $2,500,000 $2,000,000 $1,500,000 $1,000,000 $500,000 $0

b 13 .5 t '1 1

.5 tb

1. 5t b

4. 5t b

'0 3

'0 5

'0 7

'0 9

40 .5 t

Traditional Storage Approach

All data resides on single storage tier
High Performance Storage Tier = $72 per Gb

Active Active

All data on active = $972,000

Information Lifecycle Management

Partition data onto appropriate storage tier
High Performance Storage Tier = $72 per Gb Low cost Storage Tier = $14 per Gb Read only Storage Tier = $7 per Gb

Active

Less Active

Historical

Information Lifecycle Management

Reduce storage costs accordingly
High Performance Storage Tier = $72 per Gb Low cost Storage Tier = $14 per Gb Read only Storage Tier = $7 per Gb

5% Active

35% Less Active

60% Historical

$49,800

$67,700

$58,000

Benefit of Partitioning
Significantly reduces storage costs Cost of Storage
$1,000,000 $800,000 $600,000 $400,000 $200,000 $0

IL M

Be fo re

ith

IL M

Advanced Compression
Reduces storage requirements across all tiers 5% Active 35% Less Active 60% Historical

$49,800

$67,700

$58,000

Lets use compression factor of 3

$16,600

$22,600

$19,400

Benefit of Data Compression

Compression further reduces storage costs Cost of torage
$1,000,000 $800,000 $600,000 $400,000 $200,000 $0

IL M

Be fo re

ith

IL M

Oracle Database 11g Storage Benefits

Managing data growth

$972,000

Single tier storage Application specific Offline archive Manual process High cost

Multi tier storage Application independent Online archive Automated process Low cost

$58,600

Server Results Cache

taking the buffer cache to the next level
Caches results of queries, query blocks, or pl/sql function calls
Cache is shared across statements and sessions on server Significant speed up for read-only / read-mostly data

join join join join T1 T1 T1 GBY GBY join join T2 T2 T3 T3 GBY GBY

Q2: Use itquery cache Q1: build transparently cache join T4 T5 join T6

Server Results Cache

Caches results of queries, query blocks, or pl/sql function calls Read consistency is enforced
DML/DDL against dependent database objects invalidates cache

Bind variables parameterize cached result with variable values

join join Table 4

query 1 result is executes cached

Group by result join Table 1 Table 2 join Table 3
cached

query 2 uses cached result transparently

Group by join

Table 5

Table 5

OCI Consistent Client Cache

like cache fusion between server and client

Application Server

Consistent Caching

Database

Caches query results on client Improves performance for read-mostly tables

Faster response time - eliminates network round trips Saves server CPU

Consistent with server

Cache proactively refreshed when result set changes Maximum age of consistency info can be set

OCI Client Result Cache

alter table DEPT cache results

Unified interface with Server result cache Per process cache shared across multiple sessions/threads Works with all 11g OCI-based clients
Including ODP.Net, JDBC Type 2, PHP, ODBC

DBA just sets size of client cache to activate Client side parameter to overwrite client cache size

Native PL/SQL and JAVA Compilation

100+% faster for pure PL/SQL or Java code

10% 30% faster for typical transactions with SQL

PL/SQL
Just one parameter - On / Off No need for C compiler No file system DLLs

Java
Just one parameter On / Off JIT on the fly compilation Transparent to user (asynchronous, in background) Code stored to avoid recompilations

Server Side Session Connection Pooling (Database Resident Connection Pool)

Allows multiple Oracle clients to share a server-side pool of sessions Clients can connect and disconnect at will without the cost of creating a new server session
Note that Shared Server removes the process creation cost But not the session creation cost Similar to Web Server connection pooling model Big speedup for PHP applications

Other networking features:

Network Fast Path for simple SQL performance High throughput support for Bulk Data Transfers IPv6 addressing support

Faster Performance
Database Resident Connection Pool
2000%

Java Just-In-Time Compiler

12 10

Query Result Caching

140 120 100 140% 120% 100%

Client Side Caching

1000%

6 4

60 500% 2 0% 0 br C onnect i ons Sp e e d 40 20 0 Quer i es

Up to 20 x connections RAC Performance Enhancements

1 160% 140% 120% 100%

Up to 11 x Faster Oracle Secure Backup

140 120 100 150

Up to 25% Faster Oracle Streams Enhancements

200

Optimizer Stats Collection

1000

0%

0 100

600 400
50

0%

60 40 20 0 Quer y I nt ensi ve B ackup 0 R epl i cat i on

60% 40% 20% 0%

200 0 Stats Collection

Up to 70% Faster

Up to 25% Faster

Up to 2 x Faster

1500%

0%

60% 40% 20% 0% I m p ro vem en t

Up to 22% Faster

00

Up to 10 x Faster

<Insert Picture Here>

Oracle Database Reliability and High Availability

Examples of Sustained Innovation Enterprise Grid Computing

SMP Dominance

RAC Clusters for Availability

Grids of low cost hardware and storage

11g Grid Directions

Simplicity - Make the grid as easy as a single system

Expert system for cross-cluster performance diagnostics Zero-configuration node management

Quality of service management

Seamlessly manage resources across middle-tier, database, and storage Policy-based performance and workload management

RAC Optimized Cache Fusion

Improved performance for read-intensive workloads

improves any read from disk (not cache) whether short random reads or large table scans

Throughput improved up to 70% for internal read-only benchmark

Other RAC Enhancements

Seamless integration with XA and Microsoft Transaction Server Fine tune performance, scaling, failover, management Faster and more robust handling of instance crashes and hangs
Most of this also in 10.2.0.3

Database

Storage

Runtime Connection Load Balancing works with OCI Session Pools

ASM Fast Mirror Resync

1

Fraction of time to establish redundancy Only changed blocks are resynced

Failure time < DISK_REPAIR_TIME

Benefits:
Fast recovery from transient failures Enables pro-active maintenance

Disk again accessible: Only need to resync modified extents

ASM Preferred Mirror Read

Allow local mirror read operations Eliminate network latencies in extended clusters
Site A Site B

Extended Cluster

P
ASM_PREFERRED_READ_ FAILURE_GROUPS=DATA .SITEA

S
ASM_PREFERRED_READ_ FAILURE_GROUPS=DATA .SITEB

SELECT preferred_read FROM v$asm_disk; SELECT * FROM v$asm_disk_iostat;

ASM Rolling Upgrades and Patches

Maximizes database availability in a cluster How it works:

Place cluster in Rolling Migration mode Bring down ASM on a cluster node Upgrade or patch software Re-start ASM Stop Rolling Migration mode after upgrading all nodes

Self Managing Database

Auto-Tuning Tuning

Advisory Instrumentation

Self Managing Database

Auto-Tuning Tuning

Advisory Instrumentation

Automatic Memory Tuning

Automatically adapts to workload changes Unifies shared (SGA) and process (PGA) memory management Single dynamic parameter for all database memory Maximizes memory utilization Helps eliminate out- of-memory errors Gets and releases memory from OS: Linux, Windows and Solaris, HPUX, AIX Built in safety-nets to work under runaway workloads
Pace needy components Not shrink below minimum

O/S Memory O/S Memory SGA

SGA

PGA PGA

ADDM for RAC

Database-Level ADDM Performance expert in a box
Now RAC specialist too! Self-Diagnostic Engine

Identifies the most Globally Significant performance issues for the entire RAC database Database-wide and instance-level analysis Database-wide analysis of:
Global cache interconnect issues Lock manager congestion issues Global resource contention, e.g. IO bandwidth, hot blocks Globally high-load SQL Skew in instance response times

Instance-Level ADDMs

Node 1

Node 2

Node 3

Allows drill down to instances Runs proactively every hour (default) Directives to filter results

Management Scalability

Manage Highly Complex Integrated Applications ADDM for RAC Partitioning Advisor Fully Automatic SQL tuning Streams Performance Advisor Capture/Replay of high load SQL Capture/Replay for Database Workloads

Oracle Data Guard Unlocking the Value of Standby DBs

Standby for DR and Backup

Logical Standby for Realtime Query

Standby for Online Upgrade, Auto Failover

Standby for Testing, Readable Physical

Physical Standby with Real-Time Query

Real-time Queries Concurrent

Continuous Redo Shipment and Apply

Primary Database

Real-Time Query

Physical Standby Database

Read-only queries on physical standby concurrent with redo apply

Supports RAC on primary / standby Queries see transactionally consistent results Immediate appeal to the many users of physical standby DR with real time query is unique in the industry no idle resources Handles all data types, but not as flexible as logical standby

Oracle Data Guard 11g

Offload production reporting to standby
Real-time Queries

Production Database

Standby Database

Simultaneously available in read and recovery mode

Oracle Data Guard 11g

Offload database backups to standby
Real-time Queries

Production Database

Standby Database

Complete database and fast incremental backups

Oracle Data Guard 11g

Test Application against upgrades and patches
Real-time Queries

Production Database

Standby Database

Switch to snapshot standby for testing purposes

Oracle Data Guard 11g

Rolling upgrades
Real-time Queries

Production Database

Standby Database

Test on standby and roll to production

Oracle Data Guard 11g

Switchover to new standby system
Real-time Queries

Standby Database

Production Database

Changed standby becomes production

SQL Apply and Streams Improvements

Support XMLType data type (CLOB) Support Transparent Data Encryption (TDE) Apply performance improved up to 50% SQL Apply additional PL/SQL Package support
Support Fine Grained Auditing Support DBMS_RLS (Virtual Private Database)

Why Oracle Data Guard?

Invest in Disaster and Performance Protection

Disaster protection only Recovery mode only Rarely used Manual intensive Low ROI

Disaster & performance protection Simultaneous read & recovery Use in production & testing Automated High ROI

Flashback for Rapid Recovery from Human Error

Flashback Query

Flashback Tables

Flashback Database

Flashback Data Archive

Flashback Data Archive

Total Recall
Select * from purchase_orders AS OF Midnight 31-Dec-2004

Long term retention - years Automatically stores all changes to selected tables in Flashback Data Archive
Archive cannot be modified Old data purged per retention policy

PO

Archive Tables

View table contents as of any time using Flashback SQL Uses

Change Tracking Long term history Compliance Auditing ILM

User Tablespaces

Flashback Data Archive

Oracle Database

Oracle Recovery Manager

Protect Against Data Loss
New in Oracle Database 11g Data Recovery Advisor

Automatic Storage Management

Protect Against Disk Loss
New in Oracle Database 11g Fast Mirror Resync Preferred Mirror Read

Real Application Clusters

Protect Against Server Loss
New in Oracle Database 11g XA Transactions spanning multiple servers Improved runtime connection load balancing

Flashback
Protect Against Human Error
New in Oracle Database 11g Total Recall Flashback Transaction

Oracle Data Guard

Protect Against Site Failure
New in Oracle Database 11g Snapshot Standby Readable Physical

<Insert Picture Here>

Oracle Database Information Management and Data Security

Complete Information Management

Secure Enterprise Search
Enterprise Wide Search

Content DB and Records DB

Content Management in the Database

XML
Integrated Native XML Database

Text
Text Indexing and Classification

Location & Spatial

Location Enabled Databases

Multimedia
Audio, Image and Video

Relational
Characters, Numbers, Dates, LOBs

Complete Information Management

Secure Enterprise Search
Complete Set of Connectors

Content DB and Records DB

Universal Content & Records Management

XML
Binary XML Support

Text
RDF and OWL Support

Location & Spatial

3D Support

Multimedia
Medical Image Support

Relational
New SecureFiles LOB Storage

New in Oracle Database 11g

Critical New Data Types

RFID Data Types

DICOM Medical Images

3D Spatial Images

Oracle SecureFiles
Consolidated Secure Management of Data

SecureFiles is a new database feature designed to break the performance barrier keeping file data out of databases Similar to LOBs but much faster, and with more capabilities
Transparent encryption, compression, deduplication, etc. Preserves the security, reliability, and scalability of database Superset of LOB interfaces allows easy migration from LOBs

Enables consolidation of file data with associated relational data

Single security model Single view of data Single management of data File system access still available

Database and File System Interfaces

SecureFiles can be accessed by both database clients and file system clients Database clients use extended LOB interfaces
JDBC, ODBC, OCI, .NET, PL/SQL 11g has a highly optimized streaming protocol for SecureFiles

File system clients use the file system protocols implemented in the XML DB repository
FTP access WebDav Access Mountable NFS V4 file system (preview only)

SecureFiles in the Database Breaking the Performance Barrier

File Read Performance (MB/second)

120 100 80 60 40 20 0 0.1

Innovative technology for high performance large object data

Smart buffering, write gathering, intelligent locking Fast bulk data transfers, LOB prefetch

SecureFiles Linux Files

LOBs

10

100

Much faster than LOBs with more capabilities File system-like performance with database functionality!

File Size (MB)

Integrated BI in the Database - OLAP

SQL Star Queries

Cubes but no SQL access

SQL Views over Cubes

Transparent SQL Rewrite to Cubes

Materialized Views
Typical Architecture Today

SQL Query Region Date

Materialized Views
Sales by Region Sales by Date

Query Rewrite

Sales by Product

Sales by Channel

Product Relational Star Schema

Channel

New in Oracle Database 11g

Cube Organized Materialized Views

SQL Query Region Date

Materialized Views

Query Rewrite

Product

Channel Automatic Refresh OLAP Cube

Database Security and Compliance

Configuration Mgmt Pack

Advanced Security

Label Security

Database Vault

Audit Vault

Secure Backup

Secure Deployments

Encrypted Data

Data MultiMulti-factor Classification DBA Controls

Monitor, Alert, Encrypted Consolidate Data on Tape

Security and Compliance

Deploy Certified Configurations

Oracle Configuration Management Pack

Security and Compliance

Strongly Authenticate and Authorize End Users

New in Oracle Database 11g

Advanced Security

Kerberos authentication Strong passwords

Security and Compliance

Encrypt Data in Database
New in Oracle Database 11g Tablespace level encryption Hardware based master key protection

Transparent Data Encryption

Security and Compliance

Add Multi-factor DBA Controls

Database Vault

Security and Compliance

Consolidate and Monitor Audit Information

Audit Vault

Security and Compliance

Encrypt Backups
New in Oracle Database 11g Backup compression

Oracle Secure Backup

So What is the perennial customer challenge ?

Change

Lifecycle of Change Management

New Change Assurance Capabilities
Detect and Tune Performance Changes Capture and Replay Workload Provision - Upgrade or Clone Configure and Maintain Production System

Set Up Test Environments

Package Incidents for Support Online Hot Patching

Set up Test Environments using Snapshot Standbys

Physical Standby
Apply Logs Open Database Back out Changes Convert Physical Standby to Snapshot Standby and open for writes and application testing
ALTER DATABASE CONVERT TO SNAPSHOT STANDBY;

Snapshot Standby
Perform Testing

Can Replay Workload against the Snapshot Standby Discard testing writes and catch-up to primary by applying logs
ALTER DATABASE CONVERT TO PHYSICAL STANDBY;

Accumulates logs at the Standby site

Preserves zero data loss

Database Replay
Realistic Testing
Recreate actual production database workload Capture production workload incl concurrency Replay workload in test with production timing Analyze & fix issues before production
Middle Tier

Production Environment Capture DB Workload

Standby/Test Environment

Oracle DB servers

Replay DB Workload

Storage

SQL Performance Analyzer

Realistic Testing
Test impact of change on SQL performance Capture SQL including statistics & bind vars Re-execute SQL in test environment Use SQL Tuning Advisor to seed SQL plans

Production Environment Capture SQL

Standby/Test Environment

Oracle DB servers

Execute SQL Queries

Storage

Support for Online Hot Patching

Oracle already supports rolling patches between nodes in a cluster 11g adds online patching of a running Oracle executable (single instance or cluster) with no downtime
Integrated with OPatch Many one-off patches can be hot patched Great for diagnostic patches

Make Change Safe Realistic Testing with Database Replay

Recreate actual production database workload in test environment No test development required Replay workload in test with production timing Analyze & fix issues before production

Client

Client

Client

Production

Test
Replay DB Workload

Middle Tier

Capture DB Workload Oracle DB

Test migration to RAC

Storage

Make Change Safe

Find Regressed SQL with SQL Performance Analyzer

Oracle Real Application Testing

Innovate Change Faster
Artificial workloads Partial workflows Months of development Manual intensive High risk Production workloads Complete workflows Days of development Automated Low risk

149 Days 149 Days

11 Days

Other Oracle Database 11g Highlights

Performance and Scalability Security
Query Result Cache Tablespace and LOB Encryption TimesTen Cache Secure Configuration Enhancements Business Intelligence RAC Scalability Enhancements BI Publisher Reporting High Availability Supermodels for Data Mining Data Recovery Advisor Unstructured Data Management Readable Physical Standby Enhanced XML indexing

VLDB/ILM

Interval and Referential Partitioning Enhanced Compression

Storage & Query of Semantic Content

Developer Productivity
APEX 3.0 including support for Flash Charting and PDF output Improved PHP Scalability .NET Improvements Simple compilation of PLSQL and Java Stored Procedures

Manageability and Diagnosability

Support Workbench SQL Performance Analyzer SQL Test Case Builder

QUESTIONS ANSWERS

<Insert Picture Here>

Whats New in Oracle Database 11g

Blaine Brothers Sr. Technical Consultant Oracle Public Sector