Best Practices For Exadata and Optimizer

Best Practices for Oracle Exadata and the
Oracle Optimizer
Maria Colgan, Product Manager, Oracle Optimizer
Levi Norman, Product Marketing Director, Oracle Exadata
1
Copyright 2011, Oracle and/or its affiliates. All rights

reserved.
Oracle Exadata Database Machine

Extreme performance. Lowest cost.

reserved.
Fastest Data Warehouse & OLTP

Best Cost/Performance Data Warehouse & OLTP
Optimized Hardware
Software Breakthroughs
Scales from Rack to 8 Full Racks
Oracle Exadata Innovation

Storage Server Software
10X
Up to
50X
+
Hybrid Columnar Compression

reserved.
Smart Flash
Cache
Smart Scan Queries
Standardized and Simple to Deploy

Delivered Ready-to-Run
Oracle Exadata Database Machines Are The Same
Thoroughly Tested & Highly Supportable
Identical Configuration Used by Oracle Engineering
Run Existing OLTP and DW Applications

30 Years of Oracle DB Capabilities
No Exadata Certification Required
Leverage Oracle Ecosystem

Skills, Knowledge Base, People, & Partners

reserved.
Oracle Exadata in the Market

Rapid Adoption Across Geographies and Industries

reserved.
Agenda
How to gather statistics

Additional types of statistics
When to gather statistics
Statistics gathering performance

reserved.
How to Gather Statistics

Use DBMS_STATS Package
Analyze command is deprecated
Only good for row chaining
The GATHER_*_STATS procedures take 13 parameters

Ideally you should only set the first 2-3 parameters
SCHEMA NAME
TABLE NAME
PARTITION NAME

reserved.

Use DBMS_STATS Package
Your gather statistics commands should be this simple

reserved.

Changing Default Parameter Values for Gathering Statistics
Can change the default value at the global level
DBMS_STATS.SET_GLOBAL_PREF
This changes the value for all existing objects and any new objects
Can change the default value at the table level

DBMS_STATS.SET_TABLE_PREF

reserved.

Changing Default Parameter Values for Gathering Statistics
The following parameter defaults can be changed:
CASCADE
NO_INVALIDATE
CONCURRENT
GRANULARITY
DEGREE
PUBLISH
ESTIMATE_PERCENT
INCREMENTAL
METHOD_OPT
STALE_PERCENT
AUTOSTATS_TARGET
(SET_GLOBAL_PREFS only)
10

reserved.

Sample Size
# 1 most commonly asked question
What sample size should I use?
Controlled by ESTIMATE_PRECENT parameter

From 11g onwards use default value AUTO_SAMPLE_SIZE
New hash based algorithm
Speed of a 10% sample
Accuracy of 100% sample
11

reserved.

Sample Size
Speed of a 10% sample
Run Num
AUTO_SAMPLE_SIZE
10% SAMPLE
100% SAMPLE
00:02:21.86
00:02:31.56
00:08:24.10
00:02:38.11
00:02:49.49
00:07:38.25
00:02:39.31
00:02:38.55
00:07:37.83
Accuracy of 100% sample
12
Column
Name
NDV with
AUTO_SAMPLE_SIZE
NDV with
10%
SAMPLE
NDV with 100%

SAMPLE
C1
59852
31464
60351
C2
1270912
608544
1289760
C3
768384
359424
777942

reserved.
Agenda
13


reserved.
Additional Types of Statistics

When Table and Column Statistics are not enough
Two types of Extended Statistics
Column groups statistics
Column group statistics useful when multiple column from the same
table are used in where clause predicates
Expression statistics
Expression statistics useful when a column is used as part of a
complex expression in where clause predicate
Can be manually or automatically created

Automatically maintained when statistics are gathered
14

reserved.
Extended Statistics
Column Group Statistics
SELECT * FROM vehicles
WHERE model = 530xi
AND
color = 'RED;
MAKE
MODEL
COLOR
BMW
530xi
RED
Cardinality= #ROWS * 1
* 1
=> 12 * 1 * 1 = 1
NDV c1 NDV c2
4 3
15

reserved.
Vehicles Table
Make
Model
Color
BMW
BMW
BMW
PORSCHE
MERC
MERC
RED
BLACK
SILVER
RED
RED
SLIVER
530xi
530xi
530xi
911
SLK
C320
Extended Statistics
SELECT * FROM vehicles WHERE model = 530xi
make = BMW;
AND
MAKE
MODEL
COLOR
BMW
530xi
RED
BMW
530xi
BLACK
BMW
530xi
SLIVER
Cardinality= #ROWS * 1
* 1
=> 12 * 1 * 1 = 1
NDV c1 NDV c2
4 3
16

reserved.
Vehicles Table
Make
Model
Color
BMW
BMW
BMW
PORSCHE
MERC
MERC
RED
BLACK
SILVER
RED
RED
SLIVER
530xi
530xi
530xi
911
SLK
C320
Extended Statistics
Create extended statistics on the Model & Make columns using
DBMS_STATS.CREATE_EXTENDED_STATS
New Column
with system
generated
name
17

reserved.
Extended Statistics
SELECT * FROM vehicles WHERE model = 530xi
make = BMW;
AND
MAKE
MODEL
COLOR
BMW
530xi
RED
BMW
530xi
BLACK
BMW
530xi
SLIVER
Cardinality calculated using column group statistics
18

reserved.
Vehicles Table
Make
Model
Color
BMW
BMW
BMW
PORSCHE
MERC
MERC
RED
BLACK
SILVER
RED
RED
SLIVER
530xi
530xi
530xi
911
SLK
C320
Extended Statistics
Expression Statistics
SELECT *
FROM Customers
WHERE UPPER(CUST_LAST_NAME) = SMITH;
Optimizer doesnt know how function affects values in the column

Optimizer guesses the cardinality to be 1% of rows
SELECT count(*) FROM customers;
COUNT(*)
55500
19

reserved.
Cardinality estimate
is 1% of the rows
Extended Statistics
Expression Statistics
New Column with

system generated
name
20

reserved.
Extended Statistics
Automatic Column Group Detection
1. Start column group usage capture
Oracle can automatically

detect column group
candidates based on an STS
or by monitoring a workload
Uses DBMS_STATS procedure
SEED_COL_USAGE
If the first two arguments are
set to NULL the current
workload will be monitored
The third argument is the
time limit in seconds
21

reserved.
Extended Statistics
2. Run your workload
Actual number of rows

returned by this query is 932
Optimizer under-estimates
the cardinality as it assumes
each where clause predicate
will reduce number of rows
returned
Optimizer is not aware of
real-world relations between
city, state, & country
22

reserved.
Extended Statistics
2. Run your workload
23

reserved.
Actual number of rows

returned by this query is 145
Optimizer over-estimates the
cardinality as it is not aware
of the real-world relations
between state & country
Extended Statistics
3. Check column usage information recorded for our table
SELECT dbms_stats.report_col_usage(user, 'customers') FROM dual;
EQ means column was used in

equality predicate in query 1
COLUMN USAGE REPORT FOR SH.CUSTOMERS

FILTER means columns used together
1. COUNTRY_ID
: EQ
as filter predicates rather than join
2. CUST_CITY
: EQ
etc. Comes from query 1
3. CUST_STATE_PROVINCE
: EQ
4. (CUST_CITY, CUST_STATE_PROVINCE, COUNTRY_ID)
: FILTER
5. (CUST_STATE_PROVINCE, COUNTRY_ID) : GROUP_BY
GROUP_BY columns used in group
by expression in query 2
24

reserved.
Statistics Enhancements
4. Create extended stats for customers based on usage
SELECT dbms_stats.create_extended_stats(user, 'customers')
FROM dual;
EXTENSIONS FOR SH.CUSTOMERS
1. (CUST_CITY, CUST_STATE_PROVINCE, COUNTRY_ID):
SYS_STUMZ$C3AIHLPBROI#SKA58H_N
created
2. (CUST_STATE_PROVINCE, COUNTRY_ID) :
SYS_STU#S#WF25Z#QAHIHE#MOFFMM_
created
Column group statistics will now be automatically maintained

every time you gather statistics on this table
25

reserved.
Agenda
26


reserved.
When to Gather Statistics

Automatic Statistics Gathering
Oracle automatically collect statistics for all database
objects, which are missing or have stale statistics
AutoTask run during a predefined maintenance window
Internally prioritizes the database objects
Both user schema and dictionary tables
Objects that need updated statistics most are processed first
Controlled by DBMS_AUTO_TASK_ADMIN package or via

Enterprise Manager
27

reserved.

Automatic Statistics Gathering in Enterprise Manager
Enterprise Manager allows
you to control all aspects of
the automatic statistics
gathering task
The statistics gathering task
can be set to only run during
certain maintenance windows
28

reserved.

Automatic Statistics Gathering
If you want to disable auto job for application schema
leaving it on for Oracle dictionary tables
The scope of the auto job is controlled by the global
preference AUTOSTATS_TARGET
Possible values are
AUTO
Oracle decides what tables need statistics (Default)
All
Statistics gathered for all tables in the system
ORACLE Statistics gathered for only the dictionary tables
29

reserved.

If the Auto Statistics Gather Job is not suitable
Need to determine when to manually gather statistics
After large data loads
Add statistics gather to the ETL or ELT process
If trickle loading or online transactions

Manually determine when statistics are stale and trigger gather
USER_TAB_MODIFICATIONS lists # INSERTS, UPDATES, and
DELETES that occurs on each table
If trickle loading into a partition table

Used dbms.stats.copy_table_stats()
30

reserved.

If the Auto Statistics Gather Job is not suitable
DBMS_STATS.COPY_TABLE_STATS();
Partitioned Table
Partition 1
June 1st 2012
:
Partition 4
June 4th 2012
Copies statistic from source

partition to new partition
Adjusts min & max values for
partition column
Both partition & global statistics
Copies statistics of the

dependent objects
Columns, local (partitioned)
indexes* etc.
Partition 5
June 5th 2012
31

reserved.
Does not update global indexes
Agenda
32


reserved.
Statistics Gathering Performance

How to speed up statistics gathering
Three parallel options to speed up statistics gathering
Inter object using parallel execution
Intra object using concurrency
The combination of Inter and Intra object
Incremental statistics gathering for partitioned tables
33

reserved.

Inter Object using parallel execution
34
Controlled by GATHER_*_STATS parameter DEGREE

Default is to use parallel degree specified on object
If set to AUTO Oracle decide parallel degree used
Works on one object at a time

reserved.

Customers
Table
P1
P2
P3
P4
35

reserved.
Customers table has a

degree of parallelism of 4
4 parallel server processes
will be used to gather stats

Exec DBMS_STATS.GATHER_TABLE_STATS(SH,SALES);
Sales Table
P1
Partition 1
May 18th 2012
P2
P3
P4
Partition 2
May 19th 2012
Partition 3
May 20th 2012
36

reserved.
Each individual partition will

have statistics gathered one
after the other
The statistics gather
procedure on each individual
partition operates in parallel
BUT the statistics gathering
procedures wont happen
concurrently

Intra Object
Gather statistics on multiple objects at the same time
Controlled by DBMS_STATS preference, CONCURRENT
Uses Database Scheduler and Advanced Queuing

Number of concurrent gather operations controlled by
job_queue_processes parameter
Each gather operation can still operate in parallel
37

reserved.

Intra Object Statistics Gathering for SH Schema
Exec DBMS_STATS.GATHER_SCHEMA_STATS(SH);
A statistics gathering job is
created for each table and
partition in the schema
Level 1 contain statistics

gathering jobs for all nonpartitioned tables and a
coordinating job for each
partitioned table
Level 2 contain statistics
gathering jobs for each
partition in the partitioned
tables
38

reserved.

Inter Object using concurrent parallel execution
Exec DBMS_STATS.GATHER_TABLE_STATS(SH,SALES);
Sales Table
Partition 1
May 18th 2012
Job1
The number of concurrent

gathers is controlled by the
parameter
job_queue_processes
In this example it is set to 3
Partition 2
May 19th 2012
Job2
In this example parallel

degree is 4
Partition 3
May 20th 2012
39

reserved.
Remember each concurrent

gather operates in parallel
Job3

Incremental Statistics Gathering for Partitioned tables
Typically gathering statistics after a bulk loading data
into one partition would causes a full scan of all
partitions to gather global table statistics
Extremely time consuming
With Incremental Statistic gather statistics for touched

partition(s) ONLY
Table (global) statistics are accurately built from partition statistics
Reduce statistics gathering time considerably
Controlled by INCREMENTAL preference
40

reserved.
Incremental Statistics Gathering

Sales Table
1. Partition level stats are

gathered & synopsis created
May 18th 2011
May 19th 2011
2. Global stats generated by aggregating

partition level statistics and synopsis
May 20th 2011
May 21st 2011
May 22nd 2011
May 23rd 2011
Sysaux Tablespace
41

reserved.
Incremental Statistics Gathering

Sales Table
3. A new partition is added to the table & Data is Loaded
May 18th 2011
May 19th 2011
May 20th 2011
6. Global stats generated by aggregating

the original partition synopsis with the
new one
May 21st 2011
May 22nd 2011
May 23rd 2011
May 24th 2011
42

reserved.
5. Retrieve synopsis for

4.
Gather
partition
each
of the
other partitions
statistics
for new partition
from Sysaux
Sysaux Tablespace
More Information
Accompanying Two Part White Paper Series
Understanding Optimizer Statistics
Best Practices for Managing Optimizer Statistics
Optimizer Blog
http://blogs.oracle.com/optimizer
Oracle.com
http://www.oracle.com/technetwork/database/focus-areas/bidatawarehousing/dbbi-tech-info-optmztn-092214.html
Oracle Exadata Database Machine

http://www.oracle.com/exadata
43

reserved.
44

reserved.

Best Practices For Exadata and Optimizer

Încărcat de

Informații document

Titlu original

Drepturi de autor

Formate disponibile

Partajați acest document

Partajați sau inserați document

Opțiuni de partajare

Vi se pare util acest document?

Este necorespunzător acest conținut?

Drepturi de autor:

Formate disponibile

Best Practices For Exadata and Optimizer

Încărcat de

Drepturi de autor:

Formate disponibile

Best Practices for Oracle Exadata and the

Copyright 2011, Oracle and/or its affiliates. All rights

Oracle Exadata Database Machine

Copyright 2011, Oracle and/or its affiliates. All rights

Fastest Data Warehouse & OLTP

Oracle Exadata Innovation

Copyright 2011, Oracle and/or its affiliates. All rights

Smart Scan Queries

Standardized and Simple to Deploy

Run Existing OLTP and DW Applications

Leverage Oracle Ecosystem

Copyright 2011, Oracle and/or its affiliates. All rights

Oracle Exadata in the Market

Copyright 2011, Oracle and/or its affiliates. All rights

How to gather statistics

Copyright 2011, Oracle and/or its affiliates. All rights

How to Gather Statistics

The GATHER_*_STATS procedures take 13 parameters

Copyright 2011, Oracle and/or its affiliates. All rights

How to Gather Statistics

Copyright 2011, Oracle and/or its affiliates. All rights

How to Gather Statistics

Can change the default value at the table level

Copyright 2011, Oracle and/or its affiliates. All rights

How to Gather Statistics

Copyright 2011, Oracle and/or its affiliates. All rights

How to Gather Statistics

Controlled by ESTIMATE_PRECENT parameter

Copyright 2011, Oracle and/or its affiliates. All rights

How to Gather Statistics

Accuracy of 100% sample

NDV with 100%

Copyright 2011, Oracle and/or its affiliates. All rights

How to gather statistics

Copyright 2011, Oracle and/or its affiliates. All rights

Additional Types of Statistics

Can be manually or automatically created

Copyright 2011, Oracle and/or its affiliates. All rights

Copyright 2011, Oracle and/or its affiliates. All rights

Copyright 2011, Oracle and/or its affiliates. All rights

Copyright 2011, Oracle and/or its affiliates. All rights

Cardinality calculated using column group statistics

Copyright 2011, Oracle and/or its affiliates. All rights

Optimizer doesnt know how function affects values in the column

Copyright 2011, Oracle and/or its affiliates. All rights

New Column with

Copyright 2011, Oracle and/or its affiliates. All rights

Oracle can automatically

Copyright 2011, Oracle and/or its affiliates. All rights

Actual number of rows

Copyright 2011, Oracle and/or its affiliates. All rights

Copyright 2011, Oracle and/or its affiliates. All rights

Actual number of rows

EQ means column was used in

COLUMN USAGE REPORT FOR SH.CUSTOMERS

Copyright 2011, Oracle and/or its affiliates. All rights

Column group statistics will now be automatically maintained

Copyright 2011, Oracle and/or its affiliates. All rights

How to gather statistics

Copyright 2011, Oracle and/or its affiliates. All rights

When to Gather Statistics

Controlled by DBMS_AUTO_TASK_ADMIN package or via

Copyright 2011, Oracle and/or its affiliates. All rights