Documente Academic
Documente Profesional
Documente Cultură
Manager or Tech?
Exadata V1 Experience?
Exadata V2-2 or V2-8 Experience?
Exadata V3-2 Experience?
Oracle Cloud Control 12c Experience?
Goals
Overview & Tour of Oracle EM Cloud Control 12c
Focus on a few nice tuning features of Oracle EM Cloud Control 12c
Non-Goals
Learn ALL aspects of Tuning with Oracle EM Cloud Control 12c
Learn how to install Oracle EM Cloud Control 12c 11g Grid
3
There is a fifth dimension beyond that which is know to the CEO,
CFO, or CIO. It is a dimension that as vast as Exadata disk space,
and as untimely as an infinite loop for those that fail to embrace it. It
is the middle ground between light and shadow, between science and
superstition, between developer and DBA, and it lies between the pit
of the DBAs fears of whether a recovery will work, and the summit of
his knowledge required for a successful upgrade. This future
dimension was once the dimension of imagination only, where we
could dream of a single database filled with millions of terabytes of
data and media. A wonderland where developers could write any
query without penalty of being timed out, or being the victim of an
anonymous kill -9; its a place where speed and disk space no longer
matter (as much). This has now become a reality, and I call it the
Exabyte Zone! - Oracle Database 11g Performance Tuning Tips & Techniques
Overview
In fact, when I started Oracle, the goal was never to have a large company.
At best, I hoped we would have fifty people in the company and make
a good living. About five years into the company, it became pretty clear
that the horizons were unlimited. The only limitations were us.
Larry Ellison (Nicole Ricci Interview, 1998)
1979/1980: SIGMOD Conference
I remember seeing the Oracle system running for the first time. Larry
knew about System R and about our work and he gave me a little
demo. I was impressed, because it was obviously simple. It seemed
fast. He loaded the database, queried it, and updated it, all in a
few seconds. It was - I don't know how many - maybe five-hundred
records. And it loaded instantly. The thing that impressed me the
most was that it ran on a little DEC PDP-11. The machine looked to
be the size of a carton of cigarettes. It must have been an LSI-11
version of the machine, if my recollection of the size is correct. And
System R at the time in most of our joint studies and at IBM was
running on 168s. Now a 168 is only maybe the power of a 486DX2
or something, but the fact of the matter is it was a huge machine
which would probably not fit in this room (water cooled).
9
Fast Forward
3 Decades
With Exadata =>
(Addressable Memory):
1983 First 32-bit
(V3: 4G possible)
2K A typewritten page
5M The complete works of Shakespeare
10M One minute of high fidelity sound
2T Information generated on YouTube in one day
10T 530,000,000 miles of bookshelves at the Library of Congress
20P All hard-disk drives in 1995 (or your database in 2010)
700P Data of 700,000 companies with Revenues less than $200M
1E Combined Fortune 1000 company databases (average 1P each)
1E Next 9000 world company databases (average 100T each)
8E Capacity of ONE Oracle11g Database (CURRENT)
12E to 16E Info generated before 1999 (memory resident in 64-bit)
16E Addressable memory with 64-bit (CURRENT)
161E New information in 2006 (mostly images not stored in DB)
1Z 1000E (Zettabyte - Grains of sand on beaches -125 Oracle DBs)
100TY - 100T-Yottabytes Addressable memory 128-bit (FUTURE) 11
Bigger Data Get Ready for it
Big data: The next frontier for innovation, competition, and productivity
14
Computing has Shifted from
Monolithic to Decentralized
15
Acceleration! Next Generation Hardware
Where to find Gold X marks the spot!
16
Future Goal is to do this for Others:
Applications Acquisitions
18
How about the Oracle JAVA World?
19
Exadata (X3-2)
(Oracles picture)
14 Storage Servers
- 14x12=168 Disks
- 100T SAS or
- 504T SAS
8 Compute Servers
8 x 2 sockets x 8 cores = 128 cores
2T DRAM
InfiniBand Network
40 Gb/sec each direction
Fault Tolerant
20
Exadata is MORE than Hardware*
Sub second
On Database
Machine
20 GB 5 GB
with Storage Indexes with Smart Scans
22
10x faster than any Oracle DW 5x faster than V1
Big Difference
Much Improved!
Exadata V1?
Exadata X2?
Exadata X3?
23
Terminology & The Basics
24
Some Terms
26
WHAT is it (X3-2)?
Shared Memory/Global Area Shared Memory/Global Area Shared Memory/Global Area Shared Memory/Global Area
SAS High Performance (15K RPM) or SAS High Capacity (7.2K RPM)
SAS=Serial Attached SCSI (Small Computer System Interface)
DRAM Dynamic Random Access Memory 29
How FAST can it be?
Also - Miscellaneous:
Hot Swappable Redundant Power
Each Database Server - Dual Port InfiniBand 40Gb/s card
Database Servers have Disk Controller HBA (Host Bus Adapter) has
512M battery backed up cache
Each DB Server has 4 x 1GbE interfaces & ILOM (Integrated
Lights Out Management Remote power on)
Two 10G Ethernet ports (optical) 31
How they got these NUMBERS?
(FYI Only)
8 compute servers
8 servers x 2 CPU sockets x 8 cores = 128 cores (Xeon E5-2690)
8 servers x 256G DRAM = 2T DRAM
14 Storage Servers total 336G DRAM = 2.3T+ Total DRAM
3 InfiniBand Switches x 36 ports = 108 ports
14 Storage Servers (100-504T) with Flash Cache (22.4T)
400G x 4 banks = 1.6T flash cache per storage server
14 storage servers x 1.6T = 22.4T Flash Cache
12 disks per storage server x 14 servers = 168 disks
168 disks x 600G SAS = 101T High Performance SAS
168 disks x 3T SAS = 504T High Capacity SAS
Additional total storage of 9.6T on Database Servers (300G drives)
14 storage servers x 2 six core L5640 = 168 additional cores32
Compute Servers Like 8 Node RAC!
DRAM
33
Storage Servers Full Rack
36 Ports 35
Put it all together Oracles picture
of the X3-2
14 Storage Servers
- 14x12=168 Disks
- 100T SAS or
- 504T SAS
8 Compute Servers
8 x 2 sockets x 8 cores = 128 cores
2T DRAM
InfiniBand Network
40 Gb/sec each direction
Fault Tolerant
36
NEW X3-2 - One more time
How they got these NUMBERS?
8 compute servers
8 servers x 2 CPU sockets x 8 cores = 128 cores (Xeon E5-2690)
8 servers x 256G DRAM = 2T DRAM
14 Storage Servers total 336G DRAM = 2.3T+ Total DRAM
3 InfiniBand Switches x 36 ports = 108 ports
14 Storage Servers (100-504T) with Flash Cache (22.4T)
400G x 4 banks = 1.6T flash cache per storage server
14 storage servers x 1.6T = 22.4T Flash Cache
12 disks per storage server x 14 servers = 168 disks
168 disks x 600G SAS = 101T High Performance SAS
168 disks x 3T SAS = 504T High Capacity SAS
Additional total storage of 9.6T on Database Servers (300G drives)
14 storage servers x 2 six core L5640 = 168 additional cores37
OLD X2-2 - One more time
How they got these NUMBERS?
41
How will NEW 3-8 change these
How they got these NUMBERS?
Lost Space:
100T SAS = 45T usable
504T SAS = 224T usable
44
Some Case Studies
Technology
$200M
People
$50M
Process
$750M
48
Proof of Concept Wait Events
Our own Rack Exadata!
Fast Hardware!
Many CPUs
Flash Cache
Lots of DRAM (Parallel Query in DRAM in 11.2)
Smart Scan (save 4x-10x)
Storage Indexes (save 5x-10x)
Compression (save 10x-70x)
Partition Pruning (save 10x-100x)
Turn a 1T search into a 500M search or even 50M 52
Smart Scans
53
Smart Scans 10x savings common
ALL Flash Cache Combined (5.4G/s per cell): 75G/s (1,500,000 IOPS)
20x more random I/O; 2x more sequential I/O (vs. disk) 56
Flash Cache 20x-50x faster than disk
Caches
Hot Data/Index Blocks
Control File reads/writes
File header reads/writes
Does NOT cache
Mirror copies / Backups / Data Pump
Tablespace Formatting
Table Scans (rare)
Table Altered.
Name Value
---------------------------------------------- --------
physical read total IO requests 36240
physical read requests optimized 23954
(this second line (*8192) is flash cache used)
62
It IS working 4G query
65
** Thanks Oracle for this image
Storage Index - 10x is common (11.2)
NAME VALUE
--------------------------------------------- -------
cell physical IO bytes saved by storage index 25604736
(actual savings from Exadata built storage index)
67
Check BOTH servers
NAME VALUE
--------------------------------------------- -----------
cell physical IO bytes saved by storage index 19693854720
cell physical IO bytes saved by storage index 0
68
Case two More advanced comparing
ORDERED data to NON-ORDERED
select count(*)
from table_no_order;
COUNT(*)
--------------
482246656
select count(*)
from table_ordered;
COUNT(*)
--------------
482246656
alter system flush buffer_cache;
70
System altered
Non-Ordered does not use Storage Index
select count(*)
from table_no_order
where object_id=20;
COUNT(*)
--------------
32768
Elapsed: 00:00:01.64
select count(*)
from table_ordered
where object_id=20;
COUNT(*)
--------------
32768
Elapsed: 00:00:00.11
NAME VALUE
---------------------------------------------------------------- --------------
cell physical IO bytes saved by storage index 1.5211E+10 72
Hybrid Columnar Compression (11.2)
73
Hybrid Columnar Compression
74
** Thanks Oracle for these images (Archive)
Exadata Hybrid Columnar Compression
(EHCC) 4-10x & 30x is common
Fully supported:
B-Tree Indexes
Bitmap Indexes
Text Index
Materialized Views
Partitioning
Parallel Query
Data Guard Physical Standby
Logical Standby and Streams (FUTURE release)
Smart Scans of HCC tables! 77
Other Oracle Compression
declare
v_t_object_id number;
v_t2_object_id number;
v_t_object_name varchar2(100);
cursor mycur is
select object_id from t2;
begin
open mycur;
loop
fetch mycur into v_t2_object_id;
exit when mycur%notfound;
begin
select distinct t.object_id, t.object_name into v_t_object_id, v_t_object_name
from t where t.object_id=v_t2_object_id;
if SQL%ROWCOUNT =1 then
insert into t3 values ( v_t_object_id,v_t_object_name );
end if;
exception
when no_data_found
then
null;
end;
end loop;
close mycur;
commit;
end; 79
Performance Improved by 60x
In Exadata write smart queries!
SQL> @row-by-row
PL/SQL procedure successfully completed.
Elapsed: 00:03:44.94
98 rows created.
Elapsed: 00:00:04.95 80
Benefits Multiply*: Access 1/2000th the data; Its
like getting 8P memory resident in 4T of an X3-8
Sub second
On Database
Machine
20 GB 5 GB
with Storage Indexes with Smart Scans
82
Cloud Control 12c Monitor Exadata
83
Cloud Control 12c Monitor Exadata
84
SQL Performance Analyzer
12c Exadata Simulation
Upgrade
Options
85
Exadata Simulation
86
Resource Management (IORM)
(FYI Only)
87
IORM - I/O Resource Management
90
Security FYI Only
91
Oracle Database Security
Built over MANY years...
Audit Vault
Total Recall / Flashback
Database Vault
Label Security
Advanced Security
Secure encrypted backup (also available: incremental
backup with Change Tracking File much faster)
Data Masking
Data Guard
Failure Groups (automatic-for storage cell failure) 93
Security Enhancements in 12c
95
MUST haves & DONT do!
Must have Latest Bundle Patch (See note: 888828.1 for latest)
Must have the correct data center COOLING!
3 tiles with holes for full rack (400 CFM/tile) dont melt it!
Must have the correct power needs
Must use Oracle Linux 5.8 (x86_64) or Solaris 11 (Selectable
at install time) & Oracle11.2
Must have ASM & use RMAN for backups
Consider StorageTek SL500 Tape backup
Use an ASM allocation unit (AU) size of 4M
Dont add any foreign hardware or No Support!
Dont change BIOS/Firmware or No Support! 96
Best Practices
Fast Hardware!
Many CPUs!
Fast Flash Cache!
Lots of DRAM on Database Servers and Storage
Compression (save 10x-70x)
Partition Pruning (save 10-100x)
Storage Indexes (save 5-10x)
Smart Scan (save 4-10x)
Turn a 1T search into a 500M search or even 50M 98
Exadata = Paradigm Shift!
99
March 4, 1986 Sun
(Stanford University Network)
100
March 12, 1986 Oracle
ORCL IPO:
Open:15
Close:20.75
Up 38%
101
March 13, 1986 Microsoft Next?
102
Oracle Taking over Hardware
1/8 Rack
103
** Thanks Oracle for this image
Whats Next Exalogic Elastic Cloud!
Built for Applications Tier
(Note: There is a , & 1/8 Rack)
Oracle Database
Appliance (3-2)
2 to 32 Cores Oracle Exadata
PERFORMANCE
CAPACITY HIGHER
114
** Thanks Oracle for this image
Oracle Exalytics BI Machine!
Leveraging the Times Ten Acquisition
1T DRAM
3.6T storage uncompressed
40 Gb/s InfiniBand
4 x 10 core = 40 cores
200G/sec scan x 5x compression = 1T/sec scan
Runs Times Ten, OBIEE, Memory Optimized Essbase
In memory data access & columnar compression
Smart Storage Manager to keep the right things in memory
Software seems pricey but, huge impact possible!
Its so fast the response time is well there is no response
time, its just done.
115
Whats Next SPARC SuperCluster!
116
** Thanks Oracle for this image
SPARC SuperCluster T4-4
The Future is coming faster
5x faster than T3
L1/L2 cache specific to a core 16K each cache
L3 shared by all 8 cores 4M (new on T4)
Prefetching of instructions & data (new on T4)
Out of order execution (new on T4)
Dual instruction use (new on T4)
Memory Management Unit page size = 2G
Dynamically threaded (see next slide)
14 on chip crypto functions & 10GbE networking
Up to 8 Racks w/o adding any InfiniBand changes 118
8 core T4 processor has 64 threads
Up to 2 threads run simultaneously
119
** Thanks Oracle for this image 8 cores x 8 threads each = 64 threads x 4 T4s x 4 servers
SuperCluster 1.2M IOs/sec
How they got these NUMBERS?
(Note: There is also Rack now)
New SPARC T5
Runs 2.3x faster than T4
New T5-5
Similar to T4-5
Has the T5 processor
If SuperCluster replaces T4-4s with T5-4s it will be:
4 servers x 4 CPU sockets (T5) x 16 cores = 256 cores
8 threads per core 256 cores = 2048 threads
(About 2200 threads per box = DOUBLE THE CURRENT!)
4 compute servers x 2T DRAM= 8T DRAM (19.2T disk)
Double the CPU & Double the DRAM if SuperCluster gets it!121
The Future: 8 Exabytes
Look what fits in one 11g Database!
All Data in the world 2010 = 1000E or 1Z
2K A typewritten page
5M The complete works of Shakespeare
10M One minute of high fidelity sound
2T Information generated on YouTube in one day
10T 530,000,000 miles of bookshelves at the Library of Congress
730T Information generated in YouTube in a year
20P All hard-disk drives in 1995 (or your database in 2010)
700P Data of 700,000 companies with Revenues less than $200M
1E Combined Fortune 1000 company databases (average 1P each)
1E Next 9000 world company databases (average 100T each)
8E Capacity of ONE Oracle11g Database (CURRENT)
12E to 16E Info generated before 1999 (memory resident in 64-bit)
16E Addressable memory with 64-bit (CURRENT)
161E New information in 2006 (mostly images not stored in DB)
1Z 1000E (Zettabyte - Grains of sand on beaches -125 Oracle DBs)
122
100TY - 100T-Yottabytes (1000Z=1Y) Addressable 128-bit (FUTURE)
Whats Next World On-Line in Oracle Cloud
Super Oracle System!
124
Exadata V2 / V2-8 & Exalogic
125
Exadata V2 / V2-8 & Exalogic
126
The X3-2 is much more than X2-2
128
Headlines: Oracle is now a very serious
hardware company!
129
Big Revenue & Big Profits Coming
Need more hardware ?
130
Pillar (SAN), ZFS, Big Data, StorageTek
from www.oracle.com
131
Pillar, ZFS (NAS or SAN), Big Data,
StorageTek
132
Pillar, ZFS, Big Data, StorageTek
(TAPE) Store 1E (string of 10 w/ 2:1)!
133
134
648T Raw Storage RJN NOTE
135
Oracle Big Data Solutions
In-Database MapReduce (12c)
Oracle Public Cloud
137
The Oracle Social Network
138
Trends: Gartner Hype Cycle 2012
More SPEED Coming Get Ready
This guy does not ever slow down!!
140
Get Ready for Pluggable Databases
This guy and his team working hard to make your life easier! 141
What is your System of the Future?
142
The Best Oracle 12c New Features
(see 12c presentation for more)
Oracle Disclaimer: The following is intended to outline Oracle's general product direction. It is
intended for information purposes only, and may not be incorporated into any contract. It is not a
commitment to deliver any material, code, or functionality, and should not be relied upon in making
purchasing decisions. The development, release, and timing of any features or functionality 143
described for Oracle's products remains at the sole discretion of Oracle.
Overview 12c
145
Compelling Technology Statistics!
40
35
30
25
20 Years to Reach 50M
Users
15
10
5
0
Radio TV Cable Internet Wireless
Friedmans 6 Dimensions
of Understanding Globalization*
Politics (Merging)
Culture (Still disparate)
Technology (Merging/Merged)
Finance (Merging/Merged)
National security (Disparate)
Ecology (Merging)
* Sited from Mark Hasson, PSU, Global Pricing and International Marketing.
147
Waves of Acceleration!
Human history becomes more and more a race between education and
disaster. - HG Wells
148
NEW Waves of Acceleration!
-Melissa
150
The Future: 8 Exabytes
Look what fits in one 11g Database!
2K A typewritten page
5M The complete works of Shakespeare
10M One minute of high fidelity sound
2T Information generated on YouTube in one day
10T 530,000,000 miles of bookshelves at the Library of Congress
20P All hard-disk drives in 1995 (or your database in 2010)
700P Data of 700,000 companies with Revenues less than $200M
1E Combined Fortune 1000 company databases (average 1P each)
1E Next 9000 world company databases (average 100T each)
8E Capacity of ONE Oracle11g Database (CURRENT)
12E to 16E Info generated before 1999 (memory resident in 64-bit)
16E Addressable memory with 64-bit (CURRENT)
161E New information in 2006 (mostly images not stored in DB)
1Z 1000E (Zettabyte - Grains of sand on beaches -125 Oracle DBs)
100TY - 100T-Yottabytes (1000Z) Addressable in 128-bit (FUTURE)151
8 Exabytes:
Look what fits in one 11g Database!
153
Whats Next
154
Whats comes after the Exadata Zone?
YOU will soon be in for more
Directly Addressable Indirect/Extended
4 Bit: 16 (640)
8 Bit: 256 (65,536)
16 Bit: 65,536 (1,048,576)
32 Bit: 4,294,967,296
64 Bit: 18,446,744,073,709,551,616 quantum leaps are next!
Qubits allow multiple states so that you can look at all of the
possibilities/probabilities at one time.
The Quantum Zone next (Quantum Physics is incomplete Einstein)
Just 512 qubits would store 512-bits of addressable memory or 2512 (which is well
over a googol or 1 with 100 zeros after it a googol is about 2332).
Brush up on your Eigenvectors, Eigenvalues, Pauli Matrices & Grovers Algorithm
Create Singularity all atoms of a person by 2045 (I think earlier); 12-Monkeys
Private universes Is there one for each person? (Schroeders cat I think not)
Rearranging atoms to create new objects; Nanotech + Quantum Physics coming! 155
Whats comes after the Exadata Zone?
YOU will soon be in for more
With just 3 cubits I get (ket notation) looking at many states at once:
a|000> + b|001> + c|010> + d|011> + e|100> + f|101> + g|110> +
h|111>
For the state (a,b,c,d,e,f,g,h): Note that: |010> = (0,0,1,0,0,0,0,0)
158
Before Tech they were Engineers
159
This is How DBA View Themselves!
160
How everyone else views them!
Data
164
Dont want to Embrace the Future???
165
Summary We Covered
168
References to wish for
169
www.tusc.com
Oracle9i Performance Tuning
Tips & Techniques; Richard
J. Niemiec; Oracle Press (May
2003)
Oracle 10g Tuning (June 11,
2007)
170
- Henry David Thoreau
References
173
Rolta Your Partner .
Accomplished in Oracle!
2012 Oracle Excellence Award
(9 Partner of the Year / Titans / Excellence Awards)
175
Roltas Oracle Services
Oracle
E-Business Suite implementation, R12 upgrades, migration & support
Fusion Middleware and Open Systems development
Business Intelligence (OBIEE) development
Hyperion Financial Performance Management
DBA and Database tactical services
Strategic Global Sourcing
IT Infrastructure
IT Roadmap - Security & Compliance - Infrastructure Management
Enterprise Integration / SOA - High Availability and Disaster Planning
Profitability & Cost Management
Financial Consolidation - Budgeting & Forecasting
Profitability & Risk Analysis - Enterprise Performance Management
Operational, Financial & Management Reporting
Rolta Software Solutions
iPerspective - rapid data & systems integration
Geospatial Fusion - spatial integration & visualization
176
OneView - business & operational intelligence
Copyright
Information