03N-Architectural, SW and HW Overview

Oracle Big Data Appliance Workshop:
Introduction to Oracle Big Data Appliance
Rick Pandya
Oracle Database Product Management
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |

Agenda
1
Big Data Overview
Appliance Overview
2 Hardware
3 Networking
4
Software
5
Manageability
Big Data
A Definition

Big Data: Acting on New Data
“I found it”
Stores Looking back

“PAST”
Catalog/
Call Web
Center
Retail
Decisions
Social
Search
Looking ahead
Networks
“FUTURE”
“I think” “I want”
Big Data: Challenge to Opportunity
Harness Big Data to Increase Business Value
Business → Deep Analytics
Value Big Data → High Agility
Platform → Massive Scalability
→ Real Time
Tomorrow
→ High Variety
→ High Volume
Challenges → High Complexity Big Data
→ High Velocity
Today
Time
Big Data: Infrastructure Requirements
Acquire Organize Analyze
• Low, predictable Latency

• High Transaction Count • Deep Analytics
• Flexible Data Structures • Agile Development
• Massive Scalability
• High Throughput • Real Time Results
• In-Place Preparation
• All Data Sources/Structures

Divided
Data
Solution Spectrum
Variety
NoSQL
Distributed Flexible
File Systems MapReduce Specialized
Schema-less Transaction Solutions Developer
(Key-Value) Centric
Stores
SQL
Schema DBMS DBMS Advanced
ETL Trusted
(OLTP) (DW) Analytics
Secure
Administered

Oracle Integrated Software Solution Stack
Data
Variety
Cloudera In-DB
HDFS Analytics
CDH
Dynamic Oracle NoSQL
“R”
Oracle Mining
Schema DB Big Data Text
Connectors Graph
Oracle Oracle Spatial
Database Database Oracle
Schema
(OLTP) (DW) BI EE

Oracle Integrated Software Solution Stack
Data
Variety
Big Data Appliance Cloudera In-DB
HDFS
• Cloudera CDH Analytics
• HBase , Hive etc.
CDH
Dynamic • Cloudera Manager
Oracle NoSQL Oracle
“R”
Schema • NoSQL Database (CE | EE) Mining Exalytics
DB• Big Data Connectors
Big Data • Speed of
Text
Connectors Graph Thought
Oracle Exadata Analytics
Oracle Oracle Spatial
• OLTP & DW
Database • Database
Data Mining & Oracle R Oracle
Schema •
(OLTP) Semantics (DW) BI EE
• Spatial

Why build a Hadoop Appliance?
• Time to Build?
• Required Optimizations?
• Cost and Difficulty Maintaining?
Oracle Big Data Appliance
Hardware Overview

Oracle Engineered Systems
• 18 Sun X4-2 Servers per Rack
– 4608 GB memory (expandable to 13 TB)
– 792 cores
– 1728 TB storage
• 40 Gb/s InfiniBand Fabric
– Inter-rack Connectivity (2 X 32 Port)
– Inter-node Connectivity (1 x 36 Port)
• 10 Gb/s Ethernet Connectivity
– Data center connectivity

Big Data Appliance X6-2
Sun Oracle X6-2L Servers with per server:

• 2 * 22 Core (2.2GHz) Intel Xeon E5-2699 v4 Processors
• 256 GB DDR4-2400 Memory
• 96TB Disk space
Included Software (4.5):

• Oracle Linux 6.7
• Oracle Big Data SQL 3.0.1*
• Cloudera Distribution of Apache Hadoop 5.7 – EDH Edition
• Cloudera Manager 5.7
• Oracle R Distribution
• Oracle NoSQL Database CE
* Oracle Big Data SQL is separately licensed
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. | 14
Big Data Appliance X6-2 – April 2016
Hardware Comparison to X5-2 Generation
• Additional CPU capacity – 22-core (2.2GHz) Intel® Xeon® E5-2699 v4 (“Broadwell”)

• Double the Memory – DDR4-2400 upgradeable from 256GB (8x32GB) to 768 GB
• Same High Density Capacity – 8TB Drives
• Same Great TCO and Low Entry Cost
BDA X6-2 vs. X5-2 Full Rack
20% More Cores 792 cores – Intel® Xeon® E5-2699 v4
2x More Memory Default of 4.6TB DDR4 Memory

Elastically Scale-Out from Starter Rack to Multi-Rack
HC
Starter
Full
Multi-Rack
• Start with 6 BDA Servers and all switches
- Add BDA HC Nodes as needed
• Can expand older machines with new generation servers
How BDA Elastic Configurations Work
• Start with a BDA Starter Rack
– 6 BDA Servers
– All Switching Included (Leafs, Spine and Management)
• Add BDA HC Node
– Single node increments
– No need for a 6-node In-Rack Expansion upgrade
– Up to a Maximum of 18 BDA HC Nodes in a Rack
• Assembled with requested number of servers
by Oracle
HC – Option: Add servers later at customer site
– Can add BDA HC Node to older (x2 to x4) machines
• Standard Configurations remain available
– Starter Rack, Full Rack

Big Data Appliance – Core Design Principles
Operational Simplicity
Simplify Access to ALL Data
Open Analytics Platform

Big Data Appliance – Core Design Principles
Operational Simplicity
• Consistently High Performance
• Remove Bottlenecks
• Full Stack Install and Upgrades
• Simplified Operations / Management
• Cluster Growth
• Node Migration
• Always Highly Available
• Always Secure
• Latest Hardware Technologies for Hadoop and Spark

Successful Big Data Systems Grow
From Cluster Install with HA to Large Clusters to Dealing with Operational Issues
• 12 node BDA for Production
Day 1 • Hadoop HA and Security Set-up
• Ready to Load Data
Full install with a single command:
./mammoth –i rck_1
RCK_1

Day 1
RCK_1
N Example Service:
N Hadoop Name
Nodes
Add 12 New Nodes across two Racks
Day 90
Cluster expansion with a single command:
mammoth –e newhost1,…,newhostn
RCK_1 RCK_2
N
N

Cluster Expansion with a single command:
mammoth –e newhost1,…,newhostn
RCK_1 RCK_2
This expansion automatically optimizes HA
setup across multiple racks
N Because of uniform nodes and IB networking,

N no data is moved

Critical Node Failure => Primary Name Node

Day n
RCK_1 RCK_2
N
N

• Automatic Failover to other

NameNode
RCK_1 RCK_2 • Automatic Service Request to
Oracle for HW Failure
N
N

Software Overview

Oracle Big Data Appliance Software BDA 3.0
Software pre-installed, pre-optimized for optimal performance
• Oracle Linux 5 or 6 with UEK 2 (v2.6.39)
• Oracle JDK 8
• Oracle R Distribution
• Cloudera Distribution of Apache Hadoop 5.7 – EDH Edition
• Cloudera Manager Enterprise 5.7
• Oracle Enterprise Manager BDA Plug-in
• Oracle NoSQL Database CE
• Oracle Database Instant Client 12.1
• Oracle Big Data Connectors V2.3
• ODI 11g Agent
* Separately licensed
Copyright © 2014, Oracle software, can
and/or its affiliates. be reserved.
All rights pre-installed
| and configured on BDA
Why Cloudera CDH on BDA?
• Managed and Tested by Cloudera
– Open Source Distribution
– Most Popular Distribution in the Market
– Rich management and configuration GUI tool
• Fast evolution in critical features
– Built by the Hadoop experts in the community
– Practical instead of esoteric
– Focus on what is needed for large clusters
• Proven at very large scale
– In production at all the large consumers of Hadoop
– Extremely stable in those environments

Cloudera Enterprise & Add-Ons
• BDA license includes all Cloudera subscription products
• Existing BDA customers entitled to new Cloudera components for their
existing systems at no additional cost
• Mammoth installs the new components today and will automatically
configure them in a future release
– Use Cloudera Manager for configuration
• Supported by Oracle

Cloudera Enterprise Components
• Avro • Impala • Sentry • More on this later
• Crunch • Kite • Solr
• DataFu • Llama • Spark
• Flume • Mahout • Sqoop
• Hadoop • Oozie • Whirr
• Hbase • Parque • Yarn
• Hbase-Solr • Pig • ZooKeeper
• Hive • Puppet
• Hue • Search

The Big Data Spectrum
• Big data consists of two main types of data: File Based and Value Based
• File based data requires a highly scalable environment and this is typically
achieved via a distributed file store with distributed processing
• Value based data needs a simple and highly scalable environment for
quickly storing and retrieving values based on simple keys. This is typically
achieved via Key-Value store.

Hadoop
• Hadoop is the core of CDH. It provides a distributed file system called HDFS
and a data processing framework called MapReduce.
• Hadoop is designed for storing files in a distributed way. The content of the
files can then be analysed via the MapReduce framework.
• Hadoop MapReduce provides a highly distributed batch processing
environment.
• A number of other components make use of the Hadoop services.

Oracle NoSQL
• Oracle NoSQL is a distributed Key-Value store
• It provides a simple API go put and get simple Key-Value records.
• It allows for real-time access to records.

What goes where?
• Projects typically come with services
NameNode?
• Typical services:
QJM?
– NameNodes (x2)
– Zookeeper
– Quorum Journal Managers (x3) JobTracker?
– Hive Server2 Zookeeper?
• Oracle NoSQL
• Metadata in an RDBMS
DataNode Hive Server
TaskTracker

Big Data Connectors
• What is included in the package?
– Oracle Loader for Hadoop
– Oracle SQL Connector for HDFS
– Oracle Data Integrator Application Adapter for Hadoop
– Oracle R for Hadoop Connector
– Oracle XQuery Connector for Hadoop

Big Data Connectors
• Do not require Big Data Appliance – can be licensed for non-Oracle hardware
• Must be licensed for all processors in a Hadoop cluster (no partial licensing)
• Software components are not licensed individually
• Restricted Use License:
– ODI as part of Oracle Big Data Connectors is restricted for use on Oracle Big Data Appliance with the Cloudera CDH targets or
Oracle No SQL targets residing on the Oracle Big Data Appliance.
– Any usage of Oracle Data Integrator outside of Oracle Big Data Appliance requires a full license for Oracle Data Integrator
Enterprise Edition.

Manageability

Oracle BDA Manageability
• Hardware Management
– Atomatic Service Requests (ASR)
– Integrated Lights Out Management (ILOM)
• Software Management
– Cloudera Manager
– Hadoop Monitoring UIs
– Oracle NoSQL Database Management

Automated Service Requests
Customer Datacenter Oracle Support Services
FRU replaced by
Field Engineer
Oracle Support
Engineer
Oracle Field FRU dispatched by
Engineer Support Engineer
Service Request
routed to
Support Engineer
Fault occurs
Customer SR creation
email notification
to customer Oracle Case
Management
System
ASR
Manager ASR Service
Product's auto-diagnosis facility sends Service Request (SR)
SNMP trap to ASR Manager Fault telemetry securely created
transmitted to Oracle

Oracle Auto Service Request Fault Coverage
Faults covered by Oracle ASR Faults not covered by Oracle ASR
Fault events that require Support Services Fault events that do not require Support
action from Oracle: Services action from Oracle:
• CPU • InfiniBand switches
• Disk Controllers, disks • Cisco switch
• InfiniBand cards • KMM/KVM
• Memory • PDUs
• System board • Batteries
• Power supplies
• Fans

Monitoring Hardware
Oracle Integrated Lights Out Manager (ILOM)
• Oracle ILOM enables you to actively manage and monitor the servers in BDA
– The ILOM service processor runs its own embedded OS and has a dedicated Ethernet
port, which provides out-of-band management capability
• With ILOM, you can proactively:
– Learn about hardware errors and faults as they occur
– Remotely control the power state of a server
– View the graphical and non-graphical consoles
– View the current status of sensors and indicators on the system
– Determine the hardware configuration of your system
– Receive generated alerts about system events in advance

Managing CDH Operations
Cloudera Manager
• Cloudera Manager provides a single administrative web-based interface to all
servers of the Hadoop cluster
• Cloudera Manager simplifies the following administrative tasks:
– Monitor jobs and services
– Start and stop services
– Manage security and Kerberos credentials
– Monitor user activity
– Monitor the health of the system
– Monitor performance metrics
– Track hardware use (disk, CPU, and RAM)
• Cloudera Manager runs on Node 3 of the BDA and is available on port 7180
– http://bdanode03.oracle.com:7180

Cloudera Manager
Key Features and Functionality
• Automated Deployment
– Install the complete Hadoop stack in minutes via a wizard-based interface
• Centralized Management
– Provides complete, end-to-end visibility and control over your Hadoop cluster
• Global Time Control
– All views have a time context
– Correlates jobs, activities, logs, system changes, configuration changes, metrics along a timeline to
simplify diagnosis
• Service and Configuration Management
– Set server roles, configure services and manage security

Cloudera Manager
• Role-Based Administration
– Configure Administrator users, read-only users
• Audit Trails
– Maintain a complete record of configuration changes with the ability to rollback
• Proactive Health Checks
– Monitor service performance metrics and alter when critical thresholds are met
• Event Management
– Create and aggregate relevant events pertaining to system health, log messages, audit events,
user services and activities
– Events are made available for alerting and searching

Cloudera Manager
• Intelligent Log Management
– Gather, view and search Hadoop logs collected from the cluster
• Alerting
– Generate email alerts based on events
• Activity Monitoring
– Consolidate all cluster activity into a single, real-time view
• Host Level Monitoring
– View host status, resident memory, virtual memory and roles
• Operational Reports
– Visualize current and historical reports – e.g. Disk usage, Mapreduce jobs, etc.
• Support Integration
– Automatically send cluster state to Cloudera support for diagnostics

Managing CDH
Cloudera Manager Architecture
Cloudera Manager Server Cloudera Manager Cloudera Manager Agent(s)
• Runs service monitor and activity Agent (1) • Starts and stops Hadoop
monitor
daemons
• Stores cluster information in a
• Collects statistics
database
• Hosts, services, roles,
configuration
Cloudera Manager
• Communicates with agents
Agent (n)
• Sends configuration information Cloudera Manager Server
and commands to agents
http(s)
Database Repository
Database (MySQL, • Stores configuration and monitoring
PostgreSQL) information about cluster hosts and
daemons

Managing CDH
Managing Services with Cloudera Manager
Services: Monitors the status and health of services Logs: Collects historical information about systems and services
Hosts: Add/Remove hosts Events: Records a change in state or other occurrence

Activities: Monitors all MapReduce Jobs Reports: Generates reports on demand

Monitoring Hadoop
• Hadoop Monitoring UIs at a glance

– NameNode UI (Node 01/Node 02, port 50070)
– JobTracker UI (Node 03, port 50030)
– TaskTracker UI (Nodes 4-18, port 50060)
– DataNode UI (Nodes 1-18, port 50075)

Using Hadoop Monitoring Utilities
Monitoring the NameNode
• The NameNode Status
interface is available on
port 50070 of Node 01 on
BDA

Monitoring the JobTracker
• Hadoop Map/Reduce
Administration
monitors the
JobTracker, which
runs on port 50030
of Node 3 on BDA

Monitoring the TaskTracker
• The Task Tracker Status interface is available on port 50060 of Nodes 4 -18
on BDA

NoSQL Management

Software High Availability

Hadoop NameNode High Availability
• Removes SPOF for Name Node

• Automatic fail-over of Name Node
Active Name Node
• Multiple synchronized copies of the
metadata
• No external filer hardware required,
uses Quorum-based Journaling
Passive Name Node

NameNode High Availability

NameNode High Availability
• The NameNode critical data (fsimage and
edit logs) is written to a mirrored partition
on the host
– Loss of a single disk can be tolerated
• The active NameNode records all changes
(edits) in at least two JournalNode
processes
• The standby NameNode reads the edits
from JournalNodes to sync up
• In BDA, three JournalNodes run on
node01 to node03

Security

Enhanced Big Data Security
Authenticate
users with secure Kerberos protocol
Authorize
access to data with fine grained controls
Audit
activity and access with Oracle Audit Vault and Database
Firewall
Encrypt
data as it flows thru the system

Hadoop Default Security Model
• Not So Secure - Easily Impersonate Users
& Groups
1 [oracle@localhost shared]# su hdfs
2 bash-3.2$ hadoop fs -rm -r /fin_data

Malicious User bash-3.2$ hadoop fs -rm -r /health_data
on Local Machine
1 Change identity on local machine to Hadoop cluster user or group that owns the
file/directory
Delete sensitive data on cluster
2

BDA Kerberos Integration
Delivers Strong Authentication
• Kerberos automatically
configured User Lookup
LDAP
• Strong authentication for
Key Distribution
– Key Hadoop services Center
– Oracle Big Data Connectors Authenticate / Hadoop Service
Get Service Ticket Registration
• Ensure users are who they
claim to be
Access Service Using Ticket
Client Key Distribution

Center (Optional)
Big Data Appliance

Link to LDAP
Enterprise User Management
• Simplify permissions
management for key Hadoop User Lookup
services LDAP
• The NameNode and Key Distribution Group Lookup

Center
JobTracker can pickup group
information from LDAP Authenticate /
Get Service Ticket
Hadoop Service
Registration
• Centrally manage permissions

for the enterprise
Access Service Using Ticket
Key Distribution
Center (Optional)
Big Data Appliance

Kerberos and Apache Sentry
First
Kerberos and Sentry enabled Hadoop
Appliance
Founding member of Apache Sentry

bringing fine fine-grained authorization to
Hadoop
Bring Oracle’s security expertise and

commitment to Apache Hadoop

Sentry Authorization Features
• Secure Authorization
– Ability to control access to data and/or privileges on data for authenticated users
• Fine-Grained Authorization
– Ability to give users access to a subset of data (e.g. column) in a database
• Role-Based Authorization
– Ability to create/apply template-based privileges based on functional roles

Example
Apply Fine Grained Access to Groups Using Roles
Admin Group
• Superuser Role
HR Database • All privileges on BDA-HQ
Employee
• Name
• Manager Company Group
• Salary
• Viewer Role
Reviews
• Name
• View Employee table’s Name
• Date & Manager columns
• Comments
Manager Group
• Supervisor Role
Server: BDA-HQ • Select from Employee &
Reviews Tables

Oracle Audit Vault and Database Firewall
One
Consolidated, secure repository for all
audit data
Hadoop Audit Vault Operating Systems Centralized platform for audit reporting,
Non-Relational Data alerting and policy management
Databases
Relational Data

Auditing Key Hadoop Services
Automatically Installed and Configured on BDA
HDFS MapReduce Hive Oozie
Who’s MR jobs Did this person

Who did what on the Who ran what as
correspond with file make database
file-system? part of a workflow?
access? changes?

Encryption at Rest and on the Network
Network
Encryption Only
Cloudera Hadoop appliance with Pre-
Configured File System and Network
Encryption
Encryption at Transparent to applications and at no
Rest extra cost

Benefits
• Securely store sensitive data in Hadoop
• Simplified setup and administration
• Provides out of the box compliance reporting
• Integrated with your existing enterprise security implementation

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. | Oracle Confidential – Internal/Restricted/Highly Restricted 70

03N-Architectural, SW and HW Overview

Încărcat de

Informații document

Drepturi de autor

Formate disponibile

Partajați acest document

Partajați sau inserați document

Opțiuni de partajare

Vi se pare util acest document?

Este necorespunzător acest conținut?

Drepturi de autor:

Formate disponibile

03N-Architectural, SW and HW Overview

Încărcat de

Drepturi de autor:

Formate disponibile

Oracle Big Data Appliance Workshop:

Introduction to Oracle Big Data Appliance

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |

Stores Looking back

Acquire Organize Analyze

• Low, predictable Latency

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |

Acquire Organize Analyze

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |

Acquire Organize Analyze

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |

Acquire Organize Analyze

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |

Sun Oracle X6-2L Servers with per server:

Included Software (4.5):

• Additional CPU capacity – 22-core (2.2GHz) Intel® Xeon® E5-2699 v4 (“Broadwell”)

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. | 15

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. | 17

Simplify Access to ALL Data

Open Analytics Platform

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. | 18

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. | 19

Full install with a single command:

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. | 20

Cluster expansion with a single command:

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. | 22

Cluster Expansion with a single command:

N Because of uniform nodes and IB networking,

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. | 23

Critical Node Failure => Primary Name Node

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. | 24

• Automatic Failover to other

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. | 25

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |

Hosts: Add/Remove hosts Events: Records a change in state or other occurrence

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |

• Hadoop Monitoring UIs at a glance

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |

Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |