Solutions for Big Data

Data Management Solutions

from SAP for Big Data
2017 SAP SE or an SAP affiliate company. All rights reserved.

1/14
Table of Contents

3 Bridging the Big Data Value Gap

6 Data Management Solutions

from SAP for Big Data

10 In-Memory Computing with SAP HANA

14 Summary

2/14

2017 SAP SE or an SAP affiliate company. All rights reserved.

Bridging the Big Data Value Gap
Big Data for the business enterprise has been a work in progress. Analysts looking for business insights
want access to both enterprise data and the massive data sets from the Internet of Things, social
media, the Web, and operational logs. Until now, their projects have faced three daunting challenges:
where to keep the data; how to process diverse, unstructured data types; and how to unify enterprise
information architecture with Big Data environments. SAP has addressed all three challenges with its
data management solutions for Big Data.

As organizations move from collecting terabytes
of data to collecting petabytes and exabytes, the
challenge of Big Data analytics has crystallized.
Whats needed now is a way to unify and process
the diverse data types to make them collectively
useful. Without this ability, all the data that is filling
siloed repositories has limited value to businesses.
With this ability, the promised insights from
360-degree views of customer behavior, operational
behavior, market behavior, and other facets of the
digital business can be more thoroughly analyzed
and understood. Experiments can be proposed.
Innovations can be introduced with greater confi-
dence. The promised returns from Big Data can
be realized.
While data collection is occurring on a massive
scale in the digital economy, there is a serious value
gap between the promise and the reality of business
intelligence and analytics. On average, 60% to 73%
of all data within an enterprise goes unused for
these activities.1 Why? Because the technology
for Big Data has had to catch up to the massive
scale and diversity of data that businesses are
collecting with increased digitalization.

1. The Forrester Wave: Big Data Hadoop Distributions, Q1 2016, Mike Gualtieri and Noel Yuhanna, Forrester Research Inc.,
January 19, 2016.

3/14

2017 SAP SE or an SAP affiliate company. All rights reserved.

Phase 1 of the journey to make Big Data useful to business
involved solving the storage challenge (see Figure 1). Today, data
lakes, data warehouses, and tiered, low-cost storage are avail-
able. They can scale to accommodate spiraling volumes of data.

Phase 2 is the need for a viable approach for processing

vastly different types of data structured, unstructured, semi-
structured, graph, time-series, JavaScript Object Notation
(JSON), and so on. Making this data useful and connecting it
to applications simplifies the handling of Big Data. It increases
the use of analytics tools by a broader array of users. Features
that address Phase 2 of the Big Data journey are now available
from SAP.

Last, Phase 3 involves unifying the data landscape. This means

merging processing engines for different data types into one
unified data pipeline across storage, compute, and analytics
solutions. Products from SAP provide this service as well.

Once all of these phases in the Big Data journey have been
addressed, the gap between the promise and reality of Big Data
analytics can be eliminated. Both IT and line-of-business
objectives can be addressed, and an end-to-end operational
model for Big Data can become a reality.

Figure 1: Phases of the Big Data Journey

Phase 1 Phase 2 Phase 3

Business
transformation

Processing

Storage

4/14
Operationalizing Big Data Analytics Addressing IT and Business Objectives

IT Objectives
Utilize the broad range of different Unify data sets from corporate, transactional, customer, and
data types across the enterprise
Do it more quickly
Ensure ongoing performance and
cost efficiencies
Establish overall data governance
and management
Solution
business process applications, and from Hadoop and other
data lakes
Accelerate processing of data to production pipelines
Solve the Big Data operational problem while balancing
the costs of adding more and more data sources
Forge cooperation between diverse data owners who dont see
value in changing processes, and gain support from senior
management who dont understand Big Data or see the ROI

Business Objectives Solution

Create insights that lead to
meaningful business impacts
Get Big Data analytics into
the hands of more people
Realize digital transformation
Combine data exploration and enterprise analytics to gain
more expansive insights from Big Data in a business context
Enable simplified access to data scientists, data engineers,
and business analytics who have worked with traditional
BI solutions
Use data to transform the business with predictive analytics,
automation, machine learning, data science, and other tools

Big Data solutions from SAP allow you to marshal

and store all data across your enterprise, quickly
go from in-production analytics to insight, and
take swift action to create business results.

5/14

2017 SAP SE or an SAP affiliate company. All rights reserved.

Data Management Solutions
from SAP for Big Data
Meet SAPs complete set of Big Data solutions. Features in the data management solutions from
These offerings allow you to marshal and store SAP for Big Data include:
all data across your enterprise, quickly go from Enterprise-ready, secure, scalable solutions
in-production analytics to insight, and take swift Tiered data storage and processing
action to create business results (see Figure 2). In-production performance and governance
In-memory processing for interactive decision
making and action
Integration with your business process applications
Cloud, on-premise, and hybrid deployment models

Figure 2: Big Data Portfolio Products from SAP

Enriching Digital Business with Frictionless Big Data: Database and Data Management Solutions from SAP
Enterprise Enterprise Analytical Custom and Data pipelines Data mining and
business business and IoT third-party Data science tools exploration Business value
applications networks applications applications
Make data universal to all
On premise and cloud analytics and applications

SAP HANA: computing services SAP Vora: distributed computing engines

Spatial Graph Machine Search OLAP Time Unified

Graph Doc store
learning series Compute and processing

Database and data management solutions from SAP

Text Streaming Series Business
analytics analytics data functions

SAP HANA: database services

Data lakes

SAP Cloud Platform

Big Data Services
Columnar Multicore and Advanced Multitenancy
OLTP+OLAP parallelization compression Elastic
Storage and persistence

S3

Multitier Data Administration High availability

storage modeling and security and disaster
recovery

SAP HANA: integration and quality services SAP solutions for EIM

Data ELT and Apache Hadoop All data

Data quality MDM Data integration
virtualization replications and open source Integrate and ingest
integration

Remote Data Data discovery and Information lifecycle

data sync quality architecture management

IoT: Internet of Things | OLAP: Online analytical processing | OLTP: Online transaction processing
ELT: Extract, load, transform | MDM: Master data management | EIM: Enterprise information management

6/14

2017 SAP SE or an SAP affiliate company. All rights reserved.

SAP VORA
SAP Vora is a distributed computing solution that
is deployed on Apache Hadoop and Spark clusters
and provides integration with the SAP HANA
platform so that you can run combined analytics
across enterprise and Hadoop data. Now you can
effectively use your Big Data and Internet of Things
insights in the context of business processes.
SAP Vora runs on Big Data clusters no proprietary
hardware is required. But it is a computing solution
separate from your Hadoop data store.
All operations in SAP Vora can be accessed, executed,
and extended through SAP HANA. So, now SAP
customers have a foundation for extending enter-
prise data to distributed Big Data environments with
data sets in the petabyte range through existing
deployments of SAP HANA. To the user, SAP HANA
and SAP Vora act as a single system, with joint query
optimization and automatic storage decisions.

A major focus of SAP Vora is to provide specialized

analytical processing for different data formats.
Multiple in-memory distributed computing engines
built into a single solution eliminate the need to
physically move data between systems for analysis.

7/14

2017 SAP SE or an SAP affiliate company. All rights reserved.

Unifying Different Data Formats As an integrated, production-ready solution with
A major focus of SAP Vora is to provide specialized enterprise-ready features, SAP Vora eliminates
analytical processing for different data formats. the need to spend time and resources stitching
Multiple in-memory distributed computing engines together multiple systems. If youre looking for
built into one single solution eliminate the need a way to simplify your IT landscape and reduce
to physically move data between systems for the complexity of working with Big Data, look no
computations and analysis. The in-memory dis- further (see Figure 3).
tributed computing engines are designed to run
high-performance sophisticated analytics against
relational, time series, graph, and JSON data.
SAP Vora empowers your organization to make
decisions in near-real time based on your entire
set of data, including different formats and from
different sources.

Figure 3: SAP Vora

Distributed computing cluster

SAP Vora SAP Vora SAP Vora

Spark Spark Spark

Files Files Files

Hadoop

Data science Predictive Business intelligence Visualization apps

SAP Vora

Data modeler

Relational Time series Graph Doc store

Disk-to-memory accelerator

Distributed transaction log

Apache Spark

Apache Hadoop

8/14

2017 SAP SE or an SAP affiliate company. All rights reserved.

Apache Spark Features
With its tight integration to Apache Spark, SAP Vora
can use any open source application and library
that runs on Spark so users dont have to switch
to new tools to use SAP Vora. Furthermore, the
extended capabilities provided by SAP Vora enhance
Spark with new enterprise features such as hier-
archies, enterprise-ready calculations, currency
conversion, and support for units.
Storage Features
A disk engine is used to optimize access to external
storage service and persistency and to process
queries too large for handling in main memory.
The engines optimization features contribute to
a significant increase in query execution perfor-
mance compared to accessing an external storage
back end for each query.
Distributed Transaction Log
A flexible joint transaction management system
provides transactional consistency for data across
all engines. A high-speed persistency service
called the distributed transaction log allows high-
throughput ingestion and low-latency transactions.
Metadata persistence is also enabled by the distri
buted transaction log that can be recovered when
needed.
Security
Enterprise-grade security is provided through
support for Kerberos-enabled Hadoop distributions
and native Hadoop Distributed File System (HDFS)
permissions that are automatically propagated
to tables when data is loaded.
9/14
User-Friendly Web Interface
SAP Vora comes with an intuitive Web interface
that provides Structured Query Language (SQL)
access to Hadoop data. It makes self-service Big
Data computing possible for more users in your
organization, including data scientists, Hadoop
developers, and even business analysts.
Business analysts can access a powerful yet simple-
to-use Web interface to rapidly turn Big Data on
Hadoop into valuable insights. Drag-and-drop func-
tionality makes it easy to rapidly create data models,
both simple and complex. With one SQL entry point
for interacting with specialized computing engines,
regardless of which SAP Vora computing engine is
used to analyze data, business analysts can always
use the familiar SQL programming language to
interact with the data. This shortens learning curves
dramatically and helps to accelerate adoption.
Data scientists, software developers, and others
with more sophisticated programming skills can
take advantage of extensive programming support
for SQL, Python, Scala, C++, and Java. SAP Vora
supports data stored in CSV, Parquet, Optimized
Row Columnar (ORC), JSON, and other formats
and a variety of storage options such as HDFS, S3,
and local le systems. This enables data scientists
and developers to design and deliver mashups from
multiple information sources.
2017 SAP SE or an SAP affiliate company. All rights reserved.
In-Memory Computing with SAP HANA
SAP HANA has been considered a revolutionary
product by the industry since it was first introduced,
ushering in a new class of real-time analytics. Its
in-memory-database design lets you analyze data
within microseconds of updates to applications
without complex layers of data management and
storage. You get answers to questions instantly. You
can run high-performance applications that make
business processes faster and leaner all without
data preparation, preaggregation, or tuning.
The in-memory architecture also features columnar
delta merge to speed processing. Online transaction
processing (OLTP) and online analytical processing
(OLAP) workload support enables single data
copying for lower total cost of ownership (TCO).
And the multiplatform architecture lets you deploy
SAP HANA on premise, on a desktop, or in the
cloud (see Figure 4).

Figure 4: SAP HANA Functions

SAP HANA platform

On premise | Cloud | Hybrid

Application services Processing services Integration and quality services

</>
Data Extract, load,
Web server JavaScript Spatial Graph Predictive Search
virtualization transform and
replication
ALM

SAP Fiori Graphic Application Text Streaming Series Business Data Apache Hadoop Remote
user modeler lifecycle analytics analytics data functions quality and Spark data sync
experience management integration
Database services

Columnar Multicore and Advanced Multitenancy Multitier Data Openness Administration High availability
OLTP and parallelization compression storage modeling and security and disaster
OLAP recovery

OLTP: Online transaction processing | OLAP: Online analytical processing

10/14

2017 SAP SE or an SAP affiliate company. All rights reserved.

ADVANCED ANALYTICS
The solutions integrated, multimodal advanced
analytics lets you converge multiple complex
analytic processing tasks without data movement
or duplication. Native multimodal SQL supports
machine learning, search, text, spatial, graph,
series, and streaming for better decision making
with in-the-moment advanced analytics and root
cause analysis.
SAP CLOUD PLATFORM BIG DATA SERVICES
SAP Cloud Platform Big Data Services offer a
Hadoop-as-a-service computing solution in the
cloud. For enterprises that dont have the staff,
budget, or desire to deploy and manage their own
Hadoop environment, SAP Cloud Platform Big Data
Services provide a scalable, cloud-based Hadoop
data store, Spark complement, and processing
engine for SAP Vora. SAP Vora is also available from
Amazon Web Services (AWS). It can be ordered
from the AWS Marketplace and is available for use
with community support. Use Hadoop in the cloud
to process much larger volumes of data at a lower
price, handle structured and unstructured data
storage and processing, and scale volumes quickly
and easily in a cloud environment (see Figure 5).

Figure 5: SAP Cloud Platform Big Data Services

Workbench

Search Data science Custom

Business analytics Data exploration
and discovery and modeling applications
Data transfer

Proactive help desk

SAP Vora

Apache Hadoop Apache Spark

Portal

Unified control plane

Automated operations center

Data centers optimized for Hadoop

11/14

2017 SAP SE or an SAP affiliate company. All rights reserved.

Performance and Scale
Unlike Big Data services provided by public cloud
providers that sell infrastructure as a service (IaaS),
SAP Cloud Platform Big Data Services have Hadoop-
and Spark-optimized data centers, and full opera-
tional services are included with every subscription.
These features have been shown to deliver perfor-
mance that is 10 times faster than popular IaaS
services. We want SAP customers to be able to focus
on driving Big Data results instead of dealing with
challenging Hadoop operations that require a large,
highly skilled, dedicated team.
A Big Data platform in the cloud plus Hadoop opera-
tions services lowers the cost of running Hadoop
on premise or using an IaaS provider due to faster
job processing, lower job failure rates, and consis-
tent operational performance. Automated compute
bursting ensures that your implementation will
automatically scale to meet sudden increases
in compute needs.
Setup in Hours Instead of Months
SAP Cloud Platform Big Data Services boast
a speedy setup as well. Need a terabyte-scale
Hadoop and Spark platform? Well have it ready
to go in hours instead of the many months it
would take you to purchase network hardware,
integrate software, and hire a Hadoop team.
Integration into the SAP Software Landscape
An integral part of SAP Cloud Platform Big Data
Services, SAP Vora provides distributed calculation
capabilities such as relational processing, graph,
time series, and document processing. Through
SAP Vora you get easy consumption and integration
of SAP landscapes, tools, and data in SAP HANA.
SAP SOLUTIONS FOR ENTERPRISE
INFORMATION MANAGEMENT
SAP solutions for enterprise information man-
agement (EIM) include a variety of sophisticated
products that support data integration, manage-
ment, association, archiving, and other activities.
Supported functions are shown in Figure 6.

Figure 6: Support from SAP for Comprehensive Enterprise Information Management

SE AND MONIT
EAN OR
CL

Before After
E

A
M
AT

AN

D B
GR

Data quality
AG
INTE

C
E

Master data
management
Data integration

GOVERN
P
UN D

TE

Data X
CIA

discovery and
ER

Content
architecture
management
ST

SO
AN

AS

Information lifecycle
D

management

A R CH IV E

12/14

2017 SAP SE or an SAP affiliate company. All rights reserved.

SAP Information Steward and SAP PowerDesigner
software help you understand what data exists
within the enterprise, and the relationship of this
data to data in other systems. SAP Data Services
software, the SAP Agile Data Preparation applica-
tion, SAP HANA smart data integration software,
SAP Replication Server, SAP Event Stream Pro-
cessor, SAP Landscape Transformation software,
and the SAP Advanced Data Migration application
by BackOffice Associates all help you integrate
data from different sources. As part of the data
management solutions from SAP for Big Data,
SAP Data Services is an option for data ingestion into
Hadoop enterprise data lakes; and the integration
of existing flows in SAP Data Services is part of
the data flow pipeline in SAP Vora. This allows for
the flexible combination of various data pipes
with managed data flows.
The SAP Master Data Governance application and
SAP Master Data Governance, enterprise asset man-
agement extension by Utopia, help you create
a single version of company records.
The SAP Extended Enterprise Content Management
application by OpenText and SAP Invoice Manage-
ment application by OpenText help you manage all
of your structured and unstructured content.
The SAP Information Lifecycle Management com-
ponent helps you archive your data into a backup
environment in a systematic and organized manner
to free capacity in your enterprise data warehouse
or your live system.

SAP Data Services, SAP Agile Data Preparation,

SAP HANA smart data quality software, and the
SAP Information Steward Accelerator application
by BackOffice Associates help you clean your data
and monitor its health.

Data management solutions from SAP for Big Data

are designed to help you simplify your IT landscape,
reduce the complexity of working with Big Data, and
make a Hadoop and Spark Big Data analytics environment
easier and more accessible as a cloud service.

13/14

2017 SAP SE or an SAP affiliate company. All rights reserved.

Summary
Data management solutions from SAP for Big Data
are designed to help you simplify your IT landscape,
reduce the complexity of working with Big Data, and
make a Hadoop and Spark Big Data analytics envi-
ronment easier and more accessible as a cloud
service. It includes tightly integrated products and
an optional Big Data cloud infrastructure that let
businesses like yours take advantage of distributed
storage and the processing of very large data sets.
SAP Vora, SAP HANA, and SAP Cloud Platform
Big Data Services complement each other. They
provide an in-memory computing solution for the
enterprise plus a scalable Hadoop data store as
a cloud service that doubles as a Spark complement
and a processing engine for SAP Vora.
The computing engines in SAP Vora process multi-
ple data types from a wide variety of sources and
different formats within your business, including
SAP HANA and SAP software landscapes, and make
the data available to run directly on Hadoop. Building
on the functionality of Apache Spark, all of your
data can now be included in interactive Big Data
analytics applications.
SAP Cloud Platform Big Data Services make
available the Hadoop environment from SAP as
a Hadoop-as-a-service option in the cloud. This
is an attractive choice for businesses that dont
want to build and support a Hadoop infrastructure
themselves. The service includes a Big Data
processing platform with Spark. SAP Vora provides
the SQL analytical layer on top, with access to the
SAP world of landscapes, applications, tools, and
data in SAP HANA.
14/14
Data management solutions from SAP for Big Data
are designed to provide an array of features with an
emphasis on data replication and data governance
capabilities. They allow you to load, cleanse, and
transform a wide variety of data types for use in
SAP HANA, SAP Vora, and SAP Cloud Platform
Big Data Services. Within SAP solutions for EIM,
SAP Data Services is an option for data ingestion.
The Big Data journey has now reached its desti-
nation with a comprehensive operational solution for
data gathering, storage, processing, and networking
from SAP. The products deliver tremendous
benefits:
Processing engines for diverse data types to
make data in different formats useful for
analysis
Unification of enterprise application data and
Big Data into one data pipeline to feed analytics
solutions
Much faster analytical processing at a lower
TCO than public cloud provider IaaS offerings
Massive scalability and petabyte capacity
Are you ready to go from Big Data gathering to
actionable insights to business results? Let us
show you how.
FIND OUT MORE
For more information about data management
solutions from SAP for Big Data, contact your SAP
representative or visit us at www.sap.com/vora
or https://www.sap.com/products/technology
-platforms/big-data-hadoop.html.
2017 SAP SE or an SAP affiliate company. All rights reserved.
 www.sap.com/contactsap

Studio SAP | 50959enUS (17/05)

2017 SAP SE or an SAP affiliate company. All rights reserved.

No part of this publication may be reproduced or transmitted in any

form or for any purpose without the express permission of SAP SE or
an SAP affiliate company.

The information contained herein may be changed without prior notice.

Some software products marketed by SAP SE and its distributors
contain proprietary software components of other software vendors.
National product specifications may vary.

These materials are provided by SAP SE or an SAP affiliate company for

informational purposes only, without representation or warranty of any
kind, and SAP or its affiliated companies shall not be liable for errors or
omissions with respect to the materials. The only warranties for SAP or
SAP affiliate company products and services are those that are set forth
in the express warranty statements accompanying such products and
services, if any. Nothing herein should be construed as constituting an
additional warranty.

In particular, SAP SE or its affiliated companies have no obligation to

pursue any course of business outlined in this document or any related
presentation, or to develop or release any functionality mentioned therein.
This document, or any related presentation, and SAP SEs or its affiliated
companies strategy and possible future developments, products, and/or
platform directions and functionality are all subject to change and may be
changed by SAP SE or its affiliated companies at any time for any reason
without notice. The information in this document is not a commitment,
promise, or legal obligation to deliver any material, code, or functionality.
All forward-looking statements are subject to various risks and
uncertainties that could cause actual results to differ materially from
expectations. Readers are cautioned not to place undue reliance on these
forward-looking statements, and they should not be relied upon in making
purchasing decisions.

SAP and other SAP products and services mentioned herein as well as
their respective logos are trademarks or registered trademarks of SAP SE
(or an SAP affiliate company) in Germany and other countries. All other
product and service names mentioned are the trademarks of their
respective companies.

See http://www.sap.com/corporate-en/legal/copyright/index.epx for

additional trademark information and notices.