The Storage Evolution PDF

EDUCATION
The Storage Evolution:

From Blocks, Files and Objects
to Object Storage Systems
Christian Bandulet, Sun Microsystems
SNIA Legal Notice
EDUCATION
• The material contained in this tutorial is

copyrighted by the SNIA.
• Member companies and individuals may use this
material in presentations and literature under the
following conditions:
– Any slide or slides used must be reproduced without
modification
– The SNIA must be acknowledged as source of any
material used in the body of any document containing
material from these presentations.
• This presentation is a project of the SNIA
Education Committee.
The Storage Evolution: From Blocks, Files and Objects to Object Storage Systems
© 2007 Storage Networking Industry Association. All Rights Reserved. 2
Abstract EDUCATION
The Storage Evolution: From Blocks, Files and

Objects to Object Storage Systems
This session will appeal to CIOs, CTOs, Consultants, System
Architects and Technologists, and those that are seeking a
fundamental understanding of the emerging object-based
storage technologies. The audience will gain insight into the
basic differences of block-, file- and object-based data access
methods. The session will delve into the benefits of object
storage and it's value and also outline how this technology might
impact future directions of storage system architectures.
Topics
EDUCATION
• Block-Based Data Access

• File-Based Data Access
• Object-Based Data Access
– Object-Based Storage Devices (OSD)
– Object Storage Systems
• Object Storage Server (OSS)
• Content Addressable Storage (CAS)
• Content Aware Storage (CAS)
• Intelligent Storage Nodes (ISN)
Topics
EDUCATION

The Data Access Taxonomy
EDUCATION
Data
Access
Block ? ?
SCSI, SAS,
FCP, iSCSI,
SRP, ATA
SATA
The Block Paradigm
EDUCATION
SCSI, SAS, FCP, SRP, iSCSI, ATA, SATA
Client Interface
0 1 2 3 4
5 6 7 8 9
10 11 12 13 14 Physical Blocks:
e.g. 512 bytes
15 16 17 18 19
Topics
EDUCATION

EDUCATION
Check out
Data SNIA Tutorial:
Access Advanced
Data Sharing
Block ? File
SCSI, SAS, Local FS,
FCP, iSCSI, Distributed FS:
SRP, ATA (NFS, CIFS, WAFS)
SATA Shared FS:
(Cluster FS, SAN FS)
Global, Distributed
& Parallel FS
Local File Systems
One more level of indirection EDUCATION
Application Server
• file/directory
management(~10%
of workload) File system structure
Data
• block/sector (i.e. inodes)
management (~90% Mapping
of workload)
Physical Disk
1 1 1 1
0 1 2 3 4 5 6 7 8 9
0 1 2 3
Logical Blocks on Disk
0 1 2 3 4
5 6 7 8 9
10 11 12 13 14 Physical Blocks on Disk
1516 1617 1718 1819 1920
Distributed File Systems
e.g. NAS with NFS,CIFS Protocol EDUCATION
Application Server Application Server Application Server Application Server Application Server Application Server
IP
NAS Appliance Leaving block

Might become management (i.e.
a bottleneck – hard 90% to dedicated
to scale. NAS appliance
Data results in lean
clients!
SAN
VDISK
Disk Array Disk Array Disk Array Disk Array
Physical Disk Physical Disk Physical Disk Physical Disk Physical Disk Physical Disk Physical Disk Physical Disk
11 12 13 1 11 12 13 1 11 12 13 1 11 12 13 1 11 12 13 1 11 12 13 1 11 12 13 1 11 12 13 1
11 12 13 1 11 12 13 1 11 12 13 1 11 12 13 1 11 12 13 1 11 12 13 1 11 12 13 1 11 12 13 1
NAS Aggregation/Virtualization
Global Namespace EDUCATION
Why should accessing and scaling file storage be any different in enterprises?
N
A
S N
A
S
NAS Aggregation
Global Namespace EDUCATION
IP
Provides NAS Router

Global
Namespace
Data
NAS
NASAppliance
Appliance NAS Appliance NAS Appliance NAS Appliance NAS Appliance
Data Data Data Data Data
SAN SAN SAN SAN SAN
Global Namespace
NAS Cluster
aka Tightly Coupled NAS EDUCATION
Virtual
IP Address
System Area System Area

NAS Appliance NAS Appliance NAS Appliance NAS Appliance
Network Network
Data Data Data Data
SAN
Single Data Image

Parallel File System
Global Namespace
Scalable NAS
aka Loosely Coupled NAS
Global Namespace with NFSv4.1 and pNFS EDUCATION
In-Band NAS: Out-of-Band NAS:

Application Server
Application Server Application Server
Application Server
IP
Storage Protocol: IP
SCSI, NFS, OSD
NAS Appliance NAS Appliance
with NFSv4.1
pNFS extensions
Data
Data
SAN SAN
Storage Storage
Device Device
Scalable NAS
© 2007 Storage Networking Industry Association. All Rights Reserved. Loosely Coupled NAS Cluster 15
Topics
EDUCATION

EDUCATION
Data
Access
Block Object File

SCSI, SAS, OSD Local FS,
FCP, iSCSI, CAS Distributed FS:
SRP, ATA OSS (NFS, CIFS, WAFS)
SATA Shared FS:
(Cluster FS, SAN FS)
Global, Distributed
& Parallel FS
The Old Block Paradigm
EDUCATION
Write Block # Read Block #

Write Block # Status Read Block #
Write Block #
Return 0 Read Block # Data
Store Retrieve
0 1 2 3 4 0 1 2 3 4
5 6 7 8 9 5 6 7 8 9
10 11 12 13 14 10 11 12 13 14
15 16 17 18 19 15 16 17 18 19
The New Object Paradigm
EDUCATION
Data OID OID Data
Store Retrieve
Object Object
The New Object Paradigm
(cont'd) EDUCATION
• WRITE 26,763 Bytes

• QoS = High Data OID
• Description = “X-Ray”
• Retention = 50 years
Store
• Access Key = *&^%#
• Data Payload........
● Object Storage Responsibilities:

● Space Management
● Access Control (Identity Mgmt)
Object ● QoS Management
● Cache, Backup
● Policy Migration, Retention
Self-Contained Objects
EDUCATION
Object
OID
Metadata Object Object
Object
Data
Object
Object
Object
Attributes
Object Object
Metadata:
creation date/time; ownership, size...
Attributes – inferred:
access patterns, content, indexes...
Attributes – user supplied:
retention, QoS...
The Storage Evolution: From Blocks, Files and Objects to Object Storage Systems self-contained snail
Block Access - Inodes
EDUCATION
• The inode contains a few block numbers to ensure efficient access

to small files. Access to larger files is provided via indirect blocks Data Blocks
that contain block numbers Inode Host
direct 0 data block
direct 1 data block
direct 2 data block
direct 3 data block
direct 4 data block
direct 5 data block
direct 6 data block
direct 7 data block
direct 8 data block
0 1 2 3 4 direct 9 data block
single data block
5 6 7 8 9 indirect
data block
double
10 11 12 13 14 indirect data block
triple
15 16 17 18 19 indirect
Block Access – Inodes (cont'd)
EDUCATION
• The inode also contains file attributes...

Data Blocks
Inode Host
direct 0 data block
direct 1 data block
direct 2 data block
direct 3 data block
direct 4 data block
direct 5 data block
direct 6 data block
direct 7 data block
direct 8 data block
0 1 2 3 4 direct 9 data block
single data block
5 6 7 8 9 indirect
data block
double
10 11 12 13 14 indirect data block
triple
15 16 17 18 19 indirect
File Owner
File Type
Permissions
Last Access
File Attributes: .
.
.
Size
The Storage Evolution: From Blocks, Files and Objects to Object Storage
# of links Systems
Inodes vs. Objects
EDUCATION
Host Host
FileiSCSI
System FileiSCSI
System
Object
iSCSIIDs
Inodes:
Block Pointers
File Attributes
Objects:
Block Pointers
Object Attributes
1 2 3 4 1 2 4
5 5 6 8 5 3
6
Block Device Object Device

Object Autonomy
EDUCATION
Storage becomes autonomous:

Host Host
– capacity planning
FileiSCSI
System FileiSCSI
System
– load balancing
Object
iSCSIIDs – backup
– QoS, SLAs
– understand data/object grouping
Inodes: – aggressive pre-fetching
Block Pointers – thin provisioning
File Attributes Objects: – search
Block Pointers – compression/de-
Object Attributes
duplication/encryption
– strong security
– compliance/retention/secure
1 2 3 4 1 4 delete
2
– availability/replication
5 3 – audit
5 5 6 8
6 .
.
Block Device Object Device .
Data Sharing
Homogeneous/Heterogeneous EDUCATION
Host Host Host Host

FileiSCSI
System FileiSCSI
System FileiSCSI
System FileiSCSI
System
Object
iSCSIIDs Object
iSCSIIDs
Inodes: Inodes:
Block Pointers Block Pointers
File Attributes File Attributes
Objects:
Block Pointers
Object Attributes
heavy duty
Cluster/SAN
1 2 3 4 file system 1 2 4
5 5 6 8 5 3
6
Block Device
The Storage Evolution: From Blocks, Files and Objects to Object Storage Systems Object Device
Data Migration - ILM
Homogeneous/Heterogeneous EDUCATION
Host OID Host OID Host OID

FileiSCSI
System
Object
iSCSIIDs
FileiSCSI
System
Object
iSCSIIDs
FileiSCSI
System
Object
iSCSIIDs
...
Objects: Objects: Objects:

Block Pointers Block Pointers Block Pointers
Object Attributes Object Attributes Object Attributes
Object Object Object

...
1 2 4 1 2 4 1 2 4
5 3 5 3 5 3
6 6 6
Object Device Object Device Object Device

Additional Layer of Security
EDUCATION
Host
iSCSI Host
• strong security via

external service
– authentication
– authorization
1 2 3 4 1 2 4 – NIS, LDAP....
5 3 • fine granularity
5 5 6 8
6 – per object
Block Device
The Storage Evolution: From Blocks, Files and Objects to Object Storage Systems Object Device
Living in a Flat Namespace
EDUCATION
File names / inodes Objects / OIDs
0 1 2 3 4 Object
Object Object
5 6 7 8 9
Object
10 11 12 13 14 Object
15 16 17 18 19 Object
Object
Object
Traditional Flat
Hierarchical
Object Decomposition
EDUCATION
MDS
OID OID:Layout
OID:Layout
Layout OID:Layout
OID:Layout
OID:Layout
OID:Layout
OID:Layout
OSD OSD OSD OSD
Object Object Object Object

Component Component Component Component
Object Layout
Multiple Referenced Objects
EDUCATION
Metadata Record
Metadata Record OID
iSCSI
W
OID
iSCSI
Z
Employeee
iSCSI ID
Patient
iSCSIID
Job
iSCSI
Level
Examination
iSCSI
Salary
iSCSI
iSCSI
Date
Stock
iSCSI
Options
Diagnose
iSCSI
Department
iSCSI
Therapy
iSCSI
LinkiSCSI
to OID X
LinkiSCSI
to OID X
Reference 1
Metadata Record Reference 2
OID
iSCSI
Y
Customer
iSCSI ID
Preferences
iSCSI
Next
iSCSI
Store
Object
Revenue
iSCSI Data
Credit
iSCSI
History
LinkiSCSI
to OID X Reference 3
Virtual View / Virtual File Systems
EDUCATION
Metadata Record
Object Object Object
... Object Object
Virtual View
iSCSI Virtual FS
Metadata Record Virtual View

iSCSI Virtual FS
Metadata Record Virtual View

iSCSI Virtual FS
Virtual View / Virtual File Systems
(cont'd) EDUCATION
Virtual View A Virtual View B
File names / inodes

Objects / OIDs
0 1 2 3 4 Object
Object
Object Object
Object Object
5 6 7 8 9
Object
Object
10 11 12 13 14 Object
Object
15 16 17 18 19 Object
Object
Object
Object
Object
Object
Traditional Flat Virtual

Topics
EDUCATION

• Content Aware Storage (CAS) Check out
• Intelligent Storage Nodes (ISN) SNIA Tutorial:
Object-based
Storage
Devices
NASD
Network Attached Secure Device EDUCATION
NASD
NAS Appliance
Data
• bring the whole functionality of a NAS device down to a SCSI devices

The World of Standards
EDUCATION
Internet Society
www.isoc.org Check out American National
Standards Institute IEEE
SNIA Tutorial: (ANSI)
Internet Engineering Storage
Task Force Networking
(www.ietf.org) Standards
International Etherne
Committee t
for Information
IP-Based Storage Technology
Work Group (INCITS**)
FCIP, iFCP, T11

mFCP, T3 T10
T1 SCSI, FC, HIPPI,
iSCSI,iSNS Sonet ATA, IPI,
SNMP and ATAPI SAS,
SSA, ALU FICON
MIBs
OSD**,
SRP*
Note*SRP: SCSI RDMA Protocol
Note**OSD: Object-based Storage Devices T13
S-ATA
Note*** INCITS – formerly National Committee for Information Technology Standards (NCITS)
ANSI T10 OSD SCSI Targets
EDUCATION
Host Host
FileiSCSI
System FileiSCSI
System
iSCSIIDs
Object iSCSIIDs
Object
SAS,FCP, iSCSI...
Disk Array
OSD SCSI Controller OSD SCSI Controller
Object
Object Object
Object
Object
Object
Object
Object
Topics
EDUCATION

Object Storage Server - OSS
EDUCATION
Host
FileiSCSI
System
iSCSIIDs
Object
Object Interface
File System
OS (BSD, Solaris, Linux, Windows..)
Block Back-End Device Driver
OSS could be a migration path to provide object technologies to legacy block devices
Topics
EDUCATION

Content Addressable Storage
(CAS) EDUCATION
• OIDs are hash values derived from the objects' content

• Used as digital archive systems for long-term fixed content data
• ECM applications used as data injection machines
Proprietary Object API , XAM, WebDAV, NFS, FTP, CIFS...
Database
File system
OS (BSD, Solaris, Linux...)
RAIN
Redundant Array of Inexpensive/Independent Nodes EDUCATION
CAS CAS CAS

Database Database Database
File system File system File system
OS (BSD, Solaris, Linux...) OS (BSD, Solaris, Linux...) OS (BSD, Solaris, Linux...)
CAS CAS CAS

CAS CAS CAS

Single Data Image
Data Placement
EDUCATION
Object 1 Node Node Node Node
Node Node Node Node
= Data
= Parity
Archiving vs Protection
EDUCATION
• Data Protection is about Data • Data Archiving is about Data

Recovery Discovery – Archiving requires
– e.g. RAID, snapshot, replication,
data protection
backup... – e.g. index, search, aggregate
Archiving: allow near instantaneous retrieval of images,

and do it at tape-like prices
The New Challenges
EDUCATION
• Fast store and retrieval

• Availability
• Reliability
• Easiness to store, organize, retrieve and dispose New!
• Complex data operations New!

– aggregate, join, view, sort, convert, encrypt... New!
• Enhanced search operations New!

• Flexibility to present data New!
• Customized storage behavior New!
• Reduced administration costs New!
Topics
EDUCATION

CAS: “Content Addressable
Storage” EDUCATION
1100010110101111000
Object ID
Enterprise Content Management

Injection Engine
CAS: “Content Aware
Storage” EDUCATION
1100010110101111000
Object ID
Extensible Metadata
MD/Content Search
StorLets
Enterprise Content Management

Injection Engine
Content Aware Storage
Flexibility EDUCATION
• user-developed trigger apps

• synchronous:
Data OID OID Data
– modify the behavior of
store/retrieve/query/delete
Store Retrieve
– e.g. transcode,
downsample, filter,
watermark, extract
Input Procedure 1 Output Procedure x
.. metadata from file,
Input Procedure 2
.. . headers, encrypt, audit
Asynchronous Procedure C
Asynchronous Procedure D
Asynchronous Procedure C
Asynchronous Procedure D
Asynchronous Procedure A
Asynchronous Procedure B
Asynchronous Procedure A
Asynchronous Procedure B
. Output Procedure 2 log...

Input Procedure x Output Procedure 1
• Asynchronous:
– process data at rest
Object Object – e.g. capacity optimization,
scrubbing, migration,
sanity check...
Topics
EDUCATION

The Evolution of Data
Processing EDUCATION
Knowledge/
Information
Management
Content
Management
semantics,
Data heuristic,
Management learning,
problem-solving...
Storage ILM, QoS, SLA,
Management content/full text
search,
content aware
data services: processing...
volume mgmt
mirror, replication
configuration, snapshot, backup,
topology, DR...
RAID...
The Active Digital Archive
Archival Process Flow View EDUCATION
Access Control/
Data Classification/
Data Encoding /
Creation Triage
Signature gen
Pool / Tiered Compression /

DeDup
Migration Encryption
Data Secure
Expiration ...... Deletion
Note:
•Some steps can be done more than once
•Not all steps are needed
•Some steps can not be done out of order
Storage Applications
EDUCATION
Continuous
Data Sanity
Global Protection Check
File
Systems
NAS
Tiered Data
Storage Compression
Capacity
Optimization
Replication
Data
Migration
Data
Archiving & Encryption
Backup Virtual
Content Tape
Addressable Services
Storage
Migration of Storage
Applications EDUCATION
• Process the data where it lives...
Continuous
Data Sanity
Server
Global Protection Check
File
Systems
NAS
Tiered Data
Storage Compression
Capacity
Optimization
Replication
Data
Migration
Network
Data
Archivin Encryption
g& Virtual
Backup Content Tape
Addressable Services
Storage
Storage
The Evolution of Storage
EDUCATION
Application Application Application Application Application
File System File System
Storage File System Object API Object API
Storage Storage File System Intelligence
Storage File System
Storage
DAS SAN NAS OSD ISD*

© 2007 Storage Networking Industry Association. All Rights Reserved.
Note*: Intelligent Storage Node
55
The Vertical Consolidation
EDUCATION
• Storage and server

• Migration of data processing applications
• No I/O is best I/O
Server
Server
Server
Server
Storver
Storage
Storage
Storage
Storage
The Intelligent Storage Node
EDUCATION
Presentation Layer (Storage Personality)

Block I/F File I/F Object I/F
SCSI, FCP, iSCSI, SAS, FTP, NFS, CIFS, API, ANSI T10 OSD,
SRP, SATA, VTL ... WebDAV, HTTP... CAS, XAM... External Services
LDAP
Storage Application Layer ( Data Services) NIS
Data Management Compliance Services Scheduled Services
Backup, Classification, De-Duplication,
Active Directory
WORM, Audit, Retention,
Data Mining, Application Secure Deletion... Hash Generation,
Acceleration, Aggregation, Verification, NTP
Virtualization, Snapshot, Replication...
Sort, Views, Search, MDS
Indexing, Data Movers, Global Namespace
Distributed Namespace...
others
Operating System
Files systems, HSM, Device Drivers, Clustering, Security....
Persistent Storage
Disk, Tap, Library...
Further Reference
EDUCATION
• http://www.snia.org/tech_activities/workgroups
• http://www.snia.org/apps/org/workgroup/osd/
• http://www.snia.org/apps/org/workgroup/fcastwg/
• http://www.snia-dmf.org/
• http://www.t10.org/ftp/t10/drafts/osd
• http://www.t10.org/ftp/t10/drafts/osd2
• http://ietf.org/html.charters/webdav-charter.html
• http://ietf.org/html.charters/nfsv4-charter.html
• http://www.snia.org/education/tutorials/
Q&A / Feedback
EDUCATION
• Please send any questions or comments on this presentation to

SNIA: trackstorage@snia.org
Many thanks to the following individuals

for their contributions to this tutorial.
SNIA Education Committee
Christian Bandulet, Sun Microsystems
EDUCATION
Appendix
The SNIA Shared Storage Model EDUCATION
Application
File/record layer
Storage domain
Database File system

(dbms) (FS)
Services
Host
Network
Block
aggregation Device
Storage devices (disks, …)
Block layer
Disk Drive Anatomy
EDUCATION
Sector
Tracks (cylinders) • Average Disk Metrics:
– Capacity (36/72/146/300/400/500
GB...)
– Rotation Speed(7200/10,000
Platter /15,000 RPM)
– Seek time (3 to 9 msec)
– Sustained internal data transfer
Coil rate (60 to 130 MB/s)
– IOPS (200 – 300)
– Cache (1MB-16MB)
Interface:
SCSI, SAS, FCP, SRP
iSCSI, ATA/SATA Actuator Arm
w/ Read/Write Head(s)
Technology Improvements
EDUCATION
~1956 first spinning hard drive (IBM RAMAC)

1956: 5 MB – 2000 bits/in2
2006: 500 GB ~ 200 Gb/in2
100.000.000 x areal density

100.000 x capacity
Improvement in 50 years !
Magnetic Disk Recording
Longitudinal Recording EDUCATION
• Technology is ~50 years old!

• First introduced with IBM
RAMAC 5MB in 1956
• areal density increases 100% /
year since early 1990s
• Disk areal density progress
slowed down in 2003 as
recording challenges appeared
Source: www.horison.com
Blocks, Sectors, Tracks
Magnetic Disk Recording
Perpendicular/Vertical Recording EDUCATION
• Expected to delay
Superparamagnetic Effect,
not eliminate it...
Source: www.horison.com
Logical Blocks & Physical Blocks
Let's have a closer look.... EDUCATION
SCSI, SAS, FCP, SRP, iSCSI, ATA, SATA
Client Interface
1 1 1 1
Logical Blocks 0 1 2 3 4 5 6 7 8 9
0 1 2 3
Mapping 0 1 2 3 4
5 6 7 8 9
Physical Blocks 10 11 12 13 14
1516 1617 1718 19
18 1920
Scalable NAS (cont’d)
aka Loosely Coupled NAS
Global Namespace with NFSv4.1 and pNFS EDUCATION
NFSv4.1 client NFSv4.1 client NFSv4.1 client

with pNFS with pNFS w/o pNFS
NFSv4.1
Storage Protocol:
SCSI, NFS, OSD NFSv4.1 + pNFS
NAS Appliance
File: NFSv4.1 NAS
with Appliance
NFSv4.1
Block: iSCSI, FCP
OSD
pNFSwith NFSv4.1
extensions
pNFS extensions
MDS creates
Global
Data
Namespace
Data
Storage Storage Storage Storage
Device Device Device Device
Control Protocol
one-to-one, stripe, concatenation
Global Namespace
SCSI Standards Architecture
EDUCATION
Source: www.t10.org
Files Sharing with OSDs
EDUCATION
1. request OID layout from MDS

Application 2. request credential from security mgr
Application
Application 3. authentication
Application
4. request capabilities from policy mgr
User VFS 5. return credential
VFS
Kernel VFS NIS, Kerberos,
6. Send SCSI CDB
VFS osdfs LDAP... RAID
osdfs Authentication (optional)
osdfs
osdfsOSD Initiator
OSD Initiator 3
OSD
OSD Initiator 1 MDS OSD
OS
OSD Initiator so MDS OSD
OS
OSD
OS
so
so OS D D
OSD
so SCSI driver Security OSDD
Security D OSDTarget
OSD
Target
SCSI driver 5 Manager OSD Target
SCSI driver 2 Manager OSD Target
SCSI driveriSCSI Policy 4 OSD TargetiSCSI
iSCSI Policy iSCSI
iSCSI iSCSI
Manager iSCSI
iSCSI TPC/IP Manager iSCSI TPC/IP
TPC/IP User TPC/IP
TPC/IP TPC/IP
Kernel TPC/IP TPC/IP
TPC/IP TPC/IP TPC/IP
6
Ethernet
Global, Distributed & Parallel FS
With Object Storage Server (OSS) EDUCATION

Application Server
Ethernet, IB, IP MDS

Myrinet, Quadrics...
Object Storage Object Storage Object Storage

Server Server Server
SAN
Storage Storage Storage

Device Device Device
Single Data Image

Content Addressable/Aware Storage
aka CAS EDUCATION
• OIDs are hash values derived from the objects’ content

• Objective:
– Store large amounts of data reliably for long periods of time with fast access time
to retrieve data
• Target applications:
– Homeland security, Satellite imagery, Digital asset management, Medical
imaging, Digital photo services, Seismic data archival, Regulatory compliance,
Media preservation
• Not used for:
– Online Transaction Processing (OLTP), Enterprise Resource Planning (ERP),
Live database, Small scale file sharing
The Digital Archive Problem
EDUCATION
• How do you store and organize 100 million things?

• Issues of:
– Scale Performance
• capacity/workload balancing
? • automatic capacity expansion

– Organize data
• manage metadata
– Search
– Reliability/Availability
• data rebuild and/or failover
– Cost (OPEX/CAPEX/TCO)
© 2007 Storage Networking Industry Association. All Rights Reserved.
– Technology refresh
72
Attribute Awareness EDUCATION
• Object attributes are stored directly with data object by the application
• Attributes are carried automatically between layers and across devices
• When objects pass through a certain system layer or device, that layer can act on the values in
the attributes that it understands
• All other attributes are passed along unmodified and not acted upon
• e.g. Objects marked as high-reliability can be treated differently than objects marked as
temporary
• Attributes should be dynamically changeable
Layer 3 Attributes Layer 0 Attributes Layer 1 Attributes Layer 2 Attributes Layer 3
Object Discovery EDUCATION
• Searchable metadata
• Name-value based
– OID
– Metadata
Object
– user derived attributes
OID
• Content Metadata
– full text search Data

Attributes
Growing Storage Computation
EDUCATION
• Database acceleration via offloading

– health check, multi-level security, db reorganization, image copies, HSM, data mining...
• Business Continuity, Backup, Recovery, D2D2T, CDP...
• Data Reduction
– Classification, essential vs non essential, single instance, compression...
• Security
– Authentication, authorization, encryption
• Data Transformation
• Multiple Data Views
– workflow
• Real-time Data Analytics
– indexing, search, sort, aggregation
• Business Management
– Data Life Cycle, migration, compliance

The Storage Evolution PDF

Încărcat de

Informații document

Titlu original

Drepturi de autor

Formate disponibile

Partajați acest document

Partajați sau inserați document

Opțiuni de partajare

Vi se pare util acest document?

Este necorespunzător acest conținut?

Drepturi de autor:

Formate disponibile

The Storage Evolution PDF

Încărcat de

Drepturi de autor:

Formate disponibile

EDUCATION

The Storage Evolution:

• The material contained in this tutorial is

The Storage Evolution: From Blocks, Files and

• Block-Based Data Access

• Block-Based Data Access

SCSI, SAS, FCP, SRP, iSCSI, ATA, SATA

• Block-Based Data Access

NAS Appliance Leaving block

Provides NAS Router

Data Data Data Data Data

SAN SAN SAN SAN SAN

System Area System Area

Data Data Data Data

Single Data Image

In-Band NAS: Out-of-Band NAS:

• Block-Based Data Access

Block Object File

Write Block # Read Block #

Data OID OID Data

• WRITE 26,763 Bytes

● Object Storage Responsibilities:

• The inode contains a few block numbers to ensure efficient access

• The inode also contains file attributes...

Block Device Object Device

Storage becomes autonomous:

Host Host Host Host

Host OID Host OID Host OID

Objects: Objects: Objects:

Object Object Object

Object Device Object Device Object Device

• strong security via

File names / inodes Objects / OIDs

OSD OSD OSD OSD

Object Object Object Object

Metadata Record Virtual View

Metadata Record Virtual View

Virtual View A Virtual View B

File names / inodes

Traditional Flat Virtual

• Block-Based Data Access

• bring the whole functionality of a NAS device down to a SCSI devices

FCIP, iFCP, T11

• Block-Based Data Access

• Block-Based Data Access

• OIDs are hash values derived from the objects' content

Proprietary Object API , XAM, WebDAV, NFS, FTP, CIFS...

CAS CAS CAS

CAS CAS CAS

CAS CAS CAS

Single Data Image

Object 1 Node Node Node Node

Object 2 Node Node Node Node

Object 3 Node Node Node Node

Node Node Node Node

• Data Protection is about Data • Data Archiving is about Data

Archiving: allow near instantaneous retrieval of images,

• Fast store and retrieval

• Complex data operations New!

• Enhanced search operations New!

• Reduced administration costs New!

• Block-Based Data Access

Enterprise Content Management