Sunteți pe pagina 1din 66

Host and Storage System Environment

Chapter 2

2009 EMC Corporation. All rights reserved.

Chapter Objectives
Upon completion of this chapter, you will be able to: List components of storage system environment
Host, connectivity and storage

List physical and logical components of hosts Describe key connectivity options Describe the physical disk structure Discuss factors affecting disk drive performance

2009 EMC Corporation. All rights reserved.

Storage System Environment - 2

Lesson: Components of Storage System Environment

Upon completion of this lesson, you will be able to: Describe the three components of storage system environment
Host, Connectivity and Storage

Detail Host physical and logical components

Describe interface protocol


PCI, IDE/ATA and SCSI

Describe storage options


Tape, optical and disk drives

2009 EMC Corporation. All rights reserved.

Storage System Environment - 3

Host
Applications runs on hosts Hosts can range from simple laptops to complex server clusters Physical components of host
CPU Storage
Disk device and internal memory
LAN Laptop

Server

I/O device
Host to host communications
Network Interface Card (NIC)

Group of Servers

Host to storage device communications


Host Bus Adapter (HBA)

Mainframe
2009 EMC Corporation. All rights reserved. Storage System Environment - 4

Storage Hierarchy Speed and Cost


Fast
CPU registers

L2 cache

L1 cache

Speed

Magnetic disk

RAM

Tape

Optical disk

Slow
Low High

Cost
2009 EMC Corporation. All rights reserved. Components of a Host - 5

I/O Devices
Human interface
Keyboard Mouse Monitor

Computer-computer interface
Network Interface Card (NIC)

Computer-peripheral interface
USB (Universal Serial Bus) port Host Bus Adapter (HBA)

2009 EMC Corporation. All rights reserved.

Components of a Host - 6

Logical Components of a Host


Host
Apps
Operating System DBMS

Mgmt Utilities File System

Volume Management
Multi-pathing Software

Device Drivers
HBA

HBA

HBA

2009 EMC Corporation. All rights reserved.

Components of a Host - 7

Logical Components of the Host


Application
Interface between user and the host Three-tiered architecture
Application UI, computing logic and underlying databases

Application data access can be classifies as:


Block-level access: Data stored and retrieved in blocks, specifying the LBA File-level access: Data stored and retrieved by specifying the name and path of files

Operating system
Resides between the applications and the hardware Controls the environment

2009 EMC Corporation. All rights reserved.

Storage System Environment - 8

Logical Components of the Host: LVM


Responsible for creating and controlling host level logical storage
Physical view of storage is converted to a logical view by mapping Logical data blocks are mapped to physical data blocks
Logical Storage

Usually offered as part of the operating system or as third party host software LVM Components:
Physical Volumes Volume Groups Logical Volumes
LVM

Physical Storage

2009 EMC Corporation. All rights reserved.

Storage System Environment - 9

Volume Groups
One or more Physical Volumes form a Volume Group LVM manages Volume Groups as a single entity Physical Volumes can be added and removed from a Volume Group as necessary Physical Volumes are typically divided into contiguous equalsized disk blocks A host will always have at least one disk group for the Operating System
Application and Operating System data maintained in separate volume groups
2009 EMC Corporation. All rights reserved.

Logical Volume
Logical Disk Block

Logical Volume

Physical Volume 1

Physical Volume 2

Physical Volume 3 Physical Disk Block

Volume Group

Storage System Environment - 10

LVM Example: Partitioning and Concatenation


Servers

Logical Volume

Physical Volume

Partitioning

Concatenation

2009 EMC Corporation. All rights reserved.

Storage System Environment - 11

Logical Components of the Host (Cont)


Device Drivers
Enables operating system to recognize the device Provides API to access and control devices Hardware dependent and operating system specific

File System
File is a collection of related records or data stored as a unit File system is hierarchical structure of files
Examples: FAT 32, NTFS, UNIX FS and EXT2/3

2009 EMC Corporation. All rights reserved.

Storage System Environment - 12

File System: Metadata Examples


UNIX (UFS) File type and permissions Number of links Owner and group IDs Number of bytes in the file Last file access Last file modification Windows (NTFS) Time stamp and link count File name Access rights File data Index information Volume information

2009 EMC Corporation. All rights reserved.

Components of a Host - 13

File Systems: Journaling and Logging


Improves data integrity and system restart time over nonjournaling file systems Uses a separate area called a log or journal
May hold all data to be written May hold only metadata

Disadvantage - slower than other file systems


Each file system update requires at least 1 extra write to the log

2009 EMC Corporation. All rights reserved.

Components of a Host - 14

How Files are Moved to and from Storage


Teacher (User) Course File(s) File System Files

File System Blocks

1
Configures/ Manages

2
Reside in

3
Mapped by a file system to

Disk Sectors

Disk Physical Extents

LVM Logical Extents

6
Managed by disk storage subsystem Consisting of

5
Mapped by LVM to

4
Residing in

2009 EMC Corporation. All rights reserved.

Storage System Environment - 15

Module Summary
Key points covered in this module: Hosts typically have:
Hardware: CPU, memory, buses, disks, ports, and interfaces Software: applications, operating systems, file systems, device drivers, volume managers

Journaling enables:
very fast file system checks in the event of system crash provides better integrity for file system structure

HBAs are used to connect hosts to storage devices

2009 EMC Corporation. All rights reserved.

Components of a Host - 16

Connectivity
Interconnection between hosts or between a host and any storage devices Physical Components of Connectivity are:
Bus, port and cable

CPU

BUS

HBA

Cable

Disk Port

2009 EMC Corporation. All rights reserved.

Storage System Environment - 17

Bus Technology
Serial

Serial Bi-directional

Parallel

2009 EMC Corporation. All rights reserved.

Connectivity - 18

Bus Technology
System Bus connects CPU to Memory Local (I/O) Bus carries data to/from peripheral devices

Bus width measured in bits


Bus speed measured in MHz Throughput measured in MB/S

2009 EMC Corporation. All rights reserved.

Connectivity - 19

Connectivity Protocol
Protocol = a defined format for communication between sending and receiving devices

Tightly Connected Entities

Directly Attached Entities

Network Connected Entities

Tightly connected entities such as central processor to RAM, or storage buffers to controllers (example PCI)

Directly attached entities connected at moderate distances such as host to storage (example IDE/ATA) Network connected entities such as networked hosts, NAS or SAN (example SCSI or FC)
2009 EMC Corporation. All rights reserved. Storage System Environment - 20

Communication Protocols
Host

Apps Operating System PCI


SCSI or IDE/ATA Device Drivers

2009 EMC Corporation. All rights reserved.

Connectivity - 21

Popular Connectivity Options: PCI


PCI is used for local bus system within a computer It is an interconnection between microprocessor and attached devices Has Plug and Play functionality PCI is 32/64 bit Throughput is 133 MB/sec PCI Express
Enhanced version of PCI bus with higher throughput and clock speed
V1: 250MB/s V2: 500 MB/s V3: 1 GB/s
2009 EMC Corporation. All rights reserved. Storage System Environment - 22

Popular Connectivity Options: IDE/ATA


Integrated Device Electronics (IDE) / Advanced Technology Attachment (ATA)
Most popular interface used with modern hard disks Good performance at low cost Inexpensive storage interconnect Used for internal connectivity

Serial Advanced Technology Attachment (SATA)


Serial version of the IDE /ATA specification Hot-pluggable Enhanced version of bus provides upto 6Gb/s (revision 3.0)

2009 EMC Corporation. All rights reserved.

Storage System Environment - 23

Popular Connectivity Options: SCSI


Parallel SCSI (Small computer system interface)
Most popular hard disk interface for servers Supports Plug and Play Higher cost than IDE/ATA Supports multiple simultaneous data access

Used primarily in higher end environments


SCSI Ultra provides data transfer speeds of 320 MB/s

Serial SCSI
Supports data transfer rate of 3 Gb/s (SAS 300)

2009 EMC Corporation. All rights reserved.

Storage System Environment - 24

SCSI - Small Computer System Interface


Most popular hard disk interface for servers Higher cost than IDE/ATA

Supports multiple simultaneous data access


Currently both parallel and serial forms Used primarily in higher end environments

2009 EMC Corporation. All rights reserved.

Connectivity - 25

SCSI Model

Target Initiator

2009 EMC Corporation. All rights reserved.

Connectivity - 26

SCSI Model

Target ID

LUNs

Initiator ID

2009 EMC Corporation. All rights reserved.

Connectivity - 27

SCSI Addressing
Initiator ID Target ID LUN

Initiator ID - a number from 0 to 15 with the most common value being 7. Target ID - a number from 0 to 15 LUN - a number that specifies a device addressable through a target.

2009 EMC Corporation. All rights reserved.

Connectivity - 28

Disk Identifier - Addressing


Host Addressing
Controller Target

c0 t0 d0

LUN

t0
Peripheral Controller

LUNs

d0

d1

d2

Target

c0 Controller/ Initiator/HBA
2009 EMC Corporation. All rights reserved. Connectivity - 29

SCSI - Pros and Cons


Pros:
Fast transfer speeds, up to 320 megabytes per second

Cons:
Configuration and setup specific to one computer

Reliable, durable components Can connect many devices with a single bus, more than just HDs
SCSI host cards can be put in almost any system Full backwards compatibility

Unlike IDE, few BIOS support the standard Overwhelming number of variations in the standard, hardware, and connectors
No common software interfaces and protocol

2009 EMC Corporation. All rights reserved.

Connectivity - 30

Comparison IDE/ATA vs. SCSI


Feature
Connectivity Market

IDE/ATA
Internal Storage

SCSI
Internal and External Storage

Speed (MB/sec) Hot Pluggable Expandability

100/133/150 No Easier to set up

320 Yes
Very good but very expensive to set up High cost/Fast transfer speed

Cost/Performance

Good

2009 EMC Corporation. All rights reserved.

Connectivity - 31

Physical Components Host with External Storage


Port Bus

CPU
Host

HBA
Cable Port

Disk

2009 EMC Corporation. All rights reserved.

Connectivity - 32

Fibre Channel
DBMS

Host
Apps
Mgmt Utils File System LVM

Multipathing Software
Device Drivers HBA HBA HBA

Fibre Channel

Storage Arrays
2009 EMC Corporation. All rights reserved. Connectivity - 33

External Storage Interfaces A Comparison


SCSI
Limited distance Limited device count Usually limited to single initiator Single-ported drives

Fibre Channel
Greater distance High device count in SANs Multiple initiators Dual-ported drives

2009 EMC Corporation. All rights reserved.

Connectivity - 34

External Storage Interfaces A Comparison


iSCSI
Transport is over an IP network SCSI Commands are exchanged over an IP network

Fibre Channel over Ethernet


Tunnels fibre channel commands over IP

2009 EMC Corporation. All rights reserved.

Connectivity - 35

Fibre Channel Connectivity


Hosts

Switches

Storage

2009 EMC Corporation. All rights reserved.

Connectivity - 36

Storage: Medias and Options


Magnetic Tape
Low cost solution for long term data storage Limitations
Sequential data access, Single application access at a time, Physical wear and tear and Storage/retrieval overheads

Optical Disks
Popularly used as distribution medium in small, single-user computing environments Write once and read many (WORM): CD-ROM, DVD-ROM Limited in capacity and speed

Disk Drive
Most popular storage medium with large storage capacity Random read/write access
Ideal for performance intensive online application
2009 EMC Corporation. All rights reserved. Storage System Environment - 37

Lesson Summary
Key points covered in this lesson: Host components
Physical and Logical

Connectivity options
PCI, IDE/ATA, SCSI

Storage options
Tape, optical and disk drive

2009 EMC Corporation. All rights reserved.

Storage System Environment - 38

Lesson: Disk Drive


Upon completion of this lesson, you will be able to: List and discuss various disk drive components
Platter, spindle, read/write head and actuator arm assembly

Discuss disk drive geometry Describe CHS and LBA addressing scheme Disk drive performance
Seek time, rotational latency and transfer rate

Laws governing disk drive performance Enterprise flash drive


2009 EMC Corporation. All rights reserved. Storage System Environment - 39

Disk Drive Components

Controller

HDA

Interface

Power Connector
2009 EMC Corporation. All rights reserved.

Storage System Environment - 40

Disk Drive Components: Platters

01010100111010101010

00110100111010101010

00110100111010101010

10110101011010101010

2009 EMC Corporation. All rights reserved.

Physical Disks - 41

Disk Drive Components: Spindle

Spindle

Platters

2009 EMC Corporation. All rights reserved.

Physical Disks - 42

Disk Drive Components: Read/Write Heads

2009 EMC Corporation. All rights reserved.

Physical Disks - 43

Disk Drive Components: Actuator

Spindle

Actuator

2009 EMC Corporation. All rights reserved.

Physical Disks - 44

Physical Disk Structures: Actuator Arm Assembly

R/W Head

R/W Head Actuator

2009 EMC Corporation. All rights reserved.

Physical Disks - 45

Disk Drive Components: Controller

Controller HDA Interface

Power Connector
Bottom View of Disk Drive

2009 EMC Corporation. All rights reserved.

Physical Disks - 46

Physical Disk Structures: Sectors and Tracks


Sector

Track
Platter

2009 EMC Corporation. All rights reserved.

Physical Disks - 47

Platter Geometry and Zoned-Bit Recording


Sector

Track
Platter Without Zones Platter With Zones

2009 EMC Corporation. All rights reserved.

Physical Disks - 48

Physical Disk Structures: Cylinders

Cylinder

Tracks, Cylinders and Sectors


2009 EMC Corporation. All rights reserved. Physical Disks - 49

Logical Block Addressing


Sector Cylinder Head Block 0 Block 8 (lower surface)

Block 16

Block 32

Block 48

Physical Address = CHS


2009 EMC Corporation. All rights reserved.

Logical Block Address = Block #


Physical Disks - 50

Drive Partitioning and Concatenation


A

A B C
Partitioning Multiple Logical Volumes
2009 EMC Corporation. All rights reserved.

Concatenation One Logical Volume


Physical Disks - 51

Lesson Summary
Key points covered in this lesson: Physical drives are made up of:
HDA
Platters connected via a spindle Read/write heads which are positioned by an actuator

Controller
Controls power, communication, positioning, and optimization

Data is structured on a drive using tracks, sectors, and cylinders

The geometry of a disk impacts how data is recorded on a platter


2009 EMC Corporation. All rights reserved. Physical Disks - 52

Lesson: Disk Drive Performance


Upon completion of this lesson, you will be able to: Describe the factors that impact the performance of a drive Describe how drive reliability is measured

2009 EMC Corporation. All rights reserved.

Physical Disks - 53

Disk Drive Performance: Positioning


Seek time is the time for read/write heads to move between tracks

Seek time specifications include:


Full stroke Average

Track-to-track

2009 EMC Corporation. All rights reserved.

Physical Disks - 54

Disk Drive Performance: Rotational Speed/Latency

2009 EMC Corporation. All rights reserved.

Physical Disks - 55

Disk Drive Performance: Command Queuing


Without Command Queuing
Request 1 Request 2 4 Request 3 3 2 1
3 4 2 1

Request 4

With Command Queuing


Request 1 Request 2 4 Request 3 Request 4
3 4

2 1

2009 EMC Corporation. All rights reserved.

Physical Disks - 56

Disk Drive Performance: Data Transfer Rate


External transfer rate measured here Internal transfer rate measured here

HBA

Interface

Buffer

Disk Drive

2009 EMC Corporation. All rights reserved.

Physical Disks - 57

Drive Reliability: MTBF


Mean Time Between Failure Amount of time that one can anticipate a device to work before an incapacitating malfunction occurs
Based on averages Measured in hours

Determined by artificially aging the product

2009 EMC Corporation. All rights reserved.

Physical Disks - 58

Utilization vs. Response time

Knee of curve: disks at about 70% utilization

Low Queue Size

0%

Utilization

70%

100%

Consider a disk I/O system in which an I/O request arrives at a rate of 100 I/Os per second. The service time, RS, is 4 ms.
Utilization of I/O controller (U=a Rs) Total response time (R=Rs /1-U)

Calculate the same with service time is doubled


2009 EMC Corporation. All rights reserved. Storage System Environment - 60

Enterprise Flash Drives: A New Generation Drives


Conventional disk drive Mechanical Delay associated with conventional drive
Seek time Rotational latency

Enterprise flash drive Highest possible throughput per drive


No Spinning magnetic media No Mechanical movement which causes seek and latency Solid State enables consistent I/O performance

More power consumption due to mechanical operations

Very low latency per I/O Energy efficient storage design


Lower power requirement per GB of storage Lower power requirement per IOPS

Low Mean Time Between Failure

2009 EMC Corporation. All rights reserved.

Storage System Environment - 61

Enterprise Flash Drives Overview


Drive is based on Flash Solid State memory technology
High performance and low latency Non volatile memory Uses single layer cell (SLC) or Multi Level cell (MLC) to store data

Enterprise Flash Drives use a 4Gb FC interface

2009 EMC Corporation. All rights reserved.

Storage System Environment - 62

Enterprise Flash Drives Benefits


Faster performance
Up to 30 times greater IOPS (benchmarked) Typical applications: 8 12X Less than 1 millisecond service time
1@15K Fibre Channel drive 10@15K Fibre Channel drives 30@15K Fibre Channel drives

More energy efficient


38 percent less per terabyte 98 percent less per IO
IO per second 1 Flash drive

Better reliability
No moving parts Faster RAID rebuilds
2009 EMC Corporation. All rights reserved. Storage System Environment - 63

Response Time

Enterprise Flash Drives Tier-0 Application


Position Enterprise Flash Drives as the high-performance option in demanding environments Low latency applications, also known as Tier-0 applications Standard form-factor and capacity design allows for easier integration

High performance, low power for a Green initiative


Target Customer/Market Segments:
High performance solutions coupled with low power Specifically target Oracle database customers initially Financial trading OLTP databases
Storage System Environment - 64

2009 EMC Corporation. All rights reserved.

Lesson Summary
Key points covered in this lesson: Disk drive components and geometry

Disk drive addressing scheme


Disk drive performance Convention drive Vs Enterprise Flash Drives Enterprise Flash Drives for high performance and low power storage solution

2009 EMC Corporation. All rights reserved.

Storage System Environment - 65

Chapter Summary
Key points covered in this chapter: Storage system environment components:
Host, connectivity and storage

Physical disk structure and addressing Factors affecting disk performance Flash drives benefits

2009 EMC Corporation. All rights reserved.

Storage System Environment - 68

Check Your Knowledge


What are some examples of hosts? What are the physical and logical components of a host?

What are the common connectivity protocols used in computing environments?


What is the difference between seek time and rotational latency? What is the difference between internal and external data transfer rates?

2009 EMC Corporation. All rights reserved.

Storage System Environment - 69

S-ar putea să vă placă și