Section 2 Storage Systems

Architecture
Introduction

Section Objectives
Upon completion of this Section, you will be able to:
Describe the host environment.
Describe common connectivity components and protocols.
Describe features of intelligent disk subsystems.
Describe data flow from the host to/from the disk.

-2

Storage Systems Architecture - Introduction

In this Section
This section contains the following modules:
1. The Host Environment
2. Connectivity
3. Physical Disks
4. RAID Arrays
5. Storage Systems

-3

Storage Systems Architecture - Introduction

Storage System Environment

-4

Storage Systems Architecture - Introduction

Parts of a Storage Environment: Host

-5

Storage Systems Architecture - Introduction

 . From the hosts perspective, storage access (read and write)

occurs via
Physical components:
CPU
Memory
Bus

Logical components:

Software applications
Operating system
File systems
Databases.

Parts of a Storage Environment:

Connectivity

-7

Storage Systems Architecture - Introduction

 Network Connectivity encompasses everything between the host and the storage system.
Physical components of Connectivity include:

Wiring
Host internal bus(es)
Cables Optical and Copper
Connectors and plugs

Adapters
Host Bus Adapter (HBA) enables devices to connect to a hosts internal bus system.
Network Interface Cards enables simple network attachments to a host.

Switches/hubs
Manage traffic within a network.

Logical components of Connectivity include

Communication protocols
Device Drivers

Parts of a Storage Environment:

Storage

-9

Storage Systems Architecture - Introduction

 Physical components of storage include:

Physical devices that hold the data (i.e., disk, tape, optical

drives, etc.)
Components that make the devices operate (i.e., power
supplies, fans)
The enclosures that hold the equipment (e.g., racks)
Logical components of storage include:
Protocols
Flow algorithms

The Host Environment

Module 2.1

The Host Environment

Upon completion of this module, you will be able to:
List the hardware and software components of the host
environment
Describe key protocols and concepts used by each
component

- 12

Storage Systems Architecture - Introduction

Examples of Hosts

Server
Laptop

Group of Servers
Mainframe
- 13

Storage Systems Architecture - Introduction

Host Physical Components

Bus

CPU

I/O Devices

- 14

Storage Systems Architecture - Introduction

Storage

CPU
ALU

Bus

L1 Cache
Bus

CPU

- 15

Registers

Storage Systems Architecture - Introduction

Storage

Data n

Data 3

Data 2

Data 1

Data 0

Address

Disk

Content
Memory

- 16

Storage Systems Architecture - Introduction

Storage Hierarchy Speed and Cost

Fast

CPU registers

L2 cache

Speed

Magnetic
disk

Tape

RAM

Optical
disk

Slow
Low
- 17

L1 cache

Storage Systems Architecture - Introduction

Cost

High

I/O Devices
Human interface
Keyboard
Mouse
Monitor

Computer-computer interface
Network Interface Card (NIC)

Computer-peripheral interface
USB (Universal Serial Bus) port
Host Bus Adapter (HBA)

- 18

Storage Systems Architecture - Introduction

Host Environment: Logical Components

Host
Apps
Operating System

Mgmt Utilities

DBMS

File System
Volume Management
Multi-pathing Software

Device Drivers
HBA
- 19

Storage Systems Architecture - Introduction

HBA

HBA

File Systems

Host
Apps

Operating System

Mgmt Utilities

DBMS

File System
Volume Management
Multi-pathing Software

Device Drivers
HBA
- 20

Storage Systems Architecture - Introduction

HBA

HBA

File System: Metadata Examples

UNIX (UFS)
File type and permissions
Number of links
Owner and group IDs
Number of bytes in the file
Last file access
Last file modification

- 21

Storage Systems Architecture - Introduction

Windows (NTFS)
Time stamp and link count
File name
Access rights
File data
Index information
Volume information

File Systems: Journaling and Logging

Improves data integrity and system restart time over non-

journaling file systems.

Uses a separate area called a log or journal.
May hold all data to be written
May hold only metadata

Disadvantage - slower than other file systems.

Each file system update requires at least 1 extra write to the log

- 22

Storage Systems Architecture - Introduction

Volume Management
Host
Apps
Operating System

Mgmt Utilities

DBMS

File System
Volume Management
Multi-pathing Software

Device Drivers
HBA
- 23

Storage Systems Architecture - Introduction

HBA

HBA

HBAs
Host
Apps
Operating System

Mgmt Utilities

DBMS

File System
Volume Management
Multi-pathing Software

Device Drivers
HBA

- 24

Storage Systems Architecture - Introduction

HBA

HBA

Improving Data Availability at the Host

Redundancy:
Multiple HBAs
Multi-pathing software
Clustering

- 25

Storage Systems Architecture - Introduction

How Files are Moved to and from

Storage
Teacher

Course File(s)

Configures /
Manages

File System Files

Reside
in

Disk Sectors

Managed by Disk
Storage
Subsystem
- 26

File System Blocks

Mapped by file
system to

Disk Physical
Extents

Consisting of

Storage Systems Architecture - Introduction

LVM Logical
Extents

Mapped by
LVM to

Residing in

Module Summary
Key points covered in this module:
Hosts typically have:
Hardware: CPU, memory, buses, disks, ports, and interfaces.
Software: applications, operating systems, file systems, device

drivers, volume managers

HBAs connect hosts to storage devices.

Multi-pathing software uses redundant paths to ensure

uninterrupted communication between the host and the

storage
Clustering uses redundant host systems to improve data
availability
- 27

Storage Systems Architecture - Introduction

Check Your Knowledge

What are some examples of hosts?
Describe the hardware components found in most hosts.
What is the function of the operating system?
What is the function of the file system?
What are some techniques that can be used to improve

availability at the host?

What is volume management?

- 28

Storage Systems Architecture - Introduction

Connectivity
Module 2.2

Connectivity
Upon completion of this module, you will be able to:
Describe the physical components of a networked storage
environment.
Describe the logical components (communication protocols)
of a networked storage environment.

- 30

Storage Systems Architecture - Introduction

Physical Components Host with

Internal Storage
Bus

CPU

Port

HBA

Host
Port

Cable

Disk
- 31

Storage Systems Architecture - Introduction

Bus Technology
Serial
Serial Bi-directional

Parallel

- 32

Storage Systems Architecture - Introduction

Bus Technology
System Bus connects CPU to Memory
Local (I/O) Bus carries data to/from peripheral devices.
Bus width measured in bits
Bus speed measured in MHz
Throughput measured in MB/S

- 33

Storage Systems Architecture - Introduction

Connectivity Protocols
Protocol = a defined format for communication allows the

sending and receiving devices to agree on what is being

communicated.

Tightly
Connected
Entities

- 34

Storage Systems Architecture - Introduction

Directly
Attached
Entities

Network
Connected
Entities

Communication Protocols
Host
Apps
Operating System
PCI
SCSI or IDE/ATA Device Drivers

- 35

Storage Systems Architecture - Introduction

Bus Technology - PCI

Peripheral Component Interconnect (PCI) defines the local

- 36

bus system within a computer

It is an interconnection between microprocessor and attached
devices, in which expansion slots are spaced closely for highspeed operation.
Has Plug and Play functionality.
PCI is 32/64 bit
Throughput is 133 MB/sec

Storage Systems Architecture - Introduction

IDE/ATA
Integrated Device Electronics (IDE) / Advanced Technology

- 37

Attachment (ATA)
Most popular interface used with modern hard disks
Good performance at low cost
Desktop and laptop systems
Inexpensive storage interconnect

Storage Systems Architecture - Introduction

SCSI - Small Computer System

Interface

- 38

Most popular hard disk interface for servers.

Higher cost than IDE/ATA.
Supports multiple simultaneous data access.
Currently both parallel and serial forms.
Used primarily in higher end environments.

Storage Systems Architecture - Introduction

SCSI Model

Target
Initiator

- 39

Storage Systems Architecture - Introduction

SCSI Model
Target
ID

Initiator
ID

- 40

Storage Systems Architecture - Introduction

LUNs

SCSI Addressing
Initiator ID

Target ID

LUN

Initiator ID - a number from 0 to 15 with the most common value

being 7.
Target ID - a number from 0 to 15
LUN - a number that specifies a device addressable through a target.

- 41

Storage Systems Architecture - Introduction

Disk Identifier - Addressing

Host Addressing

c0 t0 d0

Controller
Target

LUN

t0
Peripheral
Controller

Target

- 42

c0 - Controller
Initiator, HBA

Storage Systems Architecture - Introduction

LUNs
d0

d1

d2

Comparison IDE/ATA vs SCSI

Feature

IDE/ATA

SCSI

Connectivity Market

Internal Storage

Internal and External

Storage

Speed (MB/sec)

100/133/150

320

Hot Pluggable

No

Yes

Expandability

Easier to set up

Very good but very

expensive to set up

Cost/Performance

Good

High cost/Fast
transfer speed

Storage Systems Architecture - Introduction

- 43

Physical Components Host with

External Storage
CPU

Port

Bus

Host

HBA
Cable
Port

Disk
- 44

Storage Systems Architecture - Introduction

Fibre Channel
Host
DBMS

HBA

Fibre Channel

Storage Arrays
- 45

Storage Systems Architecture - Introduction

Apps
File System
LVM
Multipathing Software
Device Drivers
HBA

Mgmt Utils

HBA

External Storage Interfaces A

Comparison
SCSI
Limited distance
Limited device count
Usually limited to single initiator
Single-ported drives

Fibre Channel
Greater distance
High device count in SANs
Multiple initiators
Dual-ported drives

- 46

Storage Systems Architecture - Introduction

Fibre Channel Connectivity

Hosts

Switches

- 47

Storage Systems Architecture - Introduction

Storage

Module Summary
Key points covered in this module:
The physical components of a networked storage
environment.
The logical components (communication protocols) of a
networked storage environment.

- 48

Storage Systems Architecture - Introduction