footprint otoh

Transcription

footprint otoh

Technologies for Green Storage
Alan G. Yoder, Ph.D.
NetApp
SNIA Legal Notice
The material contained in this tutorial is copyrighted by the SNIA.
Member companies and individuals may use this material in presentations
and literature under the following conditions:
Any slide or slides used must be reproduced without modification
The SNIA must be acknowledged as source of any material used in the body of
any document containing material from these presentations.
This presentation is a project of the SNIA Education Committee.
Neither the Author nor the Presenter is an attorney and nothing in this
presentation is intended to be nor should be construed as legal advice or
opinion. If you need legal advice or legal opinion please contact an
attorney.
The information presented herein represents the Author's personal
opinion and current understanding of the issues involved. The Author, the
Presenter, and the SNIA do not assume any responsibility or liability for
damages arising out of any reliance on or use of this information.
.
NO WARRANTIES, EXPRESS OR IMPLIED. USE AT YOUR OWN RISK
© 2009 Storage Networking Industry Association. All Rights Reserved.
2
Abstract
Hardware efficiencies are essential to reducing the amount
of power used by storage. Equally real savings are obtained
by reducing the number of copies of your data that must
be made, kept and managed. This talk presents a number
of technologies, ranging from thin provisioning and
virtualization to flywheel UPSs, that each address part of
the problem, and illustrates the impact that each
technology can have on your data center footprint.
3
Outline
Objectives
Need for redundancy (extra copies of data)
Software technologies for reducing excessive
redundancy
Other technologies for energy saving
Data center technologies
Typical savings
4
Objective
Get more work done
for less money
Translation: reduce data center footprint
in space
less storage equipment to buy
in energy
more energy-efficient equipment
less equipment to cool
better cooling methodologies
better power management
in administrative costs
less storage equipment to manage
5
Need for redundancy
RAID 10 – protect against multiple disk failures
DR Mirror – protect against whole-site disasters
Backups – protect against failures and unintentional
deletions/changes
Compliance archive – protect against heavy fines
Test/dev copies – protect live data from mutilation
by unbaked code
Overprovisioning – protect against volume out of
space application crashes
Snapshots – quicker and more efficient backups
6
Result of redundancy
- Power consumption is roughly linear in
the number of naïve (full) copies
Test
Test
10 TB
Test
Test
Test
5 TB
1 TB
Data
App
Data
Archive
Archive
Backup
Backup
Backup
Snapshots
“Growth”
Snapshots
“Growth”
Snapshots
“Growth”
Snapshots
“Growth”
RAID10
RAID10
RAID10
RAID10
Data
Data
Data
Data
“Growth”
Snapshots
“Growth”
Snapshots
“Growth”
Snapshots
“Growth”
Snapshots
“Growth”
Snapshots
“Growth”
RAID10
RAID10
RAID10
RAID10
RAID10
RAID10
RAID10
Data
Data
Data
Data
Data
Data
Data
Overprovision
Snapshots
DR
Mirror
Disk
Backup
Compliance
Archive
RAID 10
Overhead
~10x +
Test/Dev
copies
7
Effect of green technologies
Test
Test
10 TB
Test
Test
Test
Test
Test
Test
Test
Test
Test
Test
Test
Test
Archive
Test
Test
Test
Test
Backup
Test
Archive
Test
Test
Test
Test
Backup
Archive
Backup
Archive
Backup
Snapshots
“Growth”
Snapshots
“Growth”
Snapshots
“Growth”
Snapshots
“Growth”
Data
Data
Data
Data
Snapshots
“Growth”
Snapshots
“Growth”
Snapshots
“Growth”
Snapshots
“Growth”
Data
Data
Data
Data
Thin
Provisioning
MultiUse
Backups
Virtual
Clones
Dedupe
&
Compression
Test
Test
5 TB
Snapshots
“Growth”
RAID10
Data
Snapshots
“Growth”
1 TB
Green storage technologies use less raw
capacity to store and use the same data set
Power consumption falls accordingly
RAID10
Backup
Snapshots
“Growth”
RAID DP
Data
Snapshots
“Growth”
RAIDDP
Data
Data
RAID 5/6
Archive
RAID DP
RAIDDP
RAID DP
RAIDDP
RAID DP
RAIDDP
Archive
Backup
RAID DP
RAIDDP
8
Green Storage Technologies
Enabling technologies
Storage virtualization
Storage capacity planning
Green software
Compression
Snapshots
Virtual (writeable) clones
Thin provisioning
Non-mirrored RAID
Deduplication and SIS
Resizeable volumes
9
Green storage technologies (cont.)
Other storage technologies and power saving
techniques
Capacity vs. high performance drives
ILM / HSM
MAID
SSDs
Power supply and fan efficiencies
Facilities-side technologies
Hot aisle/cold aisle
Water & natural cooling
Flywheel UPSs
10
Enabling technologies
Storage virtualization
11
Storage Virtualization
Mapping from physical location to virtual location
May exist at multiple layers
In and of itself, not green wrt storage
No reduction in dataset size
Very green wrt servers
But foundational for some green technologies
Thin provisioning
Resizeable volumes
Snapshots and virtual clones (depending on implementation)
Also contributes in other areas
Flexibility, manageability, etc.
12
Obtain
and analyse baseline data
70
Many toolkits available from storage and storage
60 management vendors
Toolkits usually slanted toward more purchase of said
50
vendors’ products
40
Identify
inefficiencies
30
20
Series1
Vendors usually eager to help find issues with other
vendors’ solutions
Identify which green software technologies will
10
address
each inefficiency found
0
Ask vendors for proposals
1
2
3
4
5
6
13
Green software technologies
Compression
Snapshots
Virtual (writeable) clones
Thin provisioning
Non-mirrored RAID
Resizeable volumes
14
Compression
Compression
Old and venerable
Origins
in signaling, number and coding theory
Test
Motivated
by limited bandwidth and lossiness of satellite communications
Test
Test
Test the data stack
Test
Scattered
throughout
Test
Test
Test
Test
Test
Test formats already compressed
Many
Test
Test
Test
Test
Test
JPEG, MPEG,
MP3,
Test etc.
Test
Test
Test
Test
Test for unknown data types
Test necessary
Lossless
compression
(LZW)
Backup
Archive
Archive
Test
Test
Backup
Archive
Backup
Archive
Backup
Archive
Snapshots
“Growth”
Snapshots
“Growth”
Snapshots
“Growth”
Snapshots
“Growth”
Archive
Configuration
Backup matters
Snapshots
“Growth”
Backup
Compress before encrypting, decrypt before decompressing
RAID10
Data
Snapshots
“Growth”
RAID DP
RAID DP
RAID DP environments
Difficult inData
block-based
Data
Data
Data
Snapshots
“Growth”
RAID DP
RAID DP
Data
Snapshots
Snapshots
Snapshots
Therefore usually
done atSnapshots
the stream
or object level
“Growth”
“Growth”
“Growth”
“Growth”
RAID10
Snapshots
“Growth”
RAIDDP
Data
Data
RAIDDP
RAIDDP
RAIDDP
RAIDDP
Data
Data
Data
Data
15
Snapshots
NOT just wholesale copies of the data
We call those PIT copies
Data sharing
Test
Test
Test
Test
Form
of Test
deduplication
Test
Test
Test
Test
Test
Test
Data in snapshot
data until live data is
Testshared
Test
Test
Test with live
Archive
Test
Test
Test
Test
written
Test
Test
Test
Backup
Archive
Test
Test
Two fundamental
Archivetechniques
Backup
Test
Snapshots
“Growth”
Archive
Copy Out on Backup
Write Backup
Data
WriteRAID
toDPnewRAID
live
RAID DP
DP location
Data
RAID10
Snapshots
“Growth”
RAID10
Snapshots
“Growth”
Snapshots
“Growth”
RAIDDP
Data
Data
Archive
Backup
Archive
Backup
Snapshots
“Growth”
Snapshots
“Growth”
Snapshots
“Growth”
Snapshots
“Growth”
Data
Data
Data
Data
Snapshots
“Growth”
Snapshots
“Growth”
Snapshots
“Growth”
Snapshots
“Growth”
Data
Data
Data
Data
RAIDDP
RAIDDP
RAID DP
RAIDDP
RAID DP
RAIDDP
16
Virtual clones
Writeable snapshots, essentially
Data shared with master copy until written
Test
Master
copy is typically a recent snapshot of some live
Test
Test
data
Test
Test
Test
Test
Original Test
live data
Test left intact
Test
Test
Test
Typical use
Archive
Test
Test
Test
Test
Test
Test
Test
Test
Snapshots
“Growth”
Snapshots
“Growth”
Snapshots
“Growth”
Snapshots
“Growth”
Snapshots
“Growth”
Snapshots
“Growth”
Snapshots
“Growth”
Snapshots
“Growth”
Data
Data
Data
Data
Test
Test
Test
Backup
What-if
scenarios
Archive
Test
Test
Archive
Testing Backup
of application Archive
changesArchive
against up-to-date
datasets
Archive
Backup
Backup
Backup
Backup
Testing
of new applications with near-online
data
Data
Data
Data
Booting/runningDataof VMData
imagesData
from a golden
master
Snapshots
“Growth”
RAID10
Snapshots
“Growth”
RAID DP
Snapshots
“Growth”
RAID10
RAID DP
Snapshots
“Growth”
RAIDDP
Data
Data
RAIDDP
RAID DP
RAIDDP
RAID DP
RAIDDP
RAID DP
RAIDDP
17
Thin provisioning
Similar in concept to filesystem quotas
Quotas
Thin provisioned volume
Test
Quota
limit
Test
Nominal volume size
Test
Test
Test
Hit quota
limit:Test
writes fail
Test
Test
Increase quotaTest
Test
Archive
Test
Backup
Archive
Test
Test
Test
Test
Test
Need more physical storage
Test
Snapshots
“Growth”
Backup
Fill up volume: writes fail
Test
Archive
Test
Test
Test
Increase
volume size
Test
Test
Need more physical storage
Test
Test
Storage admin just manages the underlying storage
RAID10
Data
Snapshots
“Growth”
RAID10
Snapshots
“Growth”
RAID DP
Data
Snapshots
“Growth”
RAIDDP
Data
Data
Backup
Archive
Backup
Archive
Backup
Snapshots
“Growth”
Snapshots
“Growth”
Snapshots
“Growth”
Snapshots
“Growth”
Data
Data
Data
Data
Snapshots
“Growth”
Snapshots
“Growth”
Snapshots
“Growth”
Snapshots
“Growth”
Data
Data
Data
Data
RAID DP
RAIDDP
RAID DP
RAIDDP
RAID DP
RAIDDP
Archive
Backup
RAID DP
RAIDDP
18
RAID 5
Allows any (one) drive in a RAID set to fail without
data loss
Requires only one extra drive in a RAID set
Test
Test
Test
Test
Test raw capacity
Much
less
required than for mirroring
Test
Test
Test
Test
Test
Test
Typical:
8-disk Test
RAID 5 set:
12.5%Testoverhead vs. 50% for mirroring
Test
Test
Test
Note: RAID 3 and RAID 4 have the same overhead
as RAID 5
Archive
Test
Backup
Archive
Snapshots
“Growth”
RAID10
Data
Snapshots
“Growth”
RAID10
Backup
Snapshots
“Growth”
RAID DP
Data
Test
Test
Test
Test
Test
Test
Test
Archive
Backup
Snapshots
“Growth”
RAID DP
Data
Snapshots
“Growth”
RAIDDP
Data
Test
Data
Snapshots
“Growth”
RAIDDP
Data
Archive
Note: these
numbers
would be
Archive
Backup
Backup
14.3%Snapshots
and 100% respectively
Snapshots
Snapshots
“Growth”
“Growth”
“Growth”
RAID DP
RAID DP
RAID if
DP figured
as
overhead
on top
Data
Data
Data
of, as Snapshots
opposed to as
a
Snapshots
Snapshots
“Growth”
“Growth”
“Growth”
RAIDDP
RAIDDP of
RAIDDP
percentage
Data
Data
Data
Archive
Backup
19
RAID 6
More dependable than mirroring
Mirroring: can survive two failures in a disk group if they’re not in the
same mirrored pair
Test
RAID 6: can survive failure of any two drives in the group
Test
Test
Requires
two
extraTestdrives per RAID set
Test
Test
Test
However,
typicallyTest
somewhat
RAID sets
Test larger Test
Test
Test
Test
Test
Test
Test
Necessary
as
drive
sizes
increase
Archive
Test
Test
Test
Test
Probability
of a diskTestfailure during
RAID
5 parity reconstruct is getting
Test
Test
Backup
Archive
too high
Test
Test
Archive
Snapshots
“Growth”
Backup
More green than mirroring
Backup
Backup
RAID10
Archive
Snapshots
“Growth”
Archive
Backup
50% overhead
in RAID
1 mirroring
RAID DP
RAID DP
RAID DP
Data
Data
Data
Data
14.3% overhead in a 14-disk RAID 6 raidset
Data
Snapshots
“Growth”
RAID10
RAID DP
Snapshots
“Growth”
RAIDDP
Data
Data
Archive
Backup
16.7% and
RAID DP100% if figured
Data
on top of
Snapshots
Snapshots
“Growth”
Snapshots
“Growth”
Snapshots
“Growth”
Snapshots
“Growth”
Snapshots
“Growth”
Snapshots
“Growth”
Snapshots
“Growth”
RAIDDP
RAIDDP
Data
Data
Data
Data
RAIDDP
RAIDDP
“Growth”
20
Find duplicates at some level, substitute pointers to a
single shared copy
Block or sub-file based (dedup)
Content or name based (SIS *, “file folding”)
Streaming (in-band) and post-process techniques
Savings increase with number of copies found
Test
Test
Test
Test
Test
Test
Test
Test
Test
Test
Test
Test
Test
Test
Archive
Test
Test
Test
Test
Backup
Test
Archive
Test
Test
Test
Test
Snapshots
“Growth”
Snapshots
“Growth”
Snapshots
“Growth”
Snapshots
“Growth”
Data
Data
Data
Data
Snapshots
“Growth”
Snapshots
“Growth”
Snapshots
“Growth”
Snapshots
“Growth”
Data
Data
Data
Data
Test
Test
Snapshots
“Growth”
Archive
Backup
Archive
Archive
Up to 95%
savings,
depending
on datasetArchive
Backup
Backup
Backup
RAID10
Data
Snapshots
“Growth”
RAID DP
Data
Backup
RAID DP
RAID DP
* SIS = Single Instance Store
Snapshots
“Growth”
RAID10
Snapshots
“Growth”
RAIDDP
Data
Data
RAIDDP
RAIDDP
RAID DP
RAIDDP
RAID DP
Check out the SNIA
Dictionary !
RAIDDP
www.snia.org/dictionary
21
Resizeable volumes
Does away with need for overprovisioning
Run at 70% capacity instead of 20-30%
Manage underlying storage pool instead of the
volumes
May require application-level support
Test
Test
Test
Test
Test
Test
Test
Test
Test
Test
Test
Test
Test
Test
Test
Test
Test
Test
Test
Test
Test
Backup
Archive
Backup
Archive
Backup
Snapshots
“Growth”
Snapshots
“Growth”
Snapshots
“Growth”
Snapshots
“Growth”
Data
Data
Data
Data
Snapshots
“Growth”
Snapshots
“Growth”
Snapshots
“Growth”
Snapshots
“Growth”
Data
Data
Data
Data
Test
Archive
LUNs
usually,
filesystems
so
Test
Test less Test
Backup
Archive
Snapshots
“Growth”
RAID10
Data
Snapshots
“Growth”
RAID10
Backup
Snapshots
“Growth”
RAID DP
Data
Snapshots
“Growth”
RAIDDP
Data
Data
Archive
RAID DP
RAIDDP
RAID DP
RAIDDP
RAID DP
RAIDDP
Archive
Backup
RAID DP
RAIDDP
22
Other technologies
Capacity vs. high performance drives
ILM / HSM
MAID
SSDs
23
Capacity vs. High Performance
Capacity
focused on GB/watt at rest
1 TB SATA: 15W
4 x 250 GB FC: 64W
also tend to have better $/GB
NOTE: power use is quadratic with respect to rotational
speed
Use the slowest drives that will fit your needs
Performance
focused on seek time
1 TB SATA: 12 – 15 ms
300 GB FC: 3 – 4 ms
also designed for higher RAS * environments
* RAS = Reliability, Availability, Security
24
ILM / HSM *
Exploit cost differences between storage tiers
Idea: automatically move data to an appropriate storage platform at each
period in its lifetime
Tier change must have substantial value to make the overhead worth it
Cost of ILM/HSM system
Cost of administration
Cost of data movement
Practice
Storage declines in value as it ages
Manual movement of data sets
Check out SNIA Tutorial:
The Secret Sauce of ILM
New wrinkle
Assessment
Footprint considerations preclude keeping older gear
* ILM = Information Lifecycle Management
HSM = Hierarchical Storage Management
25
MAID (Massive Array of Idle Disks)
Idea: spin down disks when not in use
Pros
Disks use no power when spun down
> 50% power savings at idle
Cons
Most data near-online (access times of several seconds)
Background disk housekeeping difficult
Often the same data center sizing requirements (UPSs, CRAC
units, PDUs etc.), but these are used at lower efficiencies
Impending competition from SSDs
Competition from....
26
Tape
Our old “buddy”
Pros
Tapes use no power when inactive
> 90% power savings at idle
Cons
Data is at best near-online (access times of several seconds)
Not a random access format
Lack of true resilience to format failure
– Redundant Array of Independent Tape? (RAIT)
Check out SNIA Tutorial:
Introduction to Data Protection:
Backup to Tape, Disk and Beyond
27
SSDs (Solid State Disks)
Usually refers to FLASH-based disks
Pros
Great READ performance
At rest power consumption = 0
No access time penalty when idle (cf. MAID)
No need to keep some disks spinning (cf. MAID)
Cons
WRITE performance < mechanical disks
Cost >> mechanical disks except at very high perf points
Wear leveling requires a high space overhead
Note: these dynamics changing rapidly with time
SSSI – SNIA Solid State Storage Initiative
Check out the SNIA Tutorials in
the Solid State Storage (SSS)
Tutorial track
28
Efficiency of power supply an up front waste
Formerly 60-70%
Nowadays 80-95%
Climate Savers
80+ group
Note: Efficient PSs are more expensive
Variable speed fans
Common nowadays
Software (OS) control
Energy consumption is quadratic in the rotational speed
29
Facilities-side technologies
Monitoring
Hot aisle – cold aisle technologies
Water and natural cooling
Flywheel UPSs
(UPS = Uninterruptible
Power Suppy)
30
Monitoring
Critical to increased efficiencies
Lights out operation
Tightening up of temperature tolerances
Better staff utilization
Anomaly detection
31
Hot aisle / cold aisle technologies
Segregate airflows into hot and cold aisles (backs and
fronts of servers)
More precise control
Allows higher input temperatures
Several emerging
approaches
Hot air plenum
Complete containment
32
Water and natural cooling
Water cooling of increasing interest
Issues include corrosion, warm water disposal
Natural cooling
“Economizers”
Exhaust hot aisle
air when temp >
outdoor air
Use outdoor air
when temp < cold
aisle air
May need humidity
control
33
Flywheel UPSs
Operational flow: normal condition
Flywheel
Grid power keeps flywheel turning
Motor/
Alternator
Clutch
Diesel
34
Flywheel UPSs
Operational flow: outage
Flywheel
Flywheel powers alternator while diesel starts up
(~15 seconds)
Motor/
Alternator
Clutch
Diesel
35
Flywheel UPSs
Operational flow: diesel power
Flywheel
special clutch transfers mechanical linkage from flywheel to
diesel
Motor/
Alternator
Clutch
Diesel
36
Flywheel UPSs
Pros
No lead-acid batteries
Environmental impact
Ongoing maintenance pain
More reliable
No AC to DC to AC conversion
More efficient
~98% vs. ~94% best in class
Motor/
Clutch
~400KW difference inAlternator
10MW data center
Cons
More expensive, requires:
fast-starting diesel (battery-based UPSs give you 15 minutes)
frequent test/warmup cycles
Emerging competition
CAES (compressed air “flywheels”)
37
Savings calculations
Space savings
Equipment power savings
Facilities power savings
38
Savings calculations (storage)
Calculations herein are for space savings
Relationship of space to $$ is loose
But every TB of disks you don’t buy saves you
CapEx (Capital Expenditure) for the equipment
CapEx for the footprint
CapEx for power conditioning and cooling
OpEx (Operational Expenditure) for equipment power
OpEx for power conditioning and cooling
OpEx for storage management
OpEx for service contract fees
39
Typical savings
Compression
20 – 40%
Remember, no savings from already compressed file
formats
Snapshots
90 – 95% per snapshot, compared to raw PIT copies
Only data written since snapshot needs to be copied
Writeable clones
80 – 95%, compared to raw PIT copies
Only data that is written needs to be duplicated
40
Typical savings
Thin provisioning
40 - 60%
Average 30% utilization Î over 80% utilization
RAID 6
35%
For 14-disk RAID 6 set, compared to RAID 1/10
Deduplication
40 – 95%, depending on dataset and time interval
~ 40 – 50% average over time
Resizeable volumes
20 – 50%
41
Caveats
Savings estimates are real, but best taken as
anecdotal
YMMV – your mileage may vary
Make your vendors prove their claims
Green options in some implementations may
degrade RAS and/or performance
E.g.
RAID 5 vs RAID 10 – reduced RAS
7.5K SATA vs 15K FC – reduced performance
Tape vs disk during legal discovery – large fine if too slow
Make your vendor tell you the cons that go with the pros
42
Are these savings multiplicative?
Sometimes yes
RAID 6 + writeable clone
Assume 1000GB writeable clone =
2000GB needed for a raw writeable copy on RAID 1 storage
90% writeable clone savings takes us to 200GB
35% RAID 6 savings takes us from there to 130GB Î
130GB needed for a writeable clone on RAID 6
Sometimes no
Thin provisioning + resizeable volumes
Similar effects, but you only get the savings once
Sometimes maybe
Snapshot + deduplication
Can’t dedup readonly snapshots
Snapshots are a form of deduplication, so there’s less to dedup
OTOH, already deduped data can be snapshotted efficiently
43
Savings matrix
Savings multiply in combinations with checkboxes
C
SS
VC TP
R
DD RV
Compression (C)
Snapshots (SS)
Virtual Clones (VC)
Thin Provisioning (TP)
RAID (R)
Deduplication (DD)
Resizeable Vols (RV)
44
Savings matrix (cont.)
E.g. Thin provisioning with snapshots, RAID 6, and
Dedup – big win!
C
SS
VC
TP
R
DD
RV
Compression (C)
Snapshots (SS)
Virtual Clones (VC)
Thin Provisioning (TP)
RAID (R)
Deduplication (DD)
Resizeable Vols (RV)
45
Equipment power savings
Server virtualization
up to 80% savings
much depends on load
Power supply efficiencies
10 – 20%
difficult to do anything about this in a vacuum
probably okay to just ride industry trends
Variable speed fans
up to 80% savings
power consumption quadratic in rotational speed
interesting interaction with data center cold aisle temperatures
46
Facilities savings
State of the art data centers
PUE* drops from 2.25 to 1.25 = 45% savings
10MW Æ 5.5MW
$6.0M Æ $3.3M annually
Rebates in the $M from utilities on top of savings
* Power Utilization Efficiency – see www.thegreengrid.org/gg_content
47
Final point - continued monitoring
Essential to continued success
Adjust-and-rebalance scenarios
E.g. economizer optimization
Overall system health
SLA verification etc.
48
Q&A / Feedback
Please send any questions or comments on this
presentation to [email protected]
Check out our other
SNIA Green Tutorials!
Many thanks to the following individuals
for their contributions to this tutorial.
- SNIA Education Committee
Al Thomason
Wayne Adams
SW Worth
Larry Freeman
49

footprint otoh

Transcription

Similar documents

COBRACAM PRO

DriveSavers RAID Recovery Services

Sexy Shoeis - SHOEI Premium Helmets

(C) Engine - Automotriz En Video

ReadyNAS 300/500/600 Series Network Attached

i8500 iSCSI RAID SYSTEM

AMI-NAS2 2Bay

press release N°1

PRESS RELEASE N°1

CheCk ServiCeS