(Scale Out NAS System)

Transcription

For Unlimited Capacity & Performance
Clustered NAS System
(Scale Out NAS System)
Copyright© 2010 by Netclips, Ltd. All rights reserved
-0-
1
NAS Storage Trend
2
Scale-Out NAS Solution
3
Scaleway Advantages
4
Product Comparison
5
Applied Fields & Case Studies
-1-
NAS Storage Trend
Current NAS systems which suitable for data sharing on network faced problems occurred by
increasing clients and processing huge I/O. New Scale-out NAS system expands its market to
solve the problem.
Traditional NAS
Scale-Out NAS
Clients
Network
WAN
+
SCALEWAY
• TCO reduction management
• Just-in-time expansion
• Independent expansion of performance or
capacity
• Higher utilization rates
• Non-disruptive technology
• Integration of management
• Automated and policy based management
• Performance and capacity expansion issues
– Limitation on single file system size
– Number of active headers limit
• Over-Provisioning on storage
• Multiple mount points
• File location management required
• File duplication (Affects read performance)
New SCALEWAY
-2-
Why ScaleScale-Out NAS Storage?
Many enterprises require high-performance storage solutions which can process non-linear
high-capacity data like multimedia, digital contents increased geometrically and huge number
of files created by applications.
Scale-Out NAS
•
Clients Group
Provides integration and management of data over
Petabytes
•
Reducing TCO
•
Cloud storage on all kinds of business data types,
010010
000010
010010
000010
010010
000010
010010
000010
010010
000010
010010
000010
010010
000010
010010
000010
010010
000010
010010
000010
010010
000010
010010
000010
010010
000010
010010
000010
010010
000010
010010
000010
1G/ 10G/ IB
automated and integrated hierarchical storage and
information lifecycle management
•
Billions of files are supported by self managed and
automated policy based tiered storage
•
Provides capacity expansion, fastest search,
SAN or Direct
backup/restore, expandability, modular design,
availability and flexibility
•
Supports intellectual load-balancing and dynamic
thin-provisioning
•
Starts from small but expandable when business
requirement changes
Shared Disk Pool
-3-
What is SCALEWAY?
(Scale Out NAS Gateway)
Guaranteed high-performance NAS solution
which has improved its performance and
scalability in the fundamental limits of existing
storage products.
-4-
SCALEWAY Characteristics
l Customized bandwidth configuration from minimum 2 to over 1,000 nodes
l Internal storage virtualization makes customized volume configuration for the
customer
l 14PB on single volume (multiple volume configuration can be possible)
l Same vendor or heterogeneous vendors storage support
l Reducing TCO by expanding/reducing storage using thin-provisioning
l User friendly web based GUI management
l Storage policy using ILM
l High-cost snapshot, mirroring, replication option included as default
l Provides integration and management of data over Petabytes
l Designed to expand by Petabytes scale on single global namespace
l Cloud storage on all kinds of business data types
l automated and integrated hierarchical storage and information lifecycle management
l Billions of files supported by tiered storage based on automated policy
l Capacity expansion, fastest search, backup/restore, replication
l Provides availability, flexibility by modular design
l Supports intellectual load-balancing and dynamic thin-provisioning
l High-performance, expandability, availability
l expandability supported when business requirement changes
-5-
Scaleway Infrastructure
Client Group
UNIX/LINUX
MAC
Windows
Network I/F
(NFS, CIFS, FTP, HTTP)
1G/10G Ethernet,
Infiniband
...
4G/8G FC,
PCI-ex
Array Group: FC, SAS, SATA, PCI-ex
-6-
SCALEWAY I/O Structure
Client Data
Client
Group
TCP/IP LAN
....
SCALEWAY
Storage
Volume
Disk Array
Every SCALEWAY nodes can access storage volumes
Clients can access storage volumes through all SCALEWAY nodes
SCALEWAY node can be extended to over 1,000 nodes and all nodes are working as active
In case of SCALEWAY node failure, the I/O is maintained via other SCALEWAY node by automatic
fail-over, and uninterrupted increase or decrease SCALEWAY nodes and storages.
• By the client’s requirements, SCALEWAY nodes can make performance higher and bottlenecks
can be solved fundamentally
•
•
•
•
-7-
Automatic Fail Over
/Data
SCALEWAY
node
Clients
Shared Storage
• When node or network fails, SCALEWAY handles I/O separately via other live nodes
• In failure situation, SCALEWAY stores shared storage using other nodes automatically
-8-
Flexible Performance Improvement Structure
Group 1
Group 2
Group 3
Group 4
Clients
TCP/IP LAN
....
Scaleway Nodes
Extended to over
1,000 nodes
Bandwidth
20000
• SCALEWAY’s performances can be improved
through adding SCALEWAY nodes by linear
…
• When increasing clients and I/O access, it is
easy to solve performance problem by
N Node
adding SCALEWAY node (to over 1,000
기본 : n*4GB
1Gb NIC : n*12GB
1
(Gb)
nodes)
10Gb NIC : n*20GB
1
2
(Node)
3
…
Max
1,000
Node
-9-
• Increase or decrease of SCALEWAY nodes
when it is on-line
Petabytes Single Volume File System
Clients
LAN (1Gb/10Gb)
SCALEWAY node
14.4PB
Maximum 14.4PB
on Single volume
...
Storage
• Storage can be expanded, regardless of storage vendors
• FC, SAS, SATA storage can be applied differently for the work depends
-10-
Thin Provisioning
Removing Storage
Adding New Storage
X
80%
80%
80%
60%
60%
60%
60%
Shared Storage Pool
30%
30%
30%
40%
40%
40%
Shared Storage Pool
• Disk configuration necessary capacity only on on-line status (not required total
capacity on initial installation)
• Volume decrease on on-line status by removing unnecessary disks
–
–
File system reconfiguration is based on striping (can only on expanding volume space)
No data corruption and configured automatically or manually
-11-
30%
Easy Management using Web based GUI
•
•
•
•
Storage consolidation through GUI S/W management (web browser access)
Supports all OS based on Java
Real-time storage usage monitoring
E-mail notification by storage fault level
User Quota
Management
Cluster Node
Management
Storage Usage
Management
File System
Management
-12-
Storage Policy (ILM)
Based on user’s data operation policy, storage
configuration inside single file system can be possible
§ Separating storage pools (FC, SAS and
SATA disks) to maximize operation
efficiently for purposes
§ During operation of several pools, data
moving between pools by policy
adaption can be possible
§ Storage pooling can be possible by
dividing storage classes into hierarchical
structure
Storage
Network
System
Enterprise:
Priority Data Area
Tape
Mid-Rang :
Genera Data Area
Low-end:
Archive Area
-13-
Default Feature - Snapshot
Using snapshot, it is used for backup and test purpose
without damaging real data
• Instant replication based on Point-in-Point
• In case of logical data damage, user can
restore using scheduled snapshot information
• Replicated volumes can be used for
Storage
Snapshot
various purpose
• Maximum 256 snapshots per file system
개발/Test
Snapshot
Snapshot is default feature
MON 09:00
TUE 10:00
WED 15:00
Backup
-14-
Default Feature - Replication
A Site
B Site
TCP/IP LAN
TCP/IP LAN
SCALEWAY Cluster
Original
Volume
A
Backup
Volume
B
SCALEWAY Cluster
WAN
Backup
Volume
A
Console
Console
• Replication
– Asynchronous replication by file
– Can be built as low cost through LAN/WAN infrastructure
– Can be built different type of storages between main and backup center
Original
Volume
B
-15-
Default Feature - Mirroring
• Mirroring
• Providing synchronous replication to storages inside a cluster, making high-
availability solution to access data from mirrored disks when a disk fails
– Block level intra-cluster replication by node (synchronous)
– Configured as subset of file system
-16-
TRANSFER Agent
TRANSFER Agent is a customizable data transfer/lifecycle management module to support work
environments via connecting with extra-systems for broadcasts, HSM operations and archiving.
– Watch folder feature : An automatic file transfer
from source to destination
– Supported source volumes : Any file system
Source
Network
Destination
Network
including SNFS(Xsan)
– Supported sending file protocols : CIFS, FTP
– TRANSFER Agent Management Client
–
Transfer error correction by manual request to resend
– Transfer logs : Filename, start/finish time and/or
date to send, transfer results, etc.
– To re-send, select unsuccessful file(s) and press
“Re-Send” button only
Moved by non-digitalized way
-17-
HP IBRIX Product Comparison
Architecture Scaleway vs HP IBRIX
For IBRIX, files are located by disks, but SCALEWAY, files are splitted as blocks to stripe and store
data on storage. It is high performance design for single operation uses all file servers/disk
LUNs/each disks to store data.
Scaleway
IBRIX
-18-
Applied Fields
Digital Media
Animation
Broadcasting
Video Surveillance
Highly Available Scalable file
storage
User File storage
Multi-Site installations
Disaster Recovery
Database Applications
DB2
Oracle RAC
SAP
Web Applications
Grid Applications
Email services
Web Server Farm
Online Data Storage
Scientific Computing
Life Sciences
Analytics
-19-
Case Study – W Company Filehosting Service
File UP/Down APP
L4 Switch
Redhat Linux
24 File Servers
Customer Requirements
Scaleway Agent
• Provide up/downloading the same data
on multiple file server
• Supporting large file system (over 10TB)
• 24 hours uninterrupted service
• Improving performance for additional
services
Gigabit S/W
4 SCALEWAY Nodes
•
Data sharing on file servers through
SCALEWAY nodes
–
–
•
Improved I/O performance by using agents
–
SAN Switch
0
1
2
3
4
5
6
7
8
9 10 11
–
•
Performing I/O separated with 4 nodes from
file servers
Over 1.8 times better performance than ever
Custoer satisfied improved performance
–
8 SATA Storages
24 file servers share 128TB volume
7 multiple volumes (15TB per volume)
–
Before implementation, data was stored and
managed on each server
Customer satisfied at data sharing of
SCALEWAY and using agents on file servers
that improve performances
Effects after implementation
Shared Storage Pool
-20-
Case Study – H Financial Company
HP Blade Server
For VM Ware
Windows 2003
1G * 3 LAN
• Data integration
• Storage access for virtual server (VMware)
Gigabit Switch
system
• Supports SAN and NAS simultaneously
• Continuous service in node failure
• Improving performance for additional
services
SAN
• Implementing integrated infrastructure
Scaleway™ Node
Group
1G * 4 LAN
•
•
•
SAN Switch
•
makes computing management easier
Main and backup data operations are
separated
Real-time data sharing via SCALEWAY
Best services provided by 3 nodes and
keep work consistency on failure
Implement performance by adding
nodes for additional services
4TB(FC HDD)
10TB(SATA HDD)
-21-
Case Study – M Broadcasting Company
FTP
Service
Streaming
Service
1G * 4 LAN
Trunking
CMS
Catalog
HD NLE
SD NLE
•
•
•
•
•
High performance FTP service
Edited video data sharing
Supporting large file system (over 20TB)
Continuous service in node failure
Improving performance for additional
services
•
High performances service through 2
SCALEWAY nodes
•
Decrease editing time through realtime data sharing between office and
field personnel
•
Provided work consistency by using 2
nodes on failure
•
Improving performances for
additional services
Gigabit Switch
Scaleway Node
Scaleway Node
40TB(SATA HDD)
-22-
Conclusion
• Best Performances (1GbE/10GbE/IB supported)
• Complete stability (RAID, Replication, Mirroring)
• Reducing TCO by planned procurement from initial installation to
the future
• Prepared for uncertain expansion of storages (Thin Provisioning)
• Convenience of management (24x7) and storage consolidation
satisfying customer’s standard
• Improve performance combining high performance system
utilization properly
-23-
Reference
-24-
-25-

(Scale Out NAS System)

Transcription

Similar documents

AVS24 2.4 GHZ Wireless Audio/Video Sender

HEMINEVRIN - Alcohol and Alcoholism

No trophy could ever fully express our

Chaise Lounge

A golden opportunity to A golden opportunity to

Building Capacity, Creating Jobs, Discovering and Developing

New User FFM Marketplace Testing

Exhibition sales brochure Exhibit at the HR Software Showand build

Pookoo Industrial Co., Ltd.

2015 Top Ten News of China`s Paper Industry

ZStore - A distributed key-value storage system Technical Report

P2P Systems

Considering Mobile Devices, Context Awareness, and Mobile Users

the entire thesis - Southern Cross Business School

Papnet: An order-preserving and latency-aware P2P

Inside the RS/6000 SP

The RS/6000 SP Inside Out - Potsdam Institute for Climate Impact