NAS and SAN Scaling Together

Similar documents
Distributed Filesystem

Coordinating Parallel HSM in Object-based Cluster Filesystems

Snia S SNIA Certified Storage Professional (SCSP)

A SCSI Transport Layer Extension with Separate Data and Control Paths for Scalable Storage-Area-Network Architectures

Connectivity. Module 2.2. Copyright 2006 EMC Corporation. Do not Copy - All Rights Reserved. Connectivity - 1

Storage Area Networks SAN. Shane Healy

Isilon Scale Out NAS. Morten Petersen, Senior Systems Engineer, Isilon Division

Object Storage: Redefining Bandwidth for Linux Clusters

Lecture 9: MIMD Architectures

Copyright 2012, Oracle and/or its affiliates. All rights reserved.

A GPFS Primer October 2005

RIGHTNOW A C E

IBM Spectrum Protect Version Introduction to Data Protection Solutions IBM

Leveraging Software-Defined Storage to Meet Today and Tomorrow s Infrastructure Demands

IBM Tivoli Storage Manager Version Introduction to Data Protection Solutions IBM

Readings. Storage Hierarchy III: I/O System. I/O (Disk) Performance. I/O Device Characteristics. often boring, but still quite important

CS550. TA: TBA Office: xxx Office hours: TBA. Blackboard:

E-Seminar. Storage Networking. Internet Technology Solution Seminar

designed. engineered. results. Parallel DMF

New HPE 3PAR StoreServ 8000 and series Optimized for Flash

Isilon Performance. Name

TechTour. Winning Technology Roadmaps. Sig Knapstad. Cutting Edge

High-Energy Physics Data-Storage Challenges

SONAS Best Practices and options for CIFS Scalability

VMware vsphere Clusters in Security Zones

VERITAS Volume Manager for Windows 2000

Lecture 9: MIMD Architectures

As storage networking technology

Lustre A Platform for Intelligent Scale-Out Storage

vsan Security Zone Deployment First Published On: Last Updated On:

VMware Virtual SAN. Technical Walkthrough. Massimiliano Moschini Brand Specialist VCI - vexpert VMware Inc. All rights reserved.

HACMP High Availability Introduction Presentation February 2007

Exam : S Title : Snia Storage Network Management/Administration. Version : Demo

How Scalable is your SMB?

Chapter 10: Mass-Storage Systems

HPC File Systems and Storage. Irena Johnson University of Notre Dame Center for Research Computing

Data Management. Parallel Filesystems. Dr David Henty HPC Training and Support

Clustering and Reclustering HEP Data in Object Databases

Sun Fire V880 System Architecture. Sun Microsystems Product & Technology Group SE

Chapter 10: Mass-Storage Systems. Operating System Concepts 9 th Edition

IMT Standards. Standard number A Server Blade. GoA IMT Standards

CS 111. Operating Systems Peter Reiher

ASN Configuration Best Practices

Section 2 Storage Systems Architecture

Storage Area Networks: Performance and Security

Deploying Scalable Switched NAS Infrastructures in the NFS Environment

EditShare XStream EFS Shared Storage

Introduction to parallel Computing

Deep Learning Performance and Cost Evaluation

MySQL Database Scalability

Evaluating Cloud Storage Strategies. James Bottomley; CTO, Server Virtualization


NFS: What s Next. David L. Black, Ph.D. Senior Technologist EMC Corporation NAS Industry Conference. October 12-14, 2004

Transactions on Information and Communications Technologies vol 15, 1997 WIT Press, ISSN

EMC XTREMCACHE ACCELERATES MICROSOFT SQL SERVER

Storage Systems. Storage Systems

SSDs that Think. Noam Mizrahi Vice President, Technology and Architecture CTO Office, Marvell

White Paper. Major Performance Tuning Considerations for Weblogic Server

Comparison: Microsoft Logical Disk Manager (LDM) and VERITAS Volume Manager

NUMA replicated pagecache for Linux

Storage Hierarchy Management for Scientific Computing

I/O: State of the art and Future developments

Data Sheet: Storage Management Veritas Storage Foundation for Oracle RAC from Symantec Manageability and availability for Oracle RAC databases

Securing the Frisbee Multicast Disk Loader

DDN. DDN Updates. Data DirectNeworks Japan, Inc Shuichi Ihara. DDN Storage 2017 DDN Storage

Upgrade to Webtrends Analytics 8.5: Best Practices

MIMD Overview. Intel Paragon XP/S Overview. XP/S Usage. XP/S Nodes and Interconnection. ! Distributed-memory MIMD multicomputer

Assignment 5. Georgia Koloniari

Lessons learned implementing a multithreaded SMB2 server in OneFS

GFS Overview. Design goals/priorities Design for big-data workloads Huge files, mostly appends, concurrency, huge bandwidth Design for failures

EMC XTREMCACHE ACCELERATES VIRTUALIZED ORACLE

Distributed Systems LEEC (2006/07 2º Sem.)

Isilon: Raising The Bar On Performance & Archive Use Cases. John Har Solutions Product Manager Unstructured Data Storage Team

Veritas Storage Foundation for Oracle RAC from Symantec

Tuning WebHound 4.0 and SAS 8.2 for Enterprise Windows Systems James R. Lebak, Unisys Corporation, Malvern, PA

1Highwinds. Software. Highwinds Software LLC. Document Version 1.1 April 2003

Computer Architecture 计算机体系结构. Lecture 6. Data Storage and I/O 第六讲 数据存储和输入输出. Chao Li, PhD. 李超博士

SAN Storage Array Workbook September 11, 2012

CS370 Operating Systems

VMware vstorage APIs FOR ARRAY INTEGRATION WITH EMC VNX SERIES FOR SAN

Patriot Hardware and Systems Software Requirements

IBM IBM Open Systems Storage Solutions Version 4. Download Full Version :

Disk to Disk Data File Backup and Restore.

Scaling Data Center Application Infrastructure. Gary Orenstein, Gear6

Storage Management Solutions. The Case For Efficient Data Management In Broadcast

Opportunities from our Compute, Network, and Storage Inflection Points

IBM Db2 Analytics Accelerator Version 7.1

NAS for Server Virtualization Dennis Chapman Senior Technical Director NetApp

FlashGrid Software Enables Converged and Hyper-Converged Appliances for Oracle* RAC

TECHNOLOGY BRIEF. Compaq 8-Way Multiprocessing Architecture EXECUTIVE OVERVIEW CONTENTS

Costefficient Storage with Dataprotection

The Google File System

CLOUD COMPUTING IT0530. G.JEYA BHARATHI Asst.Prof.(O.G) Department of IT SRM University

Network Storage Appliance

VERITAS Storage Foundation 4.0 for Windows

Title: CompTIA Storage+ Powered by SNIA

Scalability Testing of DNE2 in Lustre 2.7 and Metadata Performance using Virtual Machines Tom Crowe, Nathan Lavender, Stephen Simms

I/O Design, I/O Subsystem, I/O-Handler Device Driver, Buffering, Disks, RAID January WT 2008/09

Operating System Performance and Large Servers 1

BIG DATA AND HADOOP ON THE ZFS STORAGE APPLIANCE

Transcription:

NAS and SAN Scaling Together (NASD Approach) Departamento de Informática, Universidade do Minho

Summary Motivations - Specialized Storage Entity Actual solutions (NAS and SAN) NASD architecture Active Disks - Enabling NASD Devices Conclusions NAS and SAN Scaling Together p.1/1

Specialized Storage Entity Motivations: Storage Bandwidth becomes critical video Data-Intensive Humankind will generate vast amounts of new data makes storage management easier increases data availability enables Data Sharing NAS and SAN Scaling Together p.2/1

Existing Solutions (NAS) NAS Main Properties: Filesystem oriented NFS/CIFS natural successor server in a Stand Alone Box with Hot-Swappable RAID behaves as another application execution, leading to CPU consumption NAS and SAN Scaling Together p.3/1

Existing Solutions (SAN) SAN Main Properties: set of two or more storage devices communicating through a serial SCSI Protocol SANs refers to the storage device itself and the network hardware to which it is attached block oriented used for high performance architectures demanding low latency and direct data access does not provide File Sharing, instead it allows multiple clients to access the same device without Concurrency Control Mechanism NAS and SAN Scaling Together p.4/1

Differences Between NAS and SAN SAN NAS Protocol Serial SCSI-3 NFS/CIFS Shares Raw disk and tape drives Filesystems Share Examples /dev/scd0 /mnt/nfsmount NAS and SAN Scaling Together p.5/1

Typicall NAS and SAN Usage Clients applications are connected to a SAN-like network NAS and SAN Scaling Together p.6/1

Typicall NAS and SAN Usage Clients applications receive Data from a File Servers NAS and SAN Scaling Together p.7/1

Combining NAS and SAN NAS Flaws: server Bottleneck (store-and-forward, concurrency control and metadata consistency) becomes worse if server also bridges traffic between diferent networks SAN Flaws: controller Bottleneck (a controller is needed to operate access to devices) incapacity to present File Sharing due to the Block Oriented Interface security matters are not solved easly NAS and SAN Scaling Together p.8/1

NAS And SAN Collaborating NAS Distributing Files which are stored in a SAN-like environment NAS and SAN Scaling Together p.9/1

NASD Architecture Scalable Solution embbeds disk management functions in the device Variable Length Object Interface (metada is Known only at the drive) File Managers grant persistent capabilities over Object access clients holding access to a specified Object, contact directly with the drive. The drive replies back directly without File Manager assistance accesses are validated against Cryptographic Techniques at the device NAS and SAN Scaling Together p.10/1

NASD Architecture (Cont.) NASD Standard Properties: Direct Transfer Asynchronous Oversight Cryptographic Integrity Object-based Interface NAS and SAN Scaling Together p.11/1

Active Disks and NASD Devices Smart Drives with Microprocessor, Memory, and Comunication Subsystem.18 microns circuit production frees space at the device which may be used to embbed a 200MHz processor enables NASD procedures like filesystem management and cryptographic tasks extra CPU cycles may be used to execute Applicational code this approach extends Cluster Based Processing NAS and SAN Scaling Together p.12/1

NASD Overview NAS and SAN Scaling Together p.13/1

Conclusions Need for Distributed Data NAS and SAN as Two Distinct Phylosophies to Grant Distributed Storage NAS/SAN Hybrid Solutions are the New Trends NASD as a Scalable Hybrid Approach Enabling NASD With Active Disks NAS and SAN Scaling Together p.14/1