Geographically Distributed Software Defined Storage (the proposal)
|
|
- Francis Chandler
- 6 years ago
- Views:
Transcription
1 Geographically Distributed Software Defined Storage (the proposal) A. Y. Shevel 1,2,a, S. E. Khoruzhnikov 1, V.A. Grudinin 1, O. L. Sadov 1, A. B. Kairkanov 1 1 ITMO University, 49, Kronverksky prospect, St. Petersburg, Russia 2 National Research Center Kurchatov Institute, Petersburg Nuclear Physics Institute, 1, Orlova Roscha, Gatchina, , Russia a shevel_a_y@niuitmo.ru The volume of the coming data in HEP is growing. The volume of the data to be held for a long time is growing as well. Actually large volume of data big data is distributed around the planet. In other words now there is a situation where it is necessary to integrate storage resources from many data centers located far from each other. That means that the methods, the approaches how to organize and manage the globally distributed data storage are required. The distributed storage has several examples for personal needs like owncloud.org, pydio.com, seafile.com, sparkleshare.org. For enterprise-level there is a number of SWIFT distributed storage systems (part of Openstack), CEPH and the like which are mostly object storage. When several data center s resources are integrated, the organization of data links becomes very important issue especially if several parallel data links between data centers are used. The situation in data centers and in data links may vary each hour. All that means each part of distributed data storage has to be able to rearrange usage of data links and storage servers in each data center. In addition, for each customer of distributed storage different requirements could appear. The above topics are planned to be discussed in data storage proposal. Keywords: software defined storage, software defined network, deduplication, compression, distributed storage, data transfer A. Y. Shevel, S. E. Khoruzhnikov, V.A. Grudinin, O. L. Sadov, A. B. Kairkanov 62
2 1. Introduction In tuning of real storage system there are a lot of aspects and questions even the storage servers are located in one room. The number of nuances is much more in geographically distributed storage systems. The part of them are quite obvious, for example, reliable and secure data transfer over Internet between data storage and client. In addition there are data transfers to do data synchronization to guarantee the replicas of the data are completely equal each other in different sites. Storage of the data in remote site and data transfer over long distance do require additional precautions such as a data encryption. Data compression and data deduplication are also important to decrease the total data volume to transfer and store. More and more often we are dealing with big data. 2. Sources of the big data Among sources of Big Data we have to mention scientific experimental installations: ~1 PB/year - International Thermonuclear Experimental Reactor (ITER - ~10 PB/year - Large Synoptic Survey Telescope (LSST - ~20-30 PB/year CERN ( ~20-30 PB/year Facility for Antiproton and Ion research (FAIR - ~20-30 PB/year The Cherenkov Telescope Array (CTA - ~ PB/year - Square Kilometre Array (SKA - In According to consensus estimation total volume of data in the World grows two times a year, i.e. about 75% of data was written in last two years. 3. Current solutions for large volume data storage Quite a lot of different studies and developments were presented in [Shirinbab, et al., 2013; Blomer, 2014; Analysis of Six Distributed File Systems, 2013]. Also pretty long list of distributed file/storage systems is available in [Comparison of distributed file systems]. A number of developments to meet concrete needs are described in [Espinal, Adde,, 2014; XtreemFS ; Software Defined Storage LizardFS ; Dutka, 2015; Roblitz, 2012; Why so Sirius?...]. There is a range of studies with presenting benchmarks in [Zhang, et al., 2015; Wong, et al., 2014]. The distributed storage is not possible to discuss without network architecture. Software Defined Network (SDS) approach is discussed in [Cui, et al., 2016]. All those sources give the idea which is the main feature to be included into the design of a scalable multi-tenant SDS system. 4. Main features of distributed storage SDS is an evolving concept in which the management and provisioning of data storage is decoupled from the physical storage hardware. SDS should include: Automation Simplified management that reduces the cost of maintaining the storage Infrastructure; Standard Interfaces APIs for the management, provisioning and maintenance of storage devices and services; Virtualized Data Path Block, File and Object interfaces that support applications written to these interfaces; Scalability Seamless ability to scale the storage infrastructure without disruption to availability or performance. 63
3 Any multi-tenant applications running on the public cloud could benefit from the concepts introduced by SDS by managing the allocation of tenant data. Important features of the Globally Distributed Software Defined Storage (GDSDS): Data store and Data transfer between client and data storage; also between components of the distributed storage; Reliability: data replication, erasure coding; Reduce the data volume to store and transfer: Data compression, data deduplication (at number of replicas, at level of files, at block level); Security: Data encryption, ACL; User interfaces: web portal and set of Command Line Interfaces; Advanced network architecture; Optimal Caching, Tiering; Automatic storage deployment by user request. It is assumed in the proposal: GDSDS consists of several groups of storage servers (in Data Centers DC) located in geographically different regions. Group of servers (DCs) are connected by a number of parallel virtual data links. Data links may have different features: speed, price, encryption type (including quantum encryption), etc. Data links have to be configured with SDN. GDSDS has web portal for clients and administrators to control and monitoring. Client can ask to perform a number of operations: o Create, Delete, Replicate, Migrate, etc of the Virtual Storage Instance (VSI) allocated in GDSDS. o The VSI can be created with different service level agreement (SLA). o Write/Read data to/from the VSI. SLA may include, for example: Data Encryption (with specific type of Encryption). Data Compression (with specific type of compression). Number of replicas. Erasure coding (specific type or/and parameters). In one specific Data Center (DC) or in many DCs with specific types of data links in between DCs. Newly created VSI may have character of object storage, file system, or block storage. Type of backend (CEPH, SWIFT, etc). The preference of access to the geographically distributed data taking into account the context of CAP theorem [Gilbert, Lynch, 2002], choose two of three options: consistency, availability, network partitioning. 5. General consideration The general scheme of the GDSDS is shown in the fig.1. The clients can be also distributed around the World (client can be a person with desktop or smart phone, virtual machine in client data center, also client can be an organization with its own DC, etc). Several clients can use same VSI. In the fig.1 it is shown that all four clients have virtual storage which is located in two or more DCs. Obviously the connection between client and DCs with data located is very important for data transfer speed. 64
4 If VSI has one or more replicas it make sense to allocate data replicas in different DCs. At this point we have to take several aspects into account. First of all we (and client) must plan the procedure of the replicas synchronization. The synchronization of the data between DCs takes time. Do we permit the clients to access the replica during synchronization time or we need to put client request in wait state until the synchronization completes or clients have to be routed to most new replica data? The answer depends on client s business. In some cases client does not care, for example, in Google different clients in geographically different regions obtain different results on the same search request. In other cases clients could have another expectations, for example, they could expect exactly the same result (or very close in some context) on the request from any geographical region. Fig. 1 General scheme of the GDSDS. The synchronization is important when the data in VSI is changing quite often. However even in case the owner did not change the data in VSI the synchronization procedure has to be repeated over some time just to be sure that no errors appeared in data due to any cause. In general, it is necessary to recalculate all hashes in each DC where the replicas are and probably to transfer some fractions of the data to accomplish synchronization. If volume of VSI is around tens (or more) of PB the synchronization time may be significant. What could we suggest to clients at this significant time? Another question how client chooses replica for reading from (or writing to) VSI. It is possible in round robin manner, or just where DC responses faster on the client request. The consideration does emphasize again that there are a lot of various choices for clients therefore we need configurable environment to meet client expectations. 65
5 6. Proposal status and plan A simple prototype was created with only backend CEPH (version ). The prototype has been deployed using several virtual machines (VM). Each VM has 2 virtual CPU, 8 GB of memory, three HDD drives (4 TB each). One drive in VM is used for CEPH logs, other two - for the data. In total we use now 21 OSD daemons. Two host servers are running under Scientific Linux 7.2. Host servers are located in different sites with a distance about 40 Km. They are connected over Internet with data link of nominal speed 1Gbit. Three OSD daemons are running in docker environment. Docker environment for OSD daemon is considered as most effective solution for storage server. We plan to create first open source and working version for the GDSDS next year. Of course we need support and volunteers. 7. Conclusion We have analyzed a range of distributed storage systems, paid attention to most important features of these systems and suggested developing Geographically Distributed Software Defined Storage. 8. Acknowledgement The research has been carried out with the financial support of the Ministry of Education and Science of the Russian Federation under grant agreement # (RFMEFI57514X0058). References Analysis of Six Distributed File Systems // HAL-Inria URL: /file/a_survey_of_dfs.pdf. Blomer J. Survey of distributed file system technology // ACAT 2014, Prague (in references) Also iopscience.iop.org/article/ / /664/4/042004/pdf. Comparison of distributed file systems [Electronic resource]: Cui L. et al. When big data meets software-defined networking: SDN for big data and big data for SDN // IEEE Network. Vol. 30, Issue 1. P DOI: /MNET Dutka L. OneData. [Electronic resource]: URL: q=onedata%20storage&pg=pa312#v=onepage&q=onedata%20storage&f=true Espinal X., Adde G., Chan B., Iven J., Lo Presti G., Lamanna M., Mascetti L., Pace A., Peters A., Ponce S., Sindrilaru E. Disk storage at CERN: Handling LHC data and beyond // 20th International Conference on Computing in High Energy and Nuclear Physics (CHEP2013) // Journal of Physics: Conference Series Vol P doi: / /513/4/ URL: Gilbert S., Lynch N. Brewer s conjecture and the feasibility of consistent, available, and partitiontolerant web services // ACM SIGACT News Vol. 33, Issue 2. Roblitz T. Towards Implementing Virtual Data Infrastructures a case study with irods // Computer Science Vol. 13, Issue 4. URL: 66
6 Shirinbab S. et al. Performance Evaluation of Distributed Storage Systems for Cloud Computing // IJCA Vol. 20, No. 4. P Software Defined Storage LizardFS is a distributed, scalable, fault-tolerant and highly available file system [Electronic resource]: Why so Sirius? Ceph backed storage at the RAL Tier [Electronic resource]: Wong M.-T. et al. Ceph as WAN Filesystem Performance and Feasibility Study through Simulation // Network Research Workshop Proceedings of the Asia-Pacific Advanced Network Vol. 38. P URL: ISSN XtreemFS is a fault-tolerant distributed file system for all storage needs [Electronic resource]: Zhang X. et al. Ceph Distributed File System Benchmarks on an Openstack Cloud // Conference Paper, November URL: 67
SERVICE RELIABILITY IN THE CLOUD OF DATA CENTERS UNDER OPENSTACK
SERVICE RELIABILITY IN THE CLOUD OF DATA CENTERS UNDER OPENSTACK P.V. Fedchenkov 1, S.E. Khoruzhnikov 1, V.A. Grudinin 1, O.L. Sadov 1, A.E. Shevel 1,2,a, A.B. Kairkanov 1, O.I. Lazo 1, A.A. Oreshkin 2
More informationAPPROACHES TO THE AUTOMATED DEPLOYMENT OF THE CLOUD INFRASTRUCTURE OF GEOGRAPHICALLY DISTRIBUTED DATA CENTERS
APPROACHES TO THE AUTOMATED DEPLOYMENT OF THE CLOUD INFRASTRUCTURE OF GEOGRAPHICALLY DISTRIBUTED DATA CENTERS P.V. Fedchenkov 1,a, N.Y. Samokhin 1, S.E. Khoruzhnikov 1, O.I. Lazo 1, A.Y. Shevel 1,2 1 Department
More informationDeploying Software Defined Storage for the Enterprise with Ceph. PRESENTATION TITLE GOES HERE Paul von Stamwitz Fujitsu
Deploying Software Defined Storage for the Enterprise with Ceph PRESENTATION TITLE GOES HERE Paul von Stamwitz Fujitsu Agenda Yet another attempt to define SDS Quick Overview of Ceph from a SDS perspective
More informationA product by CloudFounders. Wim Provoost Open vstorage
A product by CloudFounders Wim Provoost (@wimpers_be) Open vstorage (@openvstorage) http://www.openvstorage.com CloudFounders vrun Converged infrastructure that combines the benefits of the hyperconverged
More informationNext Generation Storage for The Software-Defned World
` Next Generation Storage for The Software-Defned World John Hofer Solution Architect Red Hat, Inc. BUSINESS PAINS DEMAND NEW MODELS CLOUD ARCHITECTURES PROPRIETARY/TRADITIONAL ARCHITECTURES High up-front
More informationCERN European Organization for Nuclear Research, 1211 Geneva, CH
Disk storage at CERN L Mascetti, E Cano, B Chan, X Espinal, A Fiorot, H González Labrador, J Iven, M Lamanna, G Lo Presti, JT Mościcki, AJ Peters, S Ponce, H Rousseau and D van der Ster CERN European Organization
More information-Presented By : Rajeshwari Chatterjee Professor-Andrey Shevel Course: Computing Clusters Grid and Clouds ITMO University, St.
-Presented By : Rajeshwari Chatterjee Professor-Andrey Shevel Course: Computing Clusters Grid and Clouds ITMO University, St. Petersburg Introduction File System Enterprise Needs Gluster Revisited Ceph
More informationA New Key-value Data Store For Heterogeneous Storage Architecture Intel APAC R&D Ltd.
A New Key-value Data Store For Heterogeneous Storage Architecture Intel APAC R&D Ltd. 1 Agenda Introduction Background and Motivation Hybrid Key-Value Data Store Architecture Overview Design details Performance
More informationA Gentle Introduction to Ceph
A Gentle Introduction to Ceph Narrated by Tim Serong tserong@suse.com Adapted from a longer work by Lars Marowsky-Brée lmb@suse.com Once upon a time there was a Free and Open Source distributed storage
More informationStorage Key Issues for 2017
by, Nick Allen May 1st, 2017 PREMISE: Persistent data storage architectures must evolve faster to keep up with the accelerating pace of change that businesses require. These are times of tumultuous change
More informationStorage Virtualization. Eric Yen Academia Sinica Grid Computing Centre (ASGC) Taiwan
Storage Virtualization Eric Yen Academia Sinica Grid Computing Centre (ASGC) Taiwan Storage Virtualization In computer science, storage virtualization uses virtualization to enable better functionality
More informationStreamlining CASTOR to manage the LHC data torrent
Streamlining CASTOR to manage the LHC data torrent G. Lo Presti, X. Espinal Curull, E. Cano, B. Fiorini, A. Ieri, S. Murray, S. Ponce and E. Sindrilaru CERN, 1211 Geneva 23, Switzerland E-mail: giuseppe.lopresti@cern.ch
More informationYour cloud solution for EO Data access and processing
powered by Your cloud solution for EO Data access and processing Stanisław Dałek VP - CloudFerro 2 About CREODIAS The platform In 2017 European Space Agency, acting on behalf of the European Commission,
More informationCernVM-FS beyond LHC computing
CernVM-FS beyond LHC computing C Condurache, I Collier STFC Rutherford Appleton Laboratory, Harwell Oxford, Didcot, OX11 0QX, UK E-mail: catalin.condurache@stfc.ac.uk Abstract. In the last three years
More informationRenovating your storage infrastructure for Cloud era
Renovating your storage infrastructure for Cloud era Nguyen Phuc Cuong Software Defined Storage Country Sales Leader Copyright IBM Corporation 2016 2 Business SLAs Challenging Traditional Storage Approaches
More informationN. Marusov, I. Semenov
GRID TECHNOLOGY FOR CONTROLLED FUSION: CONCEPTION OF THE UNIFIED CYBERSPACE AND ITER DATA MANAGEMENT N. Marusov, I. Semenov Project Center ITER (ITER Russian Domestic Agency N.Marusov@ITERRF.RU) Challenges
More informationOnline data storage service strategy for the CERN computer Centre G. Cancio, D. Duellmann, M. Lamanna, A. Pace CERN, Geneva, Switzerland
Online data storage service strategy for the CERN computer Centre G. Cancio, D. Duellmann, M. Lamanna, A. Pace CERN, Geneva, Switzerland Abstract. The Data and Storage Services group at CERN is conducting
More informationJINR cloud infrastructure development
JINR cloud infrastructure development A.V. Baranov 1, N.A. Balashov 1, K.V. Fedorov 1, R.R. Gainanov 2, N.A. Kutovskiy 1,3,a, R.N. Semenov 1,3 1 Laboratory of Information Technologies, Joint Institute
More informationDevelopment of new security infrastructure design principles for distributed computing systems based on open protocols
Development of new security infrastructure design principles for distributed computing systems based on open protocols Yu. Yu. Dubenskaya a, A. P. Kryukov, A. P. Demichev Skobeltsyn Institute of Nuclear
More informationApplication of Virtualization Technologies & CernVM. Benedikt Hegner CERN
Application of Virtualization Technologies & CernVM Benedikt Hegner CERN Virtualization Use Cases Worker Node Virtualization Software Testing Training Platform Software Deployment }Covered today Server
More informationScale-out Storage Solution and Challenges Mahadev Gaonkar igate
Scale-out Solution and Challenges Mahadev Gaonkar igate 2013 Developer Conference. igate. All Rights Reserved. Table of Content Overview of Scale-out Scale-out NAS Solution Architecture IO Workload Distribution
More informationContrail Cloud Platform Architecture
Contrail Cloud Platform Architecture Release 13.0 Modified: 2018-08-23 Juniper Networks, Inc. 1133 Innovation Way Sunnyvale, California 94089 USA 408-745-2000 www.juniper.net Juniper Networks, the Juniper
More information클라우드스토리지구축을 위한 ceph 설치및설정
클라우드스토리지구축을 위한 ceph 설치및설정 Ph.D. Sun Park GIST, NetCS Lab. 2015. 07. 15 1 목차 Cloud Storage Services? Open Source Cloud Storage Softwares Introducing Ceph Storage Ceph Installation & Configuration Automatic
More informationEvaluation of the Huawei UDS cloud storage system for CERN specific data
th International Conference on Computing in High Energy and Nuclear Physics (CHEP3) IOP Publishing Journal of Physics: Conference Series 53 (4) 44 doi:.88/74-6596/53/4/44 Evaluation of the Huawei UDS cloud
More informationTake Back Lost Revenue by Activating Virtuozzo Storage Today
Take Back Lost Revenue by Activating Virtuozzo Storage Today JUNE, 2017 2017 Virtuozzo. All rights reserved. 1 Introduction New software-defined storage (SDS) solutions are enabling hosting companies to
More informationOpen vstorage RedHat Ceph Architectural Comparison
Open vstorage RedHat Ceph Architectural Comparison Open vstorage is the World s fastest Distributed Block Store that spans across different Datacenter. It combines ultrahigh performance and low latency
More informationBuilding Service Platforms using OpenStack and CEPH: A University Cloud at Humboldt University
Building Service Platforms using OpenStack and CEPH: A University Cloud at Humboldt University Malte Dreyer 1, Jens Döbler 1, Daniel Rohde 1 1 Computer and Media Service, Humboldt-Universität zu Berlin,
More informationProvisioning with SUSE Enterprise Storage. Nyers Gábor Trainer &
Provisioning with SUSE Enterprise Storage Nyers Gábor Trainer & Consultant @Trebut gnyers@trebut.com Managing storage growth and costs of the software-defined datacenter PRESENT Easily scale and manage
More informationScality RING on Cisco UCS: Store File, Object, and OpenStack Data at Scale
Scality RING on Cisco UCS: Store File, Object, and OpenStack Data at Scale What You Will Learn Cisco and Scality provide a joint solution for storing and protecting file, object, and OpenStack data at
More informationpowered by Cloudian and Veritas
Lenovo Storage DX8200C powered by Cloudian and Veritas On-site data protection for Amazon S3-compliant cloud storage. assistance from Lenovo s world-class support organization, which is rated #1 for overall
More informationHedvig as backup target for Veeam
Hedvig as backup target for Veeam Solution Whitepaper Version 1.0 April 2018 Table of contents Executive overview... 3 Introduction... 3 Solution components... 4 Hedvig... 4 Hedvig Virtual Disk (vdisk)...
More informationKinetic drive. Bingzhe Li
Kinetic drive Bingzhe Li Consumption has changed It s an object storage world, unprecedented growth and scale In total, a complete redefinition of the storage stack https://www.openstack.org/summit/openstack-summit-atlanta-2014/session-videos/presentation/casestudy-seagate-kinetic-platform-in-action
More informationCeph Intro & Architectural Overview. Abbas Bangash Intercloud Systems
Ceph Intro & Architectural Overview Abbas Bangash Intercloud Systems About Me Abbas Bangash Systems Team Lead, Intercloud Systems abangash@intercloudsys.com intercloudsys.com 2 CLOUD SERVICES COMPUTE NETWORK
More informationVeeam Backup & Replication on IBM Cloud Solution Architecture
Veeam Backup & Replication on IBM Cloud Solution Architecture Date: 2018 07 20 Copyright IBM Corporation 2018 Page 1 of 12 Table of Contents 1 Introduction... 4 1.1 About Veeam Backup & Replication...
More informationSurFS Product Description
SurFS Product Description 1. ABSTRACT SurFS An innovative technology is evolving the distributed storage ecosystem. SurFS is designed for cloud storage with extreme performance at a price that is significantly
More informationHPE SimpliVity 380. Simplyfying Hybrid IT with HPE Wolfgang Privas Storage Category Manager
HPE SimpliVity 380 Simplyfying Hybrid IT with HPE Wolfgang Privas Storage Category Manager We ve seen flash evolve at a record pace 61% Have already deployed all-flash in some level and are increasing
More informationIntroducing SUSE Enterprise Storage 5
Introducing SUSE Enterprise Storage 5 1 SUSE Enterprise Storage 5 SUSE Enterprise Storage 5 is the ideal solution for Compliance, Archive, Backup and Large Data. Customers can simplify and scale the storage
More informationChallenges of Big Data Movement in support of the ESA Copernicus program and global research collaborations
APAN Cloud WG Challenges of Big Data Movement in support of the ESA Copernicus program and global research collaborations Lift off NCI and Copernicus The National Computational Infrastructure (NCI) in
More informationFLASHARRAY//M Smart Storage for Cloud IT
FLASHARRAY//M Smart Storage for Cloud IT //M AT A GLANCE PURPOSE-BUILT to power your business: Transactional and analytic databases Virtualization and private cloud Business critical applications Virtual
More informationHyper-Convergence De-mystified. Francis O Haire Group Technology Director
Hyper-Convergence De-mystified Francis O Haire Group Technology Director The Cloud Era Is Well Underway Rapid Time to Market I deployed my application in five minutes. Fractional IT Consumption I use and
More informationContrail Cloud Platform Architecture
Contrail Cloud Platform Architecture Release 10.0 Modified: 2018-04-04 Juniper Networks, Inc. 1133 Innovation Way Sunnyvale, California 94089 USA 408-745-2000 www.juniper.net Juniper Networks, the Juniper
More informationVMWARE VSAN LICENSING GUIDE - MARCH 2018 VMWARE VSAN 6.6. Licensing Guide
- MARCH 2018 VMWARE VSAN 6.6 Licensing Guide Table of Contents Introduction 3 License Editions 4 Virtual Desktop Infrastructure... 5 Upgrades... 5 Remote Office / Branch Office... 5 Stretched Cluster with
More informationThe Design Of Private Cloud Platform For Colleges And Universities Education Resources Based On Openstack. Guoxia Zou
4th National Conference on Electrical, Electronics and Computer Engineering (NCEECE 2015) The Design Of Private Cloud Platform For Colleges And Universities Education Resources Based On Openstack Guoxia
More informationSUSE OpenStack Cloud Production Deployment Architecture. Guide. Solution Guide Cloud Computing.
SUSE OpenStack Cloud Production Deployment Architecture Guide Solution Guide Cloud Computing Table of Contents page Introduction... 2 High Availability Configuration...6 Network Topography...8 Services
More informationMySQL and Ceph. A tale of two friends
ysql and Ceph A tale of two friends Karan Singh Sr. Storage Architect Red Hat Taco Scargo Sr. Solution Architect Red Hat Agenda Ceph Introduction and Architecture Why ysql on Ceph ysql and Ceph Performance
More informationA fields' Introduction to SUSE Enterprise Storage TUT91098
A fields' Introduction to SUSE Enterprise Storage TUT91098 Robert Grosschopff Senior Systems Engineer robert.grosschopff@suse.com Martin Weiss Senior Consultant martin.weiss@suse.com Joao Luis Senior Software
More informationPervasive Insight. Mission Critical Platform
Empowered IT Pervasive Insight Mission Critical Platform Dynamic Development Desktop & Mobile Server & Datacenter Cloud Over 7 Million Downloads of SQL Server 2008 Over 30,000 partners are offering solutions
More informationNew Approaches To Challenges Facing Enterprise ICT
New Approaches To Challenges Facing Enterprise ICT April 7, 2015 Gideon Senderov Director, Advanced Storage NEC Corporation of America Contents Introduction to NEC Challenges faced by enterprises today
More informationIBM Spectrum NAS, IBM Spectrum Scale and IBM Cloud Object Storage
IBM Spectrum NAS, IBM Spectrum Scale and IBM Cloud Object Storage Silverton Consulting, Inc. StorInt Briefing 2017 SILVERTON CONSULTING, INC. ALL RIGHTS RESERVED Page 2 Introduction Unstructured data has
More informationA Cloud WHERE PHYSICAL ARE TOGETHER AT LAST
A Cloud WHERE PHYSICAL AND VIRTUAL STORAGE ARE TOGETHER AT LAST Not all Cloud solutions are the same so how do you know which one is right for your business now and in the future? NTT Communications ICT
More informationSUSE Enterprise Storage 3
SUSE Enterprise Storage 3 Agenda Enterprise Data Storage Challenges SUSE Enterprise Storage SUSE Enterprise Storage Deployment SUSE Enterprise Storage Sample Use Cases Summary Enterprise Data Storage Challenges
More informationWelcome to the. Migrating SQL Server Databases to Azure
Welcome to the 1 Migrating SQL Server Databases to Azure Migrating SQL Server Databases to Azure Agenda Overview of SQL Server in Microsoft Azure Getting started with SQL Server in an Azure virtual machine
More informationHow to Keep UP Through Digital Transformation with Next-Generation App Development
How to Keep UP Through Digital Transformation with Next-Generation App Development Peter Sjoberg Jon Olby A Look Back, A Look Forward Dedicated, data structure dependent, inefficient, virtualized Infrastructure
More informationAndrea Sciabà CERN, Switzerland
Frascati Physics Series Vol. VVVVVV (xxxx), pp. 000-000 XX Conference Location, Date-start - Date-end, Year THE LHC COMPUTING GRID Andrea Sciabà CERN, Switzerland Abstract The LHC experiments will start
More informationNew Fresh Storage Approach for New IT Challenges Laurent Denel Philippe Nicolas OpenIO
New Fresh Storage Approach for New IT Challenges Laurent Denel Philippe Nicolas OpenIO Agenda Company profile and background Business and Users needs OpenIO approach Competition Conclusion Company profile
More informationMODELING OF CPU USAGE FOR VIRTUALIZED APPLICATION
e-issn 2455 1392 Volume 2 Issue 4, April 2016 pp. 644-651 Scientific Journal Impact Factor : 3.468 http://www.ijcter.com MODELING OF CPU USAGE FOR VIRTUALIZED APPLICATION Lochan.B 1, Divyashree B A 2 1
More informationCeph vs Swift Performance Evaluation on a Small Cluster. edupert monthly call Jul 24, 2014
Ceph vs Swift Performance Evaluation on a Small Cluster edupert monthly call July, 24th 2014 About me Vincenzo Pii Researcher @ Leading research initiative on Cloud Storage Under the theme IaaS More on
More informationA Robust, Flexible Platform for Expanding Your Storage without Limits
White Paper SUSE Enterprise A Robust, Flexible Platform for Expanding Your without Limits White Paper A Robust, Flexible Platform for Expanding Your without Limits Unlimited Scalability That s Cost-Effective
More informationSUSE Enterprise Storage Case Study Town of Orchard Park New York
SUSE Enterprise Storage Case Study Town of Orchard Park New York Anthony Tortola Senior Sales Engineer - SUSE atortola@suse.com Town of Orchard Park Chief Mark Pacholec Paul Pepero, Network Coordinator
More informationPRESENTATION TITLE GOES HERE. Understanding Architectural Trade-offs in Object Storage Technologies
Object Storage 201 PRESENTATION TITLE GOES HERE Understanding Architectural Trade-offs in Object Storage Technologies SNIA Legal Notice The material contained in this tutorial is copyrighted by the SNIA
More informationIT Infrastructure: Poised for Change
IT Infrastructure: Poised for Change David Freund Corporate Virtual Architect EMC Corporation October, 2009 Copyright 2009 EMC Corporation. All rights reserved. 1 Things Change The Big Question What s
More informationCourse Review. Hui Lu
Course Review Hui Lu Syllabus Cloud computing Server virtualization Network virtualization Storage virtualization Cloud operating system Object storage Syllabus Server Virtualization Network Virtualization
More informationStriped Data Server for Scalable Parallel Data Analysis
Journal of Physics: Conference Series PAPER OPEN ACCESS Striped Data Server for Scalable Parallel Data Analysis To cite this article: Jin Chang et al 2018 J. Phys.: Conf. Ser. 1085 042035 View the article
More informationHow to backup Ceph at scale. FOSDEM, Brussels,
How to backup Ceph at scale FOSDEM, Brussels, 2018.02.04 About me Bartłomiej Święcki OVH Wrocław, PL Current job: More Ceph awesomeness Speedlight Ceph intro Open-source Network storage Scalable Reliable
More informationLHC and LSST Use Cases
LHC and LSST Use Cases Depots Network 0 100 200 300 A B C Paul Sheldon & Alan Tackett Vanderbilt University LHC Data Movement and Placement n Model must evolve n Was: Hierarchical, strategic pre- placement
More information"Charting the Course... H8Q14S HPE Helion OpenStack. Course Summary
Course Summary Description This course will take students through an in-depth look at HPE Helion OpenStack V5.0. The course flow is optimized to address the high-level architecture and HPE Helion OpenStack
More informationOpendedupe & Veritas NetBackup ARCHITECTURE OVERVIEW AND USE CASES
Opendedupe & Veritas NetBackup ARCHITECTURE OVERVIEW AND USE CASES May, 2017 Contents Introduction... 2 Overview... 2 Architecture... 2 SDFS File System Service... 3 Data Writes... 3 Data Reads... 3 De-duplication
More informationWHITE PAPER SEPTEMBER VMWARE vsphere AND vsphere WITH OPERATIONS MANAGEMENT. Licensing, Pricing and Packaging
WHITE PAPER SEPTEMBER 2017 VMWARE vsphere AND vsphere WITH OPERATIONS MANAGEMENT Licensing, Pricing and Packaging Table of Contents Executive Summary 3 VMware vsphere with Operations Management Overview
More informationEMC Business Continuity for Microsoft Applications
EMC Business Continuity for Microsoft Applications Enabled by EMC Celerra, EMC MirrorView/A, EMC Celerra Replicator, VMware Site Recovery Manager, and VMware vsphere 4 Copyright 2009 EMC Corporation. All
More informationScale-out Object Store for PB/hr Backups and Long Term Archive April 24, 2014
Scale-out Object Store for PB/hr Backups and Long Term Archive April 24, 2014 Gideon Senderov Director, Advanced Storage Products NEC Corporation of America Long-Term Data in the Data Center (EB) 140 120
More informationThe Future of Virtualization Desktop to the Datacentre. Raghu Raghuram Vice President Product and Solutions VMware
The Future of Virtualization Desktop to the Datacentre Raghu Raghuram Vice President Product and Solutions VMware Virtualization- Desktop to the Datacentre VDC- vcloud vclient With our partners, we are
More informationJINR cloud infrastructure
Procedia Computer Science Volume 66, 2015, Pages 574 583 YSC 2015. 4th International Young Scientists Conference on Computational Science V.V. Korenkov 1,2, N.A. Kutovskiy 1,2, N.A. Balashov 2, A.V. Baranov
More informationStorage Considerations for VMware vcloud Director. VMware vcloud Director Version 1.0
Storage Considerations for VMware vcloud Director Version 1.0 T e c h n i c a l W H I T E P A P E R Introduction VMware vcloud Director is a new solution that addresses the challenge of rapidly provisioning
More informationEnabling Efficient and Scalable Zero-Trust Security
WHITE PAPER Enabling Efficient and Scalable Zero-Trust Security FOR CLOUD DATA CENTERS WITH AGILIO SMARTNICS THE NEED FOR ZERO-TRUST SECURITY The rapid evolution of cloud-based data centers to support
More informationvsan Disaster Recovery November 19, 2017
November 19, 2017 1 Table of Contents 1. Disaster Recovery 1.1.Overview 1.2.vSAN Stretched Clusters and Site Recovery Manager 1.3.vSAN Performance 1.4.Summary 2 1. Disaster Recovery According to the United
More informationCLOUDS OF JINR, UNIVERSITY OF SOFIA AND INRNE JOIN TOGETHER
CLOUDS OF JINR, UNIVERSITY OF SOFIA AND INRNE JOIN TOGETHER V.V. Korenkov 1, N.A. Kutovskiy 1, N.A. Balashov 1, V.T. Dimitrov 2,a, R.D. Hristova 2, K.T. Kouzmov 2, S.T. Hristov 3 1 Laboratory of Information
More informationCloud object storage : the right way. Orit Wasserman Open Source Summit 2018
Cloud object storage : the right way Orit Wasserman Open Source Summit 2018 1 About me 20+ years of development 10+ in open source: Nested virtualization for KVM Maintainer of live migration in Qemu/kvm
More informationObject storage platform How it can help? Martin Lenk, Specialist Senior Systems Engineer Unstructured Data Solution, Dell EMC
Object storage platform How it can help? Martin Lenk, Specialist Senior Systems Engineer Unstructured Data Solution, Dell EMC Files vs. Object File Metadata: Name: Picture.jpg Path: /mnt/pictures Owner:
More informationVMware vsan 6.6. Licensing Guide. Revised May 2017
VMware 6.6 Licensing Guide Revised May 2017 Contents Introduction... 3 License Editions... 4 Virtual Desktop Infrastructure... 5 Upgrades... 5 Remote Office / Branch Office... 5 Stretched Cluster... 7
More informationWhy software defined storage matters? Sergey Goncharov Solution Architect, Red Hat
Why software defined storage matters? Sergey Goncharov Solution Architect, Red Hat sgonchar@redhat.com AGENDA Storage and Datacenter evolution Red Hat Storage portfolio Red Hat Gluster Storage Red Hat
More informationSUBSCRIPTION OVERVIEW
RED HAT OPENSTACK PLATFORM SUBSCRIPTION OVERVIEW TECHNOLOGY OVERVIEW INTRODUCTION This overview outlines your Red Hat OpenStack Platform subscription options to help you choose the best solution for your
More informationSoftware Defined Storage for the Evolving Data Center
Software Defined Storage for the Evolving Data Center Petter Sveum Information Availability Solution Lead EMEA Technology Practice ATTENTION Forward-looking Statements: Any forward-looking indication of
More informationSolution Brief: Commvault HyperScale Software
Solution Brief: Commvault HyperScale Software ENTERPRISE IT SHIFTS Enterprise IT is being transformed with the maturing of public cloud providers that offer compute, storage and application services with
More informationRED HAT CEPH STORAGE ROADMAP. Cesar Pinto Account Manager, Red Hat Norway
RED HAT CEPH STORAGE ROADMAP Cesar Pinto Account Manager, Red Hat Norway cpinto@redhat.com THE RED HAT STORAGE MISSION To offer a unified, open software-defined storage portfolio that delivers a range
More informationModern hyperconverged infrastructure. Karel Rudišar Systems Engineer, Vmware Inc.
Modern hyperconverged infrastructure Karel Rudišar Systems Engineer, Vmware Inc. 2 What Is Hyper-Converged Infrastructure? - The Ideal Architecture for SDDC Management SDDC Compute Networking Storage Simplicity
More informationFederated data storage system prototype for LHC experiments and data intensive science
Federated data storage system prototype for LHC experiments and data intensive science A. Kiryanov 1,2,a, A. Klimentov 1,3,b, D. Krasnopevtsev 1,4,c, E. Ryabinkin 1,d, A. Zarochentsev 1,5,e 1 National
More informationVMware Virtual SAN Technology
VMware Virtual SAN Technology Today s Agenda 1 Hyper-Converged Infrastructure Architecture & Vmware Virtual SAN Overview 2 Why VMware Hyper-Converged Software? 3 VMware Virtual SAN Advantage Today s Agenda
More informationINTRODUCTION TO CEPH. Orit Wasserman Red Hat August Penguin 2017
INTRODUCTION TO CEPH Orit Wasserman Red Hat August Penguin 2017 CEPHALOPOD A cephalopod is any member of the molluscan class Cephalopoda. These exclusively marine animals are characterized by bilateral
More informationThe Fastest And Most Efficient Block Storage Software (SDS)
The Fastest And Most Efficient Block Storage Software (SDS) StorPool: Product Summary 1. Advanced Block-level Software Defined Storage, SDS (SDS 2.0) Fully distributed, scale-out, online changes of everything,
More informationWorkspace & Storage Infrastructure for Service Providers
Workspace & Storage Infrastructure for Service Providers Garry Soriano Regional Technical Consultant Citrix Cloud Channel Summit 2015 @rhipecloud #RCCS15 The industry s most complete Mobile Workspace solution
More informationStorPool Distributed Storage Software Technical Overview
StorPool Distributed Storage Software Technical Overview StorPool 2018 Page 1 of 9 StorPool Overview StorPool is distributed storage software. It pools the attached storage (hard disks or SSDs) of standard
More informationIncreasing Cloud Power Efficiency through Consolidation Techniques
Increasing Cloud Power Efficiency through Consolidation Techniques Antonio Corradi, Mario Fanelli, Luca Foschini Dipartimento di Elettronica, Informatica e Sistemistica (DEIS) University of Bologna, Italy
More informationDisruptive Forces Affecting the Future
Michel Bakker Disruptive Forces Affecting the Future proof to the POWER8 architecture leadership What new innovation? Can t you see I m too busy? Semiconductor Scaling: No More Moore 2016:
More informationDecentralized Distributed Storage System for Big Data
Decentralized Distributed Storage System for Big Presenter: Wei Xie -Intensive Scalable Computing Laboratory(DISCL) Computer Science Department Texas Tech University Outline Trends in Big and Cloud Storage
More informationConstruct a High Efficiency VM Disaster Recovery Solution. Best choice for protecting virtual environments
Construct a High Efficiency VM Disaster Recovery Solution Best choice for protecting virtual environments About NAKIVO Established in the USA since 2012 Provides data protection solutions for VMware, Hyper-V
More informationCeph-based storage services for Run2 and beyond
Journal of Physics: Conference Series PAPER OPEN ACCESS Ceph-based storage services for Run2 and beyond To cite this article: Daniel C. van der Ster et al 2015 J. Phys.: Conf. Ser. 664 042054 View the
More informationGlobal Data Plane. The Cloud is not enough: Saving IoT from the Cloud & Toward a Global Data Infrastructure PRESENTED BY MEGHNA BAIJAL
Global Data Plane The Cloud is not enough: Saving IoT from the Cloud & Toward a Global Data Infrastructure PRESENTED BY MEGHNA BAIJAL Why is the Cloud Not Enough? Currently, peripherals communicate directly
More informationHCI mit VMware vsan Radikal einfach und vollständig in die SDDC Strategie integriert
HCI mit VMware vsan Radikal einfach und vollständig in die SDDC Strategie integriert Februar 2018 Falko Lucas SDS Technical Specialist flucas@vmware.com Digitalisierung als Treiber für die Transformation
More informationArcGIS Enterprise: Performance and Scalability Best Practices. Darren Baird, PE, Esri
ArcGIS Enterprise: Performance and Scalability Best Practices Darren Baird, PE, Esri dbaird@esri.com What is ArcGIS Enterprise What s Included with ArcGIS Enterprise ArcGIS Server the core web services
More informationEMC Virtual Infrastructure for Microsoft Applications Data Center Solution
EMC Virtual Infrastructure for Microsoft Applications Data Center Solution Enabled by EMC Symmetrix V-Max and Reference Architecture EMC Global Solutions Copyright and Trademark Information Copyright 2009
More information