Integrated hardware-software solution developed on ARM architecture. CS3 Conference Krakow, January 30th 2018

Transcription

1 Integrated hardware-software solution developed on ARM architecture CS3 Conference Krakow, January 30th 2018

2 Why Object Storage Data doubles every 2 year...growing at a faster pace and is mainly unstructured Zettabytes : 10 ZB 2017: 20 ZB 2019: 40 ZB Petabyte created per day Unstructured data makes up 80% and more of enterprise data, and is growing at the rate of 55% and 65% per year. Structured data: text files, displayed in titled columns and rows to be processed by data mining tools. Unstructured data: s, Word Processing Files, PDF files, Spreadsheets, Digital Images, Video, Audio, Social Media Posts Source: IDC Simple, flexible and cost effective answer to storage complexity 2

3 Cynny Space A new concept of Cloud Storage Storage-as-a-Service ARM powered microservers 1-to-1 CPU storage ratio Swarm File system 3

4 The first ARM based microserver Features 8,3 cm 2 X 1 GB DDR RAM ARM CPU 1 GHz with floating point unit (FPU) 2 x 1Gbit Ethernet ports Fully-equipped microservers based on ARM CPUs Specifically designed for data management Data specific design such as SATA embedded on SOC Directly connected to internet - no other layers between server and client 3,4 cm High power efficiency iphone 6s Scale size 4

5 1-to-1 CPU storage ratio 1:1 microserver to storage unit ratio 12 nodes chassis for each server unit 456 microservers + storage units per rack Infrastructure features Infrastructure made of fully independent and interchangeable independent node No single point failure Intelligence is kept at disk level 1.5 Million DMIPS (Dhrystone Million Instruction Per Second) Linear growth of capacity and computing power generated by additional nodes 5

6 SwARM Distributed File System The only File System specifically developed and optimized for ARM technology Peer-to-peer network Intelligence equally distributed on all storage nodes (SwARM) High parallelization as every node manages data at chunk level Dynamic Hash Tables (DHT) to reduce overhead and maximize collaboration High fault tolerance: hardware fallibility embedded within the file system Infinitely scalable, role is auto-assigned when join the network Geographical nodes distribution 4 US Patents: ; ; ; EU Patents: , Chinese Patents: , X 6

7 Enhanced Durability vs. RAID systems Cynny Space Durability RAID Durability CONTROLLER - RAID 50 Parity Copy 2 Copy 1 Parity 1 Copy 2 Parity 2 Copy 1 Parity 2 nd Copy ü Data Durability > 99, % ü Higher reliability vs. RAID systems thanks to a cluster of 456 nodes working in parallel ü Smart File System distributed on all nodes (organic computing) ü Proprietary technology, both hardware and software ü Data durability: higher disk failure increases during reconstruction; disks fails 4x more often compared to pure statistical predictions. ü Data distribution in NAS/SAN devices, data has to be segmented: logical level: folder organization, implies that when FS increases it rapidly gets unusable; physical level: disks have to be organized in several isolated clusters. ü Data reliability: during data reconstruction, RAID implies a drastic reduction in terms of performance. 7

8 Unprecedented energy efficiency levels Advanced Efficient Green Technology based on ARM microservers Each microserver is powered by only 1.7 Watts Only 4 Wh to store 1TB 1/3 of energy consumption vs traditional storage Economic efficiency which results into competitive pricing Each TB stored reduces carbon footprint of 75 KG of CO 2 per year ARM microservers generate less heat *source department of energy & climate change e Arbor environment alalliance 8

9 Cynny Space is highly competitive compared to market leaders Object Storage price comparison of top players 10 TB of space - cent per GB/month Energy Rent space Hardware cent per GB/month Maintenance Source: commercial offer on websites, including an estimate of 20% of the data transferred monthly - date: 03/01/2018 9

10 Public Cloud Locations, features and services included Cynny Space DC locations in EU Features and services Redundancies included Data transfer included Requests included (GET, POST ) per GB/month Headquarters: Florence, Italy Data centers: Bologna, Italy Ravenna, Italy Lille, France Data centers (Q1/2018): United Kingdom Germany Pay as you go No hidden costs Multi-tenant and whitelabel management Multi-region access for data archiving and Disaster Recovery option 10

11 Private Cloud On Premise Object Storage Solution On Premise Architecture Characteristics Same level of control with other elements within the same infrastructure Linear and unlimited scalability, both in costs and computing power Pro-active monitoring, maintenance and support included «Plug&Play» service, no personnel training or activation work 11

12 Private Cloud One Time Purchase and Pay as you go One Time Purchase Pay as you go Cynny Space Module Cynny Space Rack Pay-as-you-Go Modules Starting from 32 TB net Installation sizing based on storage necessity Granular scalability with 2TB increments 14+ standard Rack Units From 348 TB to 2PB net per rack «Plug&play» full rack 456 nodes and 1.5 million DMIPS Connectivity up to 60 Gbit/s Included in the solution Costs based on the actual space occupied On Premise installation Linear scalability and decreasing costs Starting from 14 standard Rack Units 84+ storage nodes (microserver + HDD units) Installation Maintenance and support for 60 months Software Licensing for 60 months Net space with 99, % durability Access and Multitenancy tools 12

13 Cynny Space storage for key use cases 13

14 Access via Block Storage Seamless integration with operating system and tools SMB/CIFS NFS VIRTUAL BLOCK STORAGE Mounts object storage as a disk Seamless integration across standard protocol One to one mapping of files-to-objects Bucket access via IAM roles Once stored, data can be accessed via several protocols: NFS, SMB and S3 14

15 Use cases and third-party S3 compatible tools Key features of S3 APIs: Third-party S3 compatible tools: 15

16 NextCloud Use Case Integration with Cynny Space via S3 compatible APIs NextCloud direct integration with S3 compatible Cloud Storage On site installation S3 compatible APIs Cloud Storage HTTPS HTTPS Test environment: Tests performed by Stefano Stalio, INFN Connectivity: 1 Gbit/s Single client test Expected benefits of integration: Seamless integration and installation Enhanced data reliability Higher data availability Multi-client access Multi-site collaboration Cost optimization 16

17 NextCloud Use Case Setting up Cynny Space as S3 compatible external storage NextCloud Settings à External Storages à Amazon S3 Cynny Space S3 credentials Parameters: 17

18 NextCloud Use Case Cynny Space as external storage via S3 protocol Cynny Space is now a shared folder on external storage via S3 protocol Data in the folder are stored in Cynny Space s cloud storage The admin can share the folder or sub-folders/files with groups, federated storages or by 18

19 NextCloud Use Case Upload Performances with a 6GB file (single client) Upload speed to local storage where NextCloud s instance is installed: 53,2 MiB/s (or 425,6 Mbps) Upload to remote cloud object storage (via internet) where Cynny Space rack is hosted: 8 Mib/s or 64Mbps NextCloud uploads the file entirely, then it forwards it the file to Cynny Space During the download, the file is streamed directly by NextCloud via S3 to client. 19

20 NextCloud Use Case Download performances with a 6GB file (single client) Traffic from Cynny Space to NextCloud: 12 MiB/s or 96 Mbps Traffic from NextCloud to tester s PC: 12 MiB/s or 96 Mbps 20

21 NextCloud Use Case Federation NextCloud Instance #1 NextCloud Instance #

22 NextCloud Use Case Multiple protocol accessibility ü Once the file is uploaded via NextCloud (S3), the file is available by other Cynny Space s supported protocols ü Once a file is upload into Cynny Space via any supported protocol, the same file is available also to NextCloud 22

23 NextCloud Use Case Test conclusions Verified S3 compatibility along the entire testing chain Verified specific features such as federation Verified multi-protocol accessibility Bandwidth performance usage are Assessable (with reference to NextCloud) since the test was performed simulating just a sinlge-client use case Next tests: Testing environment extended to multiple simultaneous clients 23

24 24