Storage S3 in backup. When? Value Architecture.

Size: px

Start display at page:

Download "Storage S3 in backup. When? Value Architecture."

Ruby Booth
6 years ago
Views:

1 Storage S3 in backup When? Value Architecture

2 Agenda Storage S3 Storage S3 in backup Where to use Where not to use Use cases Prices 2 of Y

3 S3 storage as backup media

4 / Storage S3 Access LAN LAN REST API (http) access 4 of Y

5 / Storage S3 Functionalities LAN High availability Milliards of objects Maintenance-free 5 of Y

6 / Storage S3 Main value LAN Security Minimum cost per TB 6 of Y

7 / Storage S3 Main value LAN Not designed for high performance / random access Not storage for Databases / VMs / 7 of Y

8 Storage S3 What kinds of S3 storage are available on the market? Dell EMC 8 of Y

9 Storage S3 What kinds of S3 storage are available on the market? S3 in our Data Center Dell EMC 9 of Y

10 Storage S3 What kinds of S3 storage are available on the market? S3 in our Data Center Dell EMC 10 of Y

11 / Storage S3 What S3 storage is available? S3 in our Data Center S3 from Public Provider Dell EMC 11 of Y

12 Types of backup media Site A Site B Linux, UNIX, Windows, Applications, Databases, Mail Linux, UNIX, Windows, Applications, Databases, Mail VM LAN VM DBs Mails Backup Server Media agent SAN Tape library 12 of Y Data Domain Disk system Tape library Disk system Data Domain

13 Types of backup media Site A Site B Linux, UNIX, Windows, Applications, Databases, Mail Linux, UNIX, Windows, Applications, Databases, Mail VM LAN VM DBs Mails Backup Server Media agent SAN Tape library 13 of Y Backup media Data Domain Tape Disk Disk system library system Data Domain

14 Types of backup media Backup Server Site A Linux, UNIX, When to use S3 storage Applications, Linux, UNIX, Applications, Windows, Databases, Windows, Databases, Mail Mail VM DBs in backup? Mails LAN Media agent Site B VM SAN Tape library 14 of Y Backup media Data Domain Tape Disk Disk system library system Data Domain

15 / Storage S3 Backup use cases Unchangeable files Backup that have Long Term Retention Backup / restore of data that have no performance requirements Backup in the cloud Disaster Recovery of cloud data 15 of Y

16 S3 storage Fix content

17 What is fix content? Video Call center Scans pdf 17 of Y...

18 What is fix content? Video Call center Scans pdf 18 of Y Fix content Those files will not change in future...

19 What is fix content? 80% of all data Video Call center Scans pdf The fastest growth among all data 19 of Y Fix content Those files will not change in future...

20 S3 Storage for fix content Application generating fix content Scaner Camera Document Managmenet System 20 of Y

21 S3 Storage for fix content Application generating fix content LAN/WAN 21 of Y

22 S3 Storage for fix content Application generating fix content Access key: 123 Storage: ecs.my.com Acces key: 123 IP address: LAN/WAN 22 of Y

23 S3 Storage for fix content Access key: 123 Acces key: 123 Application generating fix content Storage: ecs.my.com IP address: On storage we have compliance (WORM). We can define how many years file is blocked against deletion / change LAN/WAN 23 of Y

24 S3 Storage for fix content Access key: 123 Acces key: 123 IP address: of Y Application generating fix content Storage: ecs.my.com On storage we have compliance (WORM). We can define how many years file is blocked against deletion / change LAN/WAN Thus, performs 2 things: Stores data Protects data against human error

25 S3 Storage for fix content Application generating fix content Access key: 123 Storage: ecs.my.com Acces key: 123 IP address: LAN/WAN Object replication Acces key: 123 IP address: of Y

26 S3 Storage for fix content Application generating fix content automatically replicates every file to second location where we have also compliance (WORM). Access key: 123 Storage: ecs.my.com Acces key: 123 IP address: LAN/WAN Object replication Acces key: 123 IP address: of Y

27 S3 Storage for fix content Application generating fix content automatically replicates every file to second location where we have also compliance (WORM). Access key: 123 Storage: ecs.my.com Acces key: 123 IP address: Now performs 3 things: Stores data Protects data against human error LAN/WAN Protects data against Bucket: hardware B1 Acces key: 123 error Object replication IP address: of Y

28 S3 Storage for fix content Access key: 123 Storage: ecs.my.com Acces key: 123 IP address: automatically replicates every file to second location where we have also compliance (WORM). Application Our storage not only keeps data but also generating fix content provides backup/recovery! Now performs 3 things: Stores data Protects data against human error LAN/WAN Protects data against Bucket: hardware B1 Acces key: 123 error Object replication IP address: of Y

29 S3 Storage for fix content Access key: 123 Acces key: 123 Application generating fix content Storage: ecs.my.com IP address: DNS Load Balancer ecs.my.com: LAN/WAN Object replication Acces key: 123 IP address: of Y

30 S3 Storage for fix content Access key: 123 Acces key: 123 Application generating fix content Storage: ecs.my.com IP address: DNS Load Balancer ecs.my.com: LAN/WAN Object replication Application generating fix content Access key: 123 Storage: ecs.my.com Acces key: 123 IP address: of Y

31 S3 Storage for fix content Access key: 123 Acces key: 123 Application generating fix content Storage: ecs.my.com IP address: DNS Load Balancer ecs.my.com: Application cluster LAN/WAN Object replication Application generating fix content Access key: 123 Storage: ecs.my.com Acces key: 123 IP address: of Y

32 S3 Storage for fix content Acces key: 123 Application generating fix content Protection against: Hardware error Human error Access key: 123 Storage: ecs.my.com IP address: DNS Load Balancer ecs.my.com: LAN/WAN Object replication Application generating fix content Access key: 123 Storage: ecs.my.com Acces key: 123 IP address: of Y

33 S3 Storage for fix content Application generating fix content 100% DNS Load Balancer ecs.my.com: environment Object replication Application generating fix content Access key: Access key: 123 maintenance-free Storage: ecs.my.com Storage: ecs.my.com LAN/WAN Acces key: 123 IP address: Acces key: 123 IP address: of Y

34 S3 Storage with protection Access key: of Y Application generating fix content Storage: ecs.my.com Zero time backup DNS Load Balancer LAN/WAN (no data loss) Object replication Application generating fix content ecs.my.com: Zero time recovery Access key: 123 Storage: ecs.my.com Recovery Point = 0 Acces key: 123 Acces key: 123 IP address: IP address:

35 S3 Storage with protection DNS Load Balancer ecs.my.com: No backup hardware LAN/WAN Acces key: 123 Application generating fix content Zero investment No backup software Access key: 123 Storage: ecs.my.com No backup network Object replication IP address: Application generating fix content Access key: 123 Storage: ecs.my.com Acces key: 123 IP address: of Y

36 S3 Storage with protection DNS Load Balancer Zero management ecs.my.com: Access key: Acces key: 123 Application generating fix content No backup policies Storage: ecs.my.com LAN/WAN Object replication Application generating fix content High availability on storage level No path management IP address: Access key: 123 Storage: ecs.my.com Acces key: 123 IP address: of Y

37 S3 Storage with protection DNS Load Balancer Object replication Application generating fix content No impact on ecs.my.com: production Access key: Access key: 123 No reading data in backup LAN/WAN Acces key: 123 Application generating fix content Storage: ecs.my.com IP address: Storage: ecs.my.com Acces key: 123 IP address: of Y

38 S3 Storage with protection DNS Load Balancer Object replication Application generating fix content ecs.my.com: Access key: Access key: 123 Best approach for fix content Storage: ecs.my.com Storage: ecs.my.com Acces key: 123 Application generating fix content IP address: LAN/WAN Acces key: 123 IP address: of Y

39 S3 Storage with protection Case study 39 of Y

40 S3 Storage with protection Acces key: of Y Application generating fix content IP address: DNS Load Balancer ecs.my.com: LAN/WAN Object replication Application generating fix content We cannot use this approach to dynamic content: VMWare, Hyper-V Access key: 123 Oracle, SQL, Storage: ecs.my.com Exchange, SAP, SharePoint User files Access key: 123 Storage: ecs.my.com Acces key: 123 IP address:

41 S3 storage Long Term Retention

42 NetWorker CloudBoost Long Term Backups on / S3 storage Data Domain Backup LAN/FC Media Server / Storage Node Deduplication Retention 1-3 months Performance / functionalities 42Cost of 14 effective Clone Duplication Long Term Retention Retention 5 years / 10 years /

43 Tape as Long Term Retention Data Domain Backup LAN/FC Media Server / Storage Node Retention 1-3 months Performance / functionalities 43Cost of 14 effective Clone Duplication Long Term Retention Retention 5 years / 10 years /

44 NetWorker CloudBoost Long Term Backups on / S3 storage Data Domain Backup LAN/FC Media Server / Storage Node Deduplication Retention 1-3 months Performance / functionalities 44Cost of 14 effective Clone Duplication Long Term Retention Retention 5 years / 10 years /

45 NetWorker CloudBoost Full automation with Disaster Recovery SITE A IT Infrastructure Servers, Virtualization LAN,SAN Any backup solution Backup Recovery Data Domain 45 of 14

46 NetWorker CloudBoost Full automation with Disaster Recovery SITE A IT Infrastructure Servers, Virtualization LAN,SAN Any backup solution Backup Recovery 30 days 3 months Data Domain 46 of 14 1 year 50 years

47 NetWorker CloudBoost Full automation with Disaster Recovery SITE A SITE B IT Infrastructure Servers, Virtualization LAN,SAN Any backup solution Backup Recovery 30 days 3 months Data Domain Replication 1% data sent IT Infrastructure Servers, Virtualization LAN,SAN Any backup solution 30 days 3 months Data Domain Backup Recovery 47 of 14 1 year 50 years 1 year 50 years

48 NetWorker CloudBoost Full automation with Disaster Recovery SITE A SITE B Full automation IT Infrastructure Servers, Virtualization LAN,SAN Any backup solution Maintenance-free Backup Recovery Cost effective 30 days 3 months Data Domain Replication 1% data sent IT Infrastructure Servers, Virtualization LAN,SAN Any backup solution 30 days 3 months Data Domain Backup Recovery 48 of 14 1 year 50 years 1 year 50 years

49 NetWorker CloudBoost Full automation with Disaster Recovery SITE A Any retention IT Infrastructure Servers, Virtualization LAN,SAN Any backup solution Simple SITE B IT Infrastructure Servers, Virtualization LAN,SAN Any backup solution Flexible Backup - for any Recovery Backup Recovery environment 30 days 3 months Data Domain Replication 1% data sent 30 days 3 months Data Domain 49 of 14 1 year 50 years 1 year 50 years

50 NetWorker CloudBoost Full automation with Disaster Recovery SITE A SITE B IT Infrastructure Servers, Virtualization LAN,SAN Any backup solution IT Infrastructure Servers, Virtualization LAN,SAN Any backup solution One problem Backup Recovery Backup Recovery 30 days 3 months Data Domain Replication 1% data sent 30 days 3 months Data Domain 50 of 14 1 year 50 years 1 year 50 years

51 Data Domain CloudTier Full automation with Disaster Recovery SITE A SITE B IT Infrastructure Servers, Virtualization LAN,SAN Any backup solution IT Infrastructure Servers, Virtualization LAN,SAN Any backup solution Deduplication Un-Deduplication Backup Recovery 30 days 3 months Data Domain Replication 1% data sent 30 days 3 months Data Domain Backup Recovery Un-Deduplication Deduplication 51 of 14 1 year 50 years 1 year 50 years

52 Data Domain CloudTier Why do we un-deduplicate and than de-duplicate SITE A SITE B again all data? Full automation with Disaster Recovery IT Infrastructure Servers, Virtualization LAN,SAN Any backup solution Deduplication Un-Deduplication Backup Recovery Data Domain IT Infrastructure Servers, Virtualization LAN,SAN Any backup solution All data needs to be recovered from Data Domain and de-duplicated again by Storage Node proxy 30 days 3 months Replication 1% data sent 30 days 3 months Data Domain Backup Recovery Un-Deduplication Deduplication 52 of 14 1 year 50 years 1 year 50 years

53 Better approach 53 of 14

54 NetWorker CloudBoost Long Term Backups on / S3 storage Let s remove Media Server / Storage Node It does not provide any value Data Domain Backup LAN/FC Media Server / Storage Node Deduplication Retention 1-3 months Performance / functionalities 54Cost of 14 effective Clone Duplication Long Term Retention Retention 5 years / 10 years /

55 Data Domain CloudTier Extending Data Domain with S3 storage Data Domain Backup LAN/FC Retention 1-3 months Performance / functionalities 55Cost of 14 effective Old backups are moved to S3 storage in de-duplicated format just by Data Domain Retention 5 years / 10 years /

56 Data Domain CloudTier Extending Data Domain with S3 storage S3 storage extends Data Domain space Data Domain Retention 1-3 months Performance / functionalities 56Cost of 14 effective Backup LAN/FC S3 is slow but we keep there (automatically) backups data Old backups are moved to S3 storage in de-duplicated format just by Data Domain Retention 5 years / 10 years /

57 Data Domain CloudTier Full automation with Disaster Recovery SITE A SITE B IT Infrastructure Servers, Virtualization LAN,SAN Any backup solution Backup Recovery 30 days 3 months Data Domain Replication 1% data sent IT Infrastructure Servers, Virtualization LAN,SAN Any backup solution 30 days 3 months Data Domain Backup Recovery 57 of 14 1 year 50 years 1 year 50 years

58 Data Domain CloudTier Full automation with Disaster Recovery S3 storage extends Data Domain space (for old SITE A SITE B backups) No undeduplicatiton / de-duplication again IT Infrastructure Servers, Virtualization LAN,SAN Any backup solution Minimal load of Data Domain Backend process Backup Recovery 30 days 3 months Data Domain Replication 1% data sent IT Infrastructure Servers, Virtualization LAN,SAN Any backup solution 30 days 3 months Data Domain Backup Recovery The same best Data Domain de-duplication algorithm Very cost efficiency 58 of 14 1 year 50 years 1 year 50 years

59 Data Domain CloudTier Full automation with Disaster Recovery SITE A Simple SITE B IT Infrastructure Servers, Virtualization LAN,SAN Any backup solution Backup Recovery IT Infrastructure Servers, Virtualization LAN,SAN Any backup solution Maintenance-less Any infrastructure Cost effective 30 days 30 days 3 months 3 months Replication Data Domain Data Domain 1% data sent Backup Recovery 59 of 14 1 year 50 years 1 year 50 years

60 Tape or S3 storage for Long Term Retention? What is cheaper? 60 of 14

61 What shall we include into TCO? Long term retention Acquisition cost We shall take under consideration that tape capacity is usually used as much as 80% In this analysis we consider that each tape is 100% full We are nice to tape Cost of space We shall take under consideration that tape library requires additional service space but we do not it Cost of tape rotation Migration to new generation Copyright 2014 EMC Corporation. All rights reserved. 61

62 What shall we include into TCO? Long term retention Acquisition cost We shall take under consideration that tape capacity is usually used as much as 80% In this analysis we consider that each tape is 100% full We are nice to tape Cost of space We shall take under consideration that tape library requires additional service space but we do not it Cost of tape rotation In this analysis we take under consideration only acquisition costs Migration to new generation Copyright 2014 EMC Corporation. All rights reserved. 62

67 S3 backup target with source de-duplication

68 NetWorker CloudBoost Architecture Linux, UNIX, Windows Applications, Databases, Mail LAN NetWorker VMs DBs Mails SAN Disk system Tape library 68 of 14 Data Domain Backup media

69 NetWorker CloudBoost Architecture NetWorker Linux, UNIX, Windows Can we backup directly to S3 VMs Applications, Databases, Mail DBs Mails What are pluses / minuses? SAN Disk system storage? LAN Can we use source de-duplication? Tape library 69 of 14 Data Domain Backup media

70 NetWorker CloudBoost Architecture Linux, Windows Oracle, SQL, Exchange, SAP, Files CloudBoost MetaData NetWorker LAN 70 of 14 Object Storage S3 storage

71 NetWorker CloudBoost Architecture Source de-duplication Client direct Linux, Windows Oracle, SQL, Exchange, SAP, Files LAN 100 GB 1% CloudBoost MetaData NetWorker 71 of 14 Object Storage S3 storage

72 NetWorker CloudBoost Architecture Linux, Windows Databases, Applications, Files Guest level backup CloudBoost MetaData NetWorker 72 of 14 Object Storage S3 storage

73 NetWorker CloudBoost Architecture Linux, Windows Databases, Applications, Files Guest level backup Source de-duplication Client direct 500 GB 1% CloudBoost MetaData NetWorker 73 of 14 Object Storage S3 storage

74 NetWorker CloudBoost Architecture CloudBoost MetaData NetWorker LAN 74 of 14 AIX, Solaris, HP-UX Files Databases Applications Object Storage S3 storage

75 NetWorker CloudBoost Architecture CloudBoost MetaData NetWorker LAN 200 GB Source de-duplication 1% 75 of 14 AIX, Solaris, HP-UX Files Databases Applications Linux Storage Node Object Storage S3 storage

76 NetWorker CloudBoost Architecture Source de-duplication Client direct Linux, Windows Oracle, SQL, Exchange, SAP, Files LAN 100 GB 200 GB Linux, Windows Databases, Applications, Files Guest level backup Source de-duplication Client direct 1% 500 GB Source de-duplication 1% 1% CloudBoost MetaData NetWorker 76 of 14 AIX, Solaris, HP-UX Files Databases Applications Linux Storage Node Object Storage S3 storage

77 NetWorker CloudBoost Architecture Pros 77 of 14 Linux, Windows Oracle, SQL, Exchange, SAP, Files 100 Cost effective GB Source Source de-duplication AIX, Solaris, HP-UX Files Databases Applications Linux, Windows Databases, Applications, Files Guest level backup de-duplication Client direct Client direct 1% 1% LAN 1% Source 200 de-duplication Source GB de-duplication 500 GB Linux Storage Node CloudBoost MetaData Reasonable backup performance Easy remote backup Object Storage S3 storage NetWorker

NetWorker CloudBoost Architecture Cons Linux, Windows Oracle, SQL, Exchange, SAP, Files Linux, Windows Databases, Applications, Files Guest level backup CloudBoost MetaData NetWorker 100 500 Poor

78 NetWorker CloudBoost Architecture Cons Linux, Windows Oracle, SQL, Exchange, SAP, Files Linux, Windows Databases, Applications, Files Guest level backup CloudBoost MetaData NetWorker Poor restore GB GB Source performance Source de-duplication de-duplication Client direct 1% Client direct More complicated 1% implementation than Data LAN 1% Domain 200 Source GB de-duplication 78 of 14 AIX, Solaris, HP-UX Files Databases Applications Linux Storage Node Object Storage S3 storage

79 S3 as backup media with source de-deduplication Old data / data that do not require backup/restore performance 79 of Y

80 Backup to S3 storage in public cloud

81 Protecting data in AWS, Azure, Data in public cloud (Amazon, Azure, ) We have no other choice regarding backup media S3 storage is much chipper than block storage in public cloud We reduce Cost per TB (S3 vs block) Amount of storage (de-duplication) Network (de-duplication) 81 of Y

82 Protecting data in AWS, Azure, 82 of Y

83 Protecting data in AWS, Azure, EBS Perma nent Block Storage 83 of Y

84 Protecting data in AWS, Azure, EC2 Temporary Block Storage EBS Perma nent Block Storage 84 of Y

85 Protecting data in AWS, Azure, NAS EC2 Temporary Block Storage EBS Perma nent Block Storage 85 of Y

86 Protecting data in AWS, Azure, EBS Perma nent NAS EC2 Temporary Block Storage Block Storage S3 storage 86 of Y

87 Protecting data in AWS, Azure, NAS EC2 Temporary Block Storage EBS Perma nent Block Storage From 2 to 10 times cheaper Than any other storage S3 storage 87 of Y

88 Protecting data in AWS, Azure, NAS EC2 Temporary Block Storage EBS Perma nent $10 Block Storage From 2 to 10 times cheaper Than any other storage $1 S3 storage 88 of Y

89 Protecting data in AWS, Azure, On the price huge influence has also EBS number of data sent/receive Perma nent $10 Block From 2 to 10 times cheaper NAS NetWorker saves it as well $1 EC2 Storage by Temporary source de-duplication (almost no data Block transferred Storage during the backup) S3 storage 89 of Y

90 S3 as backup media with source de-deduplication Protected VMs NetWorker VM 500 GB Protected VMs CloudBoost VM 1% NetWorker Bucket 90 of Y

91 S3 as backup media with source de-deduplication Coming back with data from cloud provider to our Data Center Very good plan B / insurance policy against potential issues in the cloud 91 of Y

92 S3 as backup media with source de-deduplication capacity net [PT] List Price with 5 years maintenance [Euro] List Price per TB with 5 years maintenance [Euro] List Price per GB with 5 years maintenance [Euro] List Price per GB per month with maintenance [Eurocents] Estimated street price per GB per month with maintenance [Eurocents] 4, ,466 0,78 0,39 2, ,543 0,90 0,45 0, ,133 1,89 0,94 92 of Y

93 S3 as backup media with source de-deduplication capacity net [PT] List Price with 5 years maintenance [Euro] List Price per TB with 5 years maintenance [Euro] List Price per GB with 5 years maintenance [Euro] List Price per GB per month with maintenance [Eurocents] Estimated street price per GB per month with maintenance [Eurocents] 4, ,466 0,78 0,39 2, ,543 0,90 0,45 0, ,133 1,89 0,94 We need to add additional backup software licenses 93 of Y

94 S3 as backup media with source de-deduplication capacity net [PT] List Price with 5 years maintenance [Euro] List Price per TB with 5 years maintenance [Euro] List Price per GB with 5 years maintenance [Euro] List Price per GB per month with maintenance [Eurocents] Estimated street price per GB per month with maintenance [Eurocents] 4, ,466 0,78 0,39 2, ,543 0,90 0,45 0, ,133 1,89 0,94 In case of NetWorker, DPS for VMware has support for S3 storage included (CloudBoost appliance) 94 of Y

95 S3 in backup Summary

96 When to use S3 storage in backup? Fix content Long Term Retention Data without pressure for backup / recovery window Public cloud data Local backup in the cloud Replication to our Data Center 96 of 14

97 Why to consider S3 storage in backup Similar or smaller cost than tape Especially with de-duplication Full automation 97 of 14

98 Why to consider S3 storage in backup In the public cloud it can be the only option Coming back with data from the cloud Long Term Retention Backup of old data 98 of 14

99 Why to consider S3 storage in backup + Automation Small cost - Performance (restore) 99 of 14

100 Why to consider S3 storage in backup If we choose the backup solution, it is good to take under consideration S3 storage functionalities 100 of 14

101 Announcements Backup / Recovery

Overview - Avamar 7.5.1 Beta What Avamar 7.5.1 provides new leading capabilities for In Cloud and Extend to the Cloud data protection for AWS and Azure.

102 Overview - Avamar Beta What Avamar provides new leading capabilities for In Cloud and Extend to the Cloud data protection for AWS and Azure. Private Cloud and Virtualization for vsphere, Hyper-V and OpenStack all have compelling and differentiated new features. Security and currency are other areas with new capability. When Start: 10/02/17 End: 11/21/17 How Registration Link: Program Manager: Abhinav Bansal - abhinav.bansal@dell.com 102 of 10

103 Who Cares? Customers interested in the following areas: In Cloud Support for AVE/DDVE in AWS and Azure marketplace Data protection for VMWare cloud on AWS Private Cloud & Virtualization Application-consistent VM image backups (MS SQL) Hyper-V support for synthetic full vsphere High Availability support Open Stack file level recovery Packaged Avamar REST API Extend to Cloud AWS for DR with application consistent VM-image backup Expand capacity by allocating multiple cloud storage targets DD Cloud Tier efficient cloud restore for LTR General HTML-5 EBR Plugin for vsphere Security KMIP support New file systems supported: BTRFS and XFS v5 New databases supported: IBM DB2 v11.1 & v10.5 FP8 103 of 10

104 Where to find more info? This presentation is available at: of 10

105 Questions

Copyright 2012 EMC Corporation. All rights reserved.

Copyright 2012 EMC Corporation. All rights reserved. 1 BACKUP BUILT FOR VMWARE Mark Twomey Technical Director, The Office Of The CTO 2 Agenda Market Forces Optimized VMware Backup Backup And Recovery For VCE Vblock Protecting vcloud Director Customer Success