DE-DUPLIKACJA UWOLNIONA!

Size: px

Start display at page:

Download "DE-DUPLIKACJA UWOLNIONA!"

Raymond Strickland
6 years ago
Views:

1 DE-DUPLIKACJA UWOLNIONA! BoostFS De-duplikacja na źródle dla każdego Film omawiający BoostFS:

2 Agenda What is BoostFS? Let s touch it Why source de-duplication Comparison of source de-duplication technics Announcements 2 of Y

3 BoostFS What is it?

4 BoostFS What is it? BoostFS is source de-duplication that any Backup software Application Database Script Command can use 4 of Y

5 BoostFS What is it? Technically BoostFS is directory (folder) on server Any backup software / application / database / script / command writes to this directory (folder) Data are de-duplicated on the server and only unique chunks are sent to Data Domain 5 of Y

6 BoostFS What is it? BoostFS uses the same BOOST technology that is used in any other application (backup software, databases, etc.) We will have the same efficiency no load of source machine (Intel) as we have in backup application / databases using BOOST 6 of Y

7 BoostFS Licensing BoostFS is 100% free feature of Data Domain 6.0+ Everyone who has Data Domain 6.0 or higher and BOOST license on Data Domain box or Data Domain Virtual Edition (DDVE has BOOST license included within cost of DDVE) can use BoostFS without any additional fee 7 of Y

8 BoostFS I want to try how? 8 of Y

9 BoostFS I want to try how? 9 of Y

10 BoostFS I want to try how? 10 of Y

11 BoostFS Chcę spróbować jak? Tutorial how to Download Install Configure Data Domain Virtual Edition (DDVE) 11 of Y

12 BoostFS I want to try how? Step by step guide for BoostFS BoostFS value presentation Go for other ppt tutorials that show other super use cases of Data Domain! 12 of Y

13 BoostFS Requirements

14 BoostFS Tested Applications 14 of Y

15 BoostFS Tested Applications For any other application contact EMC for formal approval (RPQ) in case of production use. 15 of Y

16 BoostFS Supported Operating Systems 16 of Y

17 BoostFS Supported Operating Systems This guide shows the of installation of BoostFS on SuSE of Y

18 BoostFS Data Domain requirements BoostFS requires Data Domain Operating System (DDOS) 6.0 or higher If you do not have Data Domain, install Data Domain Virtual Edition (DDVE). Data Domain Virtual Edition (DDVE) is free for tests/trials with perpetual 0.5TB license 18 of Y

19 BoostFS Let s touch

20 Configuration

21 BoostFS Installation Checking if we see binaries from Linux server pwd ls -al 21 of Y

22 BoostFS Installation Installing BoostFS on our Linux server rpm -Uvh DDBoostFS sles.x86_64.rpm 22 of Y

23 Creating Storage Unit (source de-dup device) 23 of Y

24 Creating Storage Unit (source de-dup device) 24 of Y

25 Creating Storage Unit (source de-dup device) 25 of Y

26 Creating Storage Unit (source de-dup device) 26 of Y

user /opt/emc/boostfs/bin/boostfs lockbox set -d ddt.

27 BoostFS: Defining Data Domain target boostfs lockbox set (command) FQDN of Data Domain Storage Unit Boost user /opt/emc/boostfs/bin/boostfs lockbox set -d ddt.labd.local -s BOOSTMySQL -u ddmysql ` ` 27 of Y ` `

28 BoostFS: Defining Data Domain target boostfs lockbox set (command) FQDN of Data Domain Storage Unit Boost user /opt/emc/boostfs/bin/boostfs lockbox set -d ddt.labd.local -s BOOSTMySQL -u ddmysql ` Provide password for Boost user 28 of Y

29 Directory with source de-dup to Data Domain Creating directory to which we write with source de-dup on DD mkdir /backup ls -al ` 29 of Y

30 BoostFS: Mounting Data Domain to dir Attaching Data Domain to our source de-dup directory /opt/emc/boostfs/bin/boostfs mount -d ddt.labd.local -s BOOSTMySQL /backup ` 30 of Y

31 Performing backup

32 Performing backup to BoostFS directory Manual backup with just cp command cp R /production /backup/production_copy1 ` We are the backup application We using the "cp" command are writing to Data Domain. Normally the backup is performed by backup application that automatically creates directories and files 32 of Y

33 Data Domain shows backup performance Statistics from Data Domain ddboost show stats interval 1 ` Data written to our /backup directory Data that DD has got (what a nice de-dup!) We write to /backup directory with 1 stream 33 of Y

34 We see the huge de-duplication filesys show compression / data/col1/boostmysql ` Command filesys show compression /data/col1/boostmysql shows de-duplication statistics for our logical DD BOOSTMySQL which is our BOOST device mounted on server Szczeliniec.labd.local We see the size of all protected data ( ) Amount of unique block ( ). Data Domain divided all data (991GB) on chunks 4K to 12K. Amount of unique blocks was just about 4,3MB. Probably similar data were backuped to different logical Data Domain before. In DD we have global de-dup!!! 34 of Y Unique blocks (4,3MB) were compressed before written to disk. After compression, unique blocks occupy on disk bytes

35 We can observer which machines are performing backups ddboost clients show active all We can observe what clients are writing to our Data Domain! ` 35 of Y

36 Data Domain Why source de-duplication?

37 37 of Y Data Domain LAN Backup System Source de-duplication DBs Mail Applications 100 GB BOOST 1 GB 1000 GB SAN LAN servers 10 GB 2 GB 200 GB Files 1000 GB VTL GB Target de-duplication Source de-duplication BOOST Virtual Machines CIFS NFS 200 GB 1 GB

DATA DOMAIN BOOST ECOSYSTEM Avamar NetWorker NetBackup

Protector Greenplum RMAN SAP SAP HANA DB2 SQL HortonWorks

Supported over LAN Supported over SAN DD Boost Supported

38 DATA DOMAIN BOOST ECOSYSTEM Avamar NetWorker NetBackup Backup Exec vranger NetVault Veeam VDP Advanced Data Protector Greenplum RMAN SAP SAP HANA DB2 SQL HortonWorks Cloudera Backup Server App Server DD Boost DD Boost Supported over LAN Supported over SAN DD Boost Supported over WAN For everything else, use the DD Boost file system plug-in 38 of Y

39 Data Domain: Why source de-duplication? Performance The highest possible performance Performance scalability Across different machines On the same machine 39 of Y

40 Data Domain: Why source de-duplication? Performance The same speed no matter if LAN or SAN Over 60TB/h continues backup speed in real environments 40 of Y

41 Data Domain: Why source de-duplication? No network bottleneck Source de-duplication for every backup software 41 of Y

42 Data Domain: Why source de-duplication? No network load Client direct Simple management Network load balancing & live failover Interface Group 42 of Y

43 Data Domain: Why source de-duplication? Source de-duplication device (Storage Unit) is visible at the same time via LAN/SAN You can backup via SAN and the same backup via LAN You can backup via LAN and the same backup via SAN Clients can backup / restore at the same time via LAN/SAN 43 of Y

44 Data Domain: Why source de-duplication? Backup via WAN Possible delays up to 20ms / 35ms / 200ms 44 of Y

45 Data Domain: Why source de-duplication? Smaller costs Fewer Media Servers No need for dedicated network Smaller amount of backup software licenses Management 45 of Y

46 Data Domain: Why source de-duplication? Disaster Recovery Managed by backup software Replication with granularity for single file Simple Disaster Recovery Backup software which is aware of backup copies in both locations 46 of Y

47 Data Domain: Why source de-duplication? Source de-duplication Disaster provide Recovery the highest Managed backup by backup performance software Replication technically with granularity best approach for single to backup/restore file data Simple from Disaster Data Recovery Domain provides the biggest value and uniuqe Backup software which is aware of backup copies in both possibilities for backup/restore locations shall be used if possible is recommended way to backup Data Domain 47 of Y

48 What type of source de-duplication do we have?

Cloudera Backup Server App Server DD Boost DD Boost Supported over LAN Supported over

49 DATA DOMAIN BOOST ECOSYSTEM Avamar NetWorker NetBackup Backup Exec vranger NetVault Veeam VDP Advanced Data Protector Greenplum RMAN SAP SAP HANA DB2 SQL HortonWorks Cloudera Backup Server App Server DD Boost DD Boost Supported over LAN Supported over SAN DD Boost Supported over WAN For everything else, use the DD Boost file system plug-in 49 of Y

50 Who perfroms source de-duplication? Backup software Application module BoostFS 50 of Y

51 Who perfroms source de-duplication? Backup software ` Application module BoostFS Guest level backup Image level backup Windows 2012 R2 51 of Y Guest level backup Image level backup Windows 8.1

52 Who perfroms source de-duplication? Backup software Application ` module BoostFS 52 of Y

53 Who perfroms source de-duplication? Backup software Application module BoostFS ` cp R /production /backup/production_copy1 ` 53 of Y

54 Who perfroms source de-duplication? Backup software Application module BoostFS Performance Highest Highest Highest Management Backup software admin + required data (configs) from database admins Database admins Backup software admin or database admin Monitoring Replication Backup software Backup software is aware about replicated copy Database admin / ecdm Mtree (Data Domain level) replication According to backup type (backup Depends on backup method Mtree (Data Domain level) replication 54 of Y

55 Who perfroms source de-duplication? Backup software Application module BoostFS Backup /restore network SAN/LAN (required support from backup application) SAN/LAN LAN 55 of Y Number of streams Recommendation Price Any / Up to backup application Recommended if central backup software is responsible for backups Up to backup software vendor rules Any Recommended if databases admins own the backup Per amount of protected databases (source TB) 64 per Storage Unit BOOST on Data Domain hardware is required Only if source deduplication at * backup software level * application module level is not avaialable No additional charge

56 I want more info

57 More info Where to find? Technology guides Films, values, use cases, Just contact me. 57 of Y

58 gurago.pl Technology guides 58 of Y

59 gurago.pl Technology guides 59 of Y

60 Ogłoszenia

61 Warsztaty technologiczne 2017 Data Domain Avamar NetWorker VDP Zaninteresowanych proszę o kontakt Daniel.Olkowski@dell.com 61 of Y

62 Następny webcast 13 stycznia, piątek 10:00 10:30 Nowości w Avamar of Y

63 Questions

Dell EMC Data Protection Everywhere

Dell EMC Data Protection Everywhere For the modern data center GLOBAL SPONSORS Journey to digital transformation Are you protected? 2 Enabling simplicity - data protection everywhere Where you need it