SAM-FS Tools. machen

Transcription

1 SAM Users Group Mai 2009 SAM-FS Tools Die das Leben leichter machen

2 Extend the Power of SAM-FS SAM-FS Add-on Tools & Services SAM-NeT SAM-WeB Media Refresh HSM Migration ERS SAM Monitoring NTFS Migration ObjectArchive cdlm Tools & Services Add-on Products SAM-FS/QFS File System Data Archive

3 SAM-NeT Windows Interface Windows to SAM-FS connectivity enhancer Windows Explorer Plug-In Shows an icon overlay for offline files in Explorer Property dialog allows display of SAM-FS attributes tes (sls -D like), staging & releasing of files & directories, etc. Multi-File & Multi-User Capability Allows to continue to browse a SAM-FS file system via Samba while offline files are staged in the background No Window freeze Support for Asynchronous I/O Read-behind Based on open libsam Windows DLL available for stage/release via C-programs

4 SAM-NeT Windows Interface

5 SAM-WeB: schnelle Antwort auf dringende Fragen Sind alle Dateien archiviert? Alle Kopien nach SLA erstellt? Welche Dateien sind nicht archiviert? Welche Dateien wurden in einem bestimmten Zeitraum archiviert? Gibt es damaged damaged Kopien / Dateien? Auf welchen Archivmedien? Wie viel Kapazität belegen never release? partial online? never archive? Welche Dateien sind auf Archivmedium xyz? Wie viel Dateien wurden im Zeitraum nn archiviert?

6 SAM-WeB (Browserbasierte Visualisierung) Samfsdump Extraktor (10 mio Files pro Min.) Optimierte e Datenbank WebGUI FS Statistik Intuitive Abfragen Schnelle Antworten Ergebnis Listen Zusammenfassung Standard Abfragen Vordefiniert Individuell id

7 SAM-WeB Statistics Filesystemstatistics at :53:21 on host: uqfs Using samfsdump dated :35:00 Global max file size : G DAU-size: 64 KB Total objects processed: Class Report: ClassRange Total Total Average Total Total Files % Size % Filesize Online % Locked % ( 1): 0K - 4K M K G M 0 ( 2): 4K - 8K M K 7.16 G ( 3): 8K - 16K M K 4.39 G K 0 ( 4): 16K - 32K G K 6.45 G K 0 ( 5): 32K - 64K G K 6.67 G K 0 ( 6): 64K - 128K G K M K 0 ( 7): 128K - 256K G K 2.25 M (17): 128M - 256M T M 2.76 G G 0 (18): 256M - 512M T M 2.11 G G 0 (19): 512M - 1G T M G G 0 (20): 1G - 2G T G G G 2 (21): 2G - 4G T G 3.04 G (22): 4G - 8G T G 4.16 G (23): 8G - 16G T G G (24): 16G - 32G T G G (25): 32G - 64G T G 1.11 T (26): 64G - 128G T G (27): 128G - 256G T G G Totals T M 2.69 T G 3 Total Files: Total Zero Files: 5191 Total Dirs/Symlnk: Total size: T Average filesize: M Total size all copies: T Total online cap.: 6.26 T

8 SAM-WeB Statistics Timerange Creation time Modify time Acess time within files volume %vol files volume %vol files volume %vol 1d T 0.2% T 0.2% T 0.4% 2d % % % 1w T 0.8% T 1.0% T 1.1% 1m T 4.0% T 4.0% T 6.1% 2m % % % 3m % % % 1y T 36.1% T 35.8% T 40.2% 2y % % % 3y % % % older T 58.9% T 59.0% T 52.3% Total T 100.0% T 100.0% T 100.0% =============================================================================

9 Media Refresh / Fast Recycle SAM-Media Refresh Toolkit Automatically migrates/recycles between media types (incl. diskarchive) i.e to T10K, LTO-2 to LTO-4, etc. Highly optimized media transcription with little or no impact on production Drastically shorter migration process (up to 15 times) Automatic load balancing and streaming of devices Dynamically adjust the usage of available drives and disk buffer area Maximum throughput and performance Concise control and status reports Also used for standard recycling (tape and disk)

10 Fast Recycle uqfs Tapes % active Tapes available Total Fullest Avg Robot(s) 0% tapes % free pool in use total TB GB GB S10400 li dkpools dk totals VSN pools: Capacity apool 9 7.0T cp2pool T dkfpool T hpool T npool T Tapes and used volume per archiveset and copy: Archiveset copy 1 copy 2 copy 3 copy 4 all G darch2cp T diskarchive_(unspecified) T home T T 0 0 nbu_full T 0 0 unreserved 9 5.9T Total T T GrandTotal T tapes will be relabeled Recycling of 5 tapes will be started Date: 2009/06/05 01:21

11 Media Refresh / Fast Recycle Continuous streaming Dynamically adjustable Any number of streams Streams can be stopped / restarted

12 HSM Migration SAM-HSM Migration Suite Automatic ti migration of data and media from other HSM systems to SAM-QFS (Migration No. 13 in progress) UniTree (EMC), Veritas HSM (Storage Migrator), DMF Data Migration Facility (SGI), Amass (ADIC), others possible Migration principlep Conversion of the Metadata, takes only a few hours Production from now on via SAM-QFS only Not necessary for parallel operation of old and new systems Staging possible in two modes Random stage when users access files Bulk migration process in the background Migration time T[sec] = Volume[MB]/(Speed[MB/sec] x Drives)

13 Enterprise Resource Suite ERS-Control Center ERS Analyzing ERS Monitoring ERS Charging ERS Migration SAM-FS Module Example: Analysis of 1,2 TB User data Total Files With 789 different file types Time to analyze: 22 Minutes Average speed of 3508 Files/per Second and Server

14 Enterprise Resource Suite Helps to determine what data you have and where Complete quantification of data Volume of Shares, Directories, Disks, Servers Complete qualification of data age, type, user, groups, online, offline Filters based on selection criteria Searching of identical files (doublets) Determine offline file candidates for migration, release, etc.

15 ERS Resource Manager

16 Enterprise Resource Suite in Use Development of growth Basis of resource planning Harddisk Capacity for: SERVER 1 Determining further information calculations Visual presentation of decision criteria on in % Utilizatio Long term development of growth Time

17 SAM-FS Monitoring ERS SAM-FS Module Supports special SAM-FS file attributes Creates file system statistics and trend analysis For User Files File types Online or offline files Archive Set utilization & growth rates Monitors M i SAM devices and alerts when down Detailed statistics for SLA monitoring, etc.

18 NTFS Migrator HSM for Windows ERS scanning engine determines migration candidates by age, size, user, access time, etc. Time/Schedule based (every night, etc.) Event driven (file (fl system full, etc.) Copies file candidates from NTFS to SAM-FS Encapsulate extended Windows attributes, ACLs, etc. SAM-FS makes multiple copies to Tape, other Releases files from NTFS disk cache Leave file stub behind with copy information Sets Offline Attribute

19 NTFS Migrator Migration Policies If no archive is defined, the job contains no migration operation. Usually files are migrated to a max. of two archives in order to have an automatic failover in case an archive isn t available.

20 Release Policies NTFS Migrator

21 cdlm: Backup- and Restore Tool for SAM-FS Information Life Cycle Management Scheduled SAM-FS Snapshots capture Filesystem content in the background Client Server Architecture with Explorer-like GUI Clients for Solaris/W2k/WinXP/Linux/MacOS X No external database required Optimized for cdlm No administration required Minimizes space requirements Each version is exactly one entry Maximum performance Minimum overhead

22 SAM-cDLM GUI

23 Compliance and ILM SAM-Object Archive Allows to store additional descriptive business information (i.e. easy to remember meta information, project name, etc.) together with the archived objects/files Files are stored in containers (good for small files) GUI to view content of containers (for Linux, Solaris, HP-UX, AIX, Irix, True64, Windows) Group files together by attaching meta information Easy search for files and objects based on meta data File name or directory name must not be known Delete files/objects when expiration date is reached

24 Other Tools and Services Implementation Services and Tools Backup and SAM-FS Archive and SAM-FS VTL and SAM-FS (Copan) HA and SAM-FS Shared QFS other 5x8/7x24 SAM-FS Support Remote Administration Tape Sniffing

25 Noch Fragen / Questions?

26 Einen schönen Abend /nice evening...

27 Computer Technologies GmbH We manage your data Peter Weinrich, Frankfurter Straße Kronberg