Interoperability in Storage Management Systems IEEE 2003

Transcription

1 Interoperability in Storage Management Systems IEEE 2003

2 Large and Complex Networks Site - A Site - B H 1 H 2 H n H 1 SW 1 Router 1 Library 1 Appliance 1 SW 1 SW 2 Bridge 1 H 1 H n Site - C Appliance n SW 3 Bridge 2 SW 1 A 1 A n IP or Sonet Network Bridge 1 Bridge 2 SW 2 A n A 1 V 1 V Snaps/Clones n V 1 V n Page 2

3 Cascaded/Diverse Relationships Presentation e Frameworks Graphical Interfaces Storage Resource Mgmt Performance Capacity Planning Resource Allocation Container Management Media Management Volume Management Information Management Data Mover Layer Data Management File Layer System Database System Data Movers Backup System HSM User Applications Other Other Other Other Physical Entities Media Robot Disk Drive Mgmt. Appliance Tape Drive Switch Enclosure Array Removable Media Fabric Loop Hub HBA Extender Router Logical Entities Other RAIDset LUN LUN Clone LUN SnapShot Media Set Tape Volume Zone (Ports, LUNs,,,) ZoneSet Page 3

4 Fortune 1000 Requests Performance improvements 8% Improved services 3% Virtualization across multiple vendors 6% Reliability improvements 4% Better management tools 47% Vertical application integration 2% Standards support 7% Better interoperability 43% New technologies 13% Improved scalability or flexibility 3% Cost or price improvements 8% Source: InfoPro Page 4

5 Emerging Storage Management Problems Decreasing Storage Technology Cost Increasing Data Volume and Value Increasing Storage Management Cost Management GAP Source: Michael Peterson, In-Fusion Page 5

6 Additional Problem Dimensions Security Privacy Authentication Authorization Certificate distribution Automated discovery Devices/subsystems Device features Security practices Vendor unique extensions Non-cooperating active management clients Physical transport independence (in/out-band) In-field seamless multi-vendor interoperability Vendor Extensibility Page 6

7 Management App Dilemma Management Application Discovery Service Integration Infrastructure Object Model Mapping Protocol Mapping Transport Mapping Security Service RPC Command Line Telnet CORBA C++ Library C Library Java Library SCSI Mode Page XML DTD SNMP FC- GS TCP/IP Socket Device Types Tape Library Switch Array Many Other Vendor Unique Object Models Page 7

8 Device Vendor Dilemma Mgmt. App. Vendor Mgmt. App. Vendor Mgmt. App. Vendor Mgmt. App. Vendor Mgmt. App. Vendor Mgmt. App. Vendor Mgmt. App. Vendor MIB-1 MIB-2 MIB-N SDK- UNIX 1 (Java, C++, C) SDK- O.S. -1 (Java, C++, C) SDK- UNIX N (Java, C++, C) SDK- O.S.-N (Java, C++, C) SNMP Transport (UDDP) SNMP Agent Device Vendor Vendor Proprietary Distributed Transport Tape Library Product 1 Tape Library Product 2 Tape Library Product N Page 8

9 Changing Business Model Infrastructure (no $ers) GUIs $ s Middleware Engines $ s Devices $ s Proprietary integration infrastructures impractical: OpenSource Avail. Common Transport (SMI/CIM/WBEM) Development Velocity Affordability Model Page 9

10 The Larger Problem Systems Management Stovepipes Common Model Needed Page 10 Network Management Applications Management Processor Complex Mgmt. Storage Management Database Management

11 Why Not SNMP? (Simple Network Management Protocol) Common Object Model Security Positive Response Mechanism Inflexible no auto discovery ACID properties Richness of canonical intrinsic methods Modeling Constructs Associations Page 11

12 No Dominant Vendor SNIA DMTF Way Page 12

13 Graphical User Interface Architectural Vision Management Frameworks Management Tools Users Storage Resource Management Performance Capacity Planning Resource Allocation Container Management Volume Management Media Management Other Data Management File System Database Manager Backup & HSM Storage Management Interface Specification Physical Components Removable Media Tape Drive Disk Drive Robot Enclosure Host Bus Adapter Switch Managed Objects Logical Components Volume Clone Snapshot Media Set Zone Other Page 13

14 SMI-S Storage domain File/record layer Database (dbms) Host Application Network Block aggregation File system (fs) Device Storage devices Bluefin SMIS Management Services Single interoperable transport Rigorous object model Durable names Automated discovery Resource locking Client considerations (use recipes) Security Future - transactions Page 14

15 SNIA Shared Storage Model Storage domain Database (dbms) Application File/record layer Host Network Block aggregation Storage devices (disks, ) Block layer SMIS File system (FS) Device CIM Model for Agents Agent Agent Agent Agent Agent Agent CIM-XML Protocol for Communication with Managers Page 15

16 CIM/WBEM Transport Unification WBEM is a set of technologies: Data Description CIM CIM Model: Common Information Model. UML modeling constructs + Object Definition Language (MOF Meta-Language) + Schema (Model Descriptions) xmlcim Encoding CIM over HTTP Semantics WBEM Interface CIM over HTTP: Defines semantics for the transport of CIM data descriptions over Http. xmlcim: Specification for the encoding of CIM Ops into XML. Page 16

17 The CIM Schema ~1000 Classes (maturing) Most aspects of computer systems and their applications Described by: MOF - Managed Object Format (ASCII or Unicode) VISIO for UML (Unified Modeling Language) Whitepapers XML - extensible Markup Language XML grammar can be used to describe CIM metaschema, Detailed in DTD (Document Type Defn) DTD defines tags such as CLASS, INSTANCE and QUALIFIER Associations are described via an ASSOCIATION.CLASS tag (Distinguished because they include references as properties) Page 17

18 CIM Model Constructs Page 18

19 MOF Example [Abstract, Description ( "An abstraction or emulation of a Qualifiers hardware entity, that may " "or may not be Realized in physical hardware.... ") ] lass CIM_LogicalDevice : CIM_LogicalElement.. [Key, MaxLen (64), Description ( "An address or other identifying information to uniquely " "name the LogicalDevice.") ] string DeviceID; [Description ( "Boolean indicating that the Device can be power " "managed....") ] boolean PowerManagementSupported; [Description ( "Requests that the LogicalDevice be enabled (\"Enabled\" " "input parameter = TRUE) or disabled (= FALSE)....)" ] uint32 EnableDevice([IN] boolean Enabled);.. ; Class Name and Inheritance Human and Machine Readable! Properties Methods Page 19

20 WBEM Integration Integration Success = Semantic Richness WBEM Private Private GDMO GDMO MIF MIB Managed Resource Definition Private Private CMIP CMIP DMI SNMP Service Layer & Infrastructure Storage Storage systems systems Telecom Telecom devices devices Desktop systems Network Network devices Physical managed objects Page 20

21 Inheritance ManagedElement Association Aggregation Product ProductPhysicalElements ManagedSystemElement Tape Model/Profile PhysicalElement LogicalElement Realizes Container Service LogicalDevice SystemDevice System See Software/ Service View PhysicalPackage HostedService MediaTransferDevice MediaAccessDeviceDevice NetworkAdapter StorageLibrary See Device View See Device View Port LibraryPackage FCPort See Device View PhysicalFrame Chassis See Physical View See Physical View Page 21

22 Protocol Stack Flexibility Message Syntax: XML-CIM Encoding Message Semantics: CIM operations over http Messaging Protocol: http Transfer Protocol: TCP/IP Object Model Independence Message Protocol Independence Transfer Protocol Independence Page 22

23 Sequence Diagram Client HTTP M-POST or POST (XML Entity) HTTP response (XML Entity) Repeat Server Page 23

24 XML Method Request <?xml version="1.0"? <CIM CIMVERSION="2.0" DTDVERSION="2.0"> <MESSAGE ID="3" PROTOCOLVERSION="1.0"> <SIMPLEREQ> <METHODCALL NAME="createLun"> <LOCALINSTANCEPATH> <LOCALNAMESPACEPATH> <NAMESPACE NAME="root"> </NAMESPACE> </LOCALNAMESPACEPATH> <INSTANCENAME CLASSNAME= SNIA_StorageService"> <KEYBINDING NAME="id"> <KEYVALUE VALUETYPE="string"> 42 </KEYVALUE> </KEYBINDING> </INSTANCENAME> </LOCALINSTANCEPATH> <PARAMVALUE NAME="Size"><VALUE>40</VALUE></PARAMVALUE> <PARAMVALUE NAME="Lun"><VALUE>20</VALUE></PARAMVALUE> <PARAMVALUE NAME="test"><VALUE>1</VALUE></PARAMVALUE> </METHODCALL> </SIMPLEREQ> </MESSAGE> </CIM> Instance path Parameters Page 24

25 XML Response for Method <?xml version="1.0"?> <CIM CIMVERSION="2.0" DTDVERSION="2.0"> <MESSAGE ID="3" PROTOCOLVERSION="1.0"> <SIMPLERSP> <METHODRESPONSE NAME="createLun"> <RETURNVALUE> <VALUE>24</VALUE> <PARAMVALUE NAME="test"> <VALUE>21</VALUE> </PARAMVALUE> </RETURNVALUE> </METHODRESPONSE> </SIMPLERSP> </MESSAGE> </CIM> Human readable protocol! Page 25

26 CIM Operations Canonical Intrinsic Functional Group Dependency Methods Basic Read none GetClass EnumerateClasses EnumerateClassNames GetInstance EnumerateInstances EnumerateInstanceNames GetProperty Basic Write Basic Read SetProperty Schema Manipulation Instance Manipulation CreateClass ModifyClass DeleteClass Instance Manipulation Basic Write CreateInstance ModifyInstance DeleteInstance Association Traversal Basic Read Associators AssociatorNames References ReferenceNames Query Execution Basic Read ExecQuery Qualifier Declaration Schema Manipulation GetQualifier SetQualifier DeleteQualifier EnumerateQualifiers Page 26

27 Management Discovery Clients need to discover agents/object managers Enables Plug and Play Management Discover the management interface (not necessarily the actual device) the management interface is responsible for finding the device (may be proprietary) Uses SLP V2 Roles - Agent, Lock Manager, Object Manager Agents include supported Profiles Directory Server Optional Page 27

28 Service Template Language of service template: en Security Considerations: Template Text: template begins here template-type=bluefin:http template-version=0.1 template-description= # This is a concrete service type based on the bluefin abstract service # type. This service type describes the Bluefin interface that uses # HTTP as the transport protocol. template-url-syntax= url-path = ; Not used in this service template security = string O M L none # The security protocol supported by the SLP agent. none, ssl, password Page 28

29 Lock Manager SA 0 n SMIS Reference Model Directory Server Directory Agent 0 n Client User Agent 0 n SLP TCP/IP CIMxml CIM operations over http TCP/IP SA Agent 1 1 Device or Subsystem 0 n Proprietary Proxy Model Service Agent (SA) Agent Device or Subsystem Embedded Model 0 n SA Object Manager Proprietary Provider 1 n Device or Subsystem Device Proxy Model 0 n Page 29

30 SMI Key Components Storage Industry Architects & Developers Interoperability SMI Specification Testing Education & Collaboration SMI Industry and Plug-fests and Customer Promotion Demonstrations Technology Center Only the SNIA can deliver! Only the SNIA can deliver! #1 Priority for SNIA in 2003 Page 30

31 SMI Organization New SMI groups SMI - Involvement SNIA BOD Committees Forums Geography Forums Technical Council SMI Committee Storage Management Forum Europe Technical workgroups SMI Technical Steering Group Education Committee Supported Solution Forum UK DRM Fibre Channel Interoperability IP Storage Forum France Management Applications Management Protocols International Committee DAFS Implementers Forum Germany Storage Media Library IP Storage Marketing Storage Security Industry Forum Belgium NFS/RDMA OSD Finance Japan Policy Performance Analysis & Modelling Tech Centre NAS Security Membership Backup Page 31

32 The Evolutionary Path Q2 of 2004: >50 percent of the SNIA members companies, ship product using SMI 2005 Strategic Imperative Q4 of 2003: End-users, OEMs, and integrators will be able to ascertain interface compliance All storage managed By SMIS Q3 2003, ICTP Conformance Testing Launched Q2 2003: SMIS V1.0 Publicly Available Page 32

33 Ship V1.0 Spec Start V1.1 Spec SMI 2003 Focus Start ICTP conformance Testing Launch marketing effort (SM-Forum) Branding Promotion (Industry + Consumers) CIM-SAN-2 & 3, expand participation and functionality SMIS technology and spec roadmap Foster the availability of tools/education/services to accelerate vendor implementation Page 33

34 Clients and (Types) 2800, 3200, 3800 AppIQ Manager (WBEM Servicesbased) BMC Patrol Storage Management (SNIA-based) CA Brightstor SAN Mgr (SNIAbased) Brocade Crossroads EMC HDS CIM-SAN-1 HP IBM InRange LSI NetAp Qlogic Quantum Symm HDS HDS Enterp Virtual Tape Tape 2105 ESS 9000 E4600 F San Super T3 etrix rise Array Library Library F20 Model Box2 loader Virtual (VA) 800 Array (EVA) O O O O O O O O O O O * O O X O O O O O O O O O O O O O * X X O O * O O O O O X O O O O O O O O * O * CA Brightstor Portal (SNIA-based) O * O O O O O X O O O O * * O O * * * SUN VxVM Veri EMC:VisualSAN (SNIA-based) * * O O O O O * * O O * O * * * * O * EMC:Control Center (SNIA-based) X O O O O O O * O O O O O O O O * O * SNIA Generic GUI (SNIA-based) O O O O O O O O O O O O O O O O O O O HP:OpenView SAM (SNIA-based) * * O O O O O * * O O * O O * * * O * IBM Tivoli:TSRM,TSANM,etc.(SNIAbased) InterSAN PATHLINE (WBEM CLIbased) O O O O O * O O O O O O O O O O O O O * O O O * O O * McData/SANavigator (?-based) O * * * * * * * O Sun:StorEdge Configuration Service (WBEM Services-based) X 0 0 X X X X O O O * Veritas: NetBackup O O O Veritas:SAN Point Control (Pegasusbased) Copyright 2003 Storage Networking Industry Association. All Rights O O O O O O O O O O Page 34 Reserved.

35 Management App Accelerator Management Application Auto-generation of Application and Infrastructure Constructs Integration Infrastructure Object Model Mapping Vendor Unique Features SMIS Interface Platform Independent Distributed Automated Discovery Security Locking Object Oriented CIM/WBEM Technology Device Types Tape Library Switch Array Many Other MOF MOF MOF MOF Standard Object Model per Device Vendor Unique Function Page 35

36 Device Vendor Opportunity Mgmt. App. Vendor Mgmt. App. Vendor Mgmt. App. Vendor Mgmt. App. Vendor Mgmt. App. Vendor Mgmt. App. Vendor Mgmt. App. Vendor Mgmt. App. Vendor SMIS Interface MOF Platform Independent Distributed Object Oriented SMIS Agent or Object Manager Device Vendor CIM/WBEM Technology Vendor Unique Functionality Tape Library Product 1 Tape Library Product 2 Tape Library Product N Page 36

37 The Value Chain Single Extensible Management Transport + Base Object Model Compatibility New More Powerful Management Systems Reduce Storage Management Costs Customers Embrace Storage Networking Technology Faster Page 37

38 Distributed Management Task Force Standard CIM TC (Technical Committee) Interoperability Chair: Sun Database Chair: Oracle Chair: Andrea Westerinen, Cisco Board Members: Intel, Microsoft, Cisco, Sun, Tivoli/IBM, Compaq, Dell, HP, 3Com, BMC, NEC, Novell, Symantec, VERITAS Alliance Partners, WG Chairs Architecture Subcommittee System/Devices Chair: Cisco Events Chair: Sun Networks Chair: Cisco LDAP Mapping Chair: Avaya Policy/SLA Chair: IBM User/Security Chair: IBM DEN Chair: <Open> Applications/Metrics Chair: TOG Support/Help Desk Chair: STEI Page 38

39 Open Source Code Decide whether Java or C++ development language Java: SNIA (Open Group) CIMOM WBEM Services (Sun) CIMOM C++: OpenWBEM (Caldera's) CIMOM Pegasus (Open Group) CIMOM Page 39

40 References DMTF W3C SNIA OpenGroup Page 40