Visio Automation for Infrastructure Design and Management. David Cuthbertson Square Mile Systems / AssetGen

Transcription

1 Visio Automation for Infrastructure Design and Management David Cuthbertson Square Mile Systems / AssetGen

2 A Few Questions Anyone here attended the workshops in 2014 and 2016? Which is easier and faster to complete? a. Updating a Visio drawing with changes b. Re-drawing into Visio a drawing sent in Cad/PDF/JPEG/BMP What has to happen to have 6500 racks drawn with consistent format and detail by different engineers?

3 This Workshop Will Show What can be reduced with Visio workload - skills dependent cost - $26 or $20,000 time - 16 minutes or 25 days How to improve diagram quality and accuracy All of which you can do later today - yourself!!

4 Visio Automation Agenda 1. Understand Visio out of the box 2. Diagramming techniques - Making it simpler for all 3. Linking Visio to data sources - Reduce cut/paste, diagram refresh, consistency 4. Automation for larger infrastructures - Automated creation and updating

5 Diagrams Are Very Useful!

6 If A Picture Paints a Thousand Words How do we paint a thousand pictures? Easily?

7 CRITICAL MAJOR MINOR USER COMPACT I micros ystems 440 Understanding IT Dependencies Isn t Easy Many 1,000s of documents are created by projects, operations and risk processes Commercial Physical Logical Business Ownership Room LAN System Support Rack SAN Service Software Cabling Virtual Machines Applications Security Power OS User Data Contracts Hardware Build Remote Mgmt DR Plan Licences Backup Environment Change Impact UK_BIRM_UX01 One Server, Multiple Mappings and Diagrams

8 CRITICA L MA JO R MI NO R USE R CO M PAC T COMPACT PROLIANT PROLIANT PROLIANT SERVERWIN0099 SERVERWIN0001 SERVERWIN00078 I mic r osy ste ms UK_BIRM_UX01 ONLINE SPARE MIROR PCI POWER POWER RISER SUPLYSUPLY CAGE PP PM PM PROCPROC UID DIMS FANS 1 2 INTER LOCK OVER TEMP HP ProLiant DL380G5 PDU1 I-Series A PDU2 SAN-01 SAN-02 I-Series B Run Date: 02 June 2008 CRM_DB INS_LIVE ACCOUNTS BLADE_BIRM01 BLADE_BIRM02 BLADE_BIRM03 PAYROLL Run Date: 12 December 2008 Dependencies & Diagrams Rack Floor Plan ITIL Service Map Data Flows AssetGen Planner Birmingham Computer Room Racks AssetGen Planner Birmingham Computer Room AA AB AC AD AE AF AG AH AI AJ AK AL AM AN AO AP AQ AR AS AT AU AV AW AX AY AZ Claims Processing Example Service assets have embedded links for further analysis or verification Birmingham Call Centre - UK Computer Room Front Rear Sales Policy Administration Claims Processing Accounts Receivable Accounts Payable Payroll CRM Member Module Policy Module Claims Module Payment Module Accounts Module Sage Payroll Earth Bar 15 tsr SVRUNX001 Physical assets also have AssetGen Connect links for more detail SVRWIN001 Network Topology Example AssetGen Planner Blade Test SW-BHAM-CORE1 SW-BHAM-CORE2 Blade Server Chassis Visualisation Run Date: 02 June 2008 SW-BHAM-01 SW-BHAM-05 SW-BHAM-06 SW-BHAM-04 SW-BHAM-02 BLADE-BIRM01.BLADE-SW1 UK_BIRM01_BLADE-01 UK_BIRM01_BLADE-09 UK_BIRM01_BLADE-02 UK_BIRM01_BLADE-10 UK_BIRM01_BLADE-03 UK_BIRM01_BLADE-04 UK_BIRM01_BLADE-12 UK_BIRM01_BLADE-05 BLADE-BIRM01.BLADE-SW2 BLADE-BIRM02.BLADE-SW1 UK_BIRM02_BLADE-01 UK_BIRM02_BLADE-02 UK_BIRM02_BLADE-03 UK_BIRM02_BLADE-04 UK_BIRM02_BLADE-05 BLADE-BIRM02.BLADE-SW2 BLADE-BIRM03.BLADE-SW1 BLADE_BIRM03.BLADE-01 BLADE_BIRM03.BLADE-02 BLADE_BIRM03.BLADE-03 BLADE_BIRM03.BLADE-04 BLADE-BIRM03.BLADE-SW2 UK_BIRM_UX01 UK_BIRM_UX02 UK_BIRM_UX09 UK_BIRM_UX04 UK_BIRM_UX05 UK_BIRM_UX03 UK_BIRM_UX06 UK_BIRM_UX07 UK_BIRM_UX08 UK_BIRM_UX10 Network Topology Build Zones

9 Diagrams Also Cover Processes Projects Design Team Deployment Planning Build Team Change Mgmt. Request Request form Std Components Yes No Design Review Outline Design Doc Forward booking schedule Book Contractor Update Capacity Plan Allocated dates Deployment design QA Check Change from reserved to allocated Accept/Reject Accept Release Handover Detailed Plan Schedule Change Reject Confirm Contractors Square Mile Systems 9

10 Information Gaps Cause Pain 1. Buy things you don t need 2. Don t buy things you do need 3. Reverse engineer with every project 4. Unnecessary site surveys 5. Project timescales are not predictable 6. Repeated one off audits 7. Overload key individuals 8. Less confidence in security controls 9. Problems escalate 10. Inability to optimise team processes 11. Unplanned change disruption 12. Fault resolution takes longer 13. Duplicate what is already there Business Processes Departmental, Company Services End user, infrastructure, supplier Applications PC, server, mainframe, SOA Virtual Infrastructure PCs, Network, Servers, Storage, DBMS Hardware Infrastructure PCs, Network, Servers, UPS, Storage, Other Fixed Infrastructure (Cabling, Power, Cabinets, Rooms, Buildings)

11 Visio history 1. Visio Basics 1992 First released, 2000 acquired by Microsoft Last non-ms versions had auto-discovery, equipment templates all removed with Visio 2003 Versions Visio 2016 Standard Visio 2016 Professional Visio Pro For Office 365 Visio Viewer (runs in IE browser) Visio app for ios Visio online web based collaboration

12 Which Version - Standard or Professional? No thought required Go for Professional! Why? More extensive selection of shapes Data linking (look for data tab) Data graphics saves typing and redrawing diagrams Visio extras An hour saved in a year makes it worth it!

13 Visio Resources And Help Microsoft web site Books LinkedIn group Visio Enthusiasts Equipment manufacturer web sites Cisco, CommScope, Siemon HP, Dell, IBM, others 3rd Party stencils netzoom, others Visioguy forum

14 Categories Templates, Stencils, Shapes Templates Stencils Shape

15 Visio Concepts and terms Template Stencil Shape Shape properties Connector Background Layer RTR-BHAM-01 SW-BHAM-01 Properties Cisco Live Data Centre Comms Room

16 Visio Basics -1 Creating new diagram from a template Manipulating shapes on a page Aligning and Distributing Shapes Copy, Paste and Duplicate Shapes Grouping and ungrouping shapes Foreground and Background options Zooming in and Out of the Page Using the Drawing Toolbar to create basic shapes

17 Visio Basics - 2 Connectors Static and dynamic glue Adding, deleting and moving connector points Using different stencils Stencil search Shape behaviour -1d, 2d, drill down Working with text Object text Freeform text Text block tool

18 Static glue Static glue is to a particular connection point The connection points used don t move even if the shapes are moved

19 Dynamic glue Drag connector onto shape and wait until shape is highlighted in red If you move the shapes relative to each other the connection moves appropriately

20 Using Different Stencils (and searching) Use Shapes tab Select via menus Use Search options External stencil sets Suppliers, 3 rd party

21 Danger! - Visio File Sizes Two files Diagram 1 Diagram kB 12kB Diagram 1 is 166 times the size of Diagram 2! Some tips to reduce file sizes

22 Good diagramming practice 2. Diagramming Techniques 1. The detail that you see - What is seen visually / printed 2. Additional data / information within diagram - Additional action by viewer display, click, show layer, etc. 3. How you get to other information - Drill down, open files, launch remote session

23 The Process of Creating a Diagram 1. Purpose Gather data Define shapes Transfer data to diagram 1. Which takes the most time? 2. Where can errors creep in? 5. Layout Add extra detail Save 8. Send / publish diagram

24 CRITICAL MAJOR MINOR USER CO MPACT WS -X6 K- SUP 1A -2GE 1 SUPERVISOR 1 FAN STATUS C6509-E-FAN INSTALL RUN CISCO SYSTE MS, INC. STATUS SYSTEM WS-X6748-GE-TX 1 2 STATUS WS-X6748-GE-TX 1 2 STATUS ACTIVE PWR MGMT INPUT V ~ 16A 60/50 Hz INPUT V ~ 16A 60/50 Hz RESET WS-C6509-E P O R T SW-BHAM-CORE1.Card SW-BHAM-CORE1.Card4 INSTALL INPUT V ~ 16A 60/50 Hz INPUT V ~ 16A 60/50 Hz INPUT FAN OUTPUT INPUT FAN OUTPUT OK OK FAI L OK OK FA IL 1 2 SW-BHAM-CORE1 1 2 SWITCH MUST BE IN OFF O POSITI ON TO INSTALL/ CISCO SYSTEMS, INC. SWITCH MUST BE IN OFF O POSITION TO INSTALL/ REMOVE POWER SUPPLY. FASTENER MUST BE FULLY REM OVE POWE R S UPP LY. FAST ENE R M US T BE FULLY ENGAGED PRIOR TO OPERATING POWER SUPPLY. E NGAGE D PRIOR TO OP ERATING POWE R S UPP LY. I CONSOLE P O R T DTE/DCE 100 % 1% SW IT CH L OAD SW-BHAM-CORE1.Card1 10/ 10 0/ GE MOD SW-BHAM-CORE1.Card5 10/ 10 0/ GE MOD SW-BHAM-CORE1.Card9 microsystems RUN PCM CI A EJECT LINK PORT FABRIC ENABLED RJ FABRIC ENABLED RJ LINK PORT Diagram Process Examples 1. Purpose Rack Diagram R01 Network Diagram Orlando LAN 2. Gather data Select Rack R01 Inventory Switches / Router in Orlando SW-BHAM-Trade01 3. Define shapes Match to Physical Shapes Match to Logical Shapes 4. Transfer data to diagram Create Shapes Create Shapes and connections 5. Layout Place/size to position in rack Move/size for readability 6. Add extra detail Notes, etc. Notes, etc. 7. Save Save as Rack R01 Save as Orlando LAN 8. Send / publish diagram Store on server Intranet/SharePoint Store on server Intranet/SharePoint

25 Is This A Good Diagram?

26 Does It Have These Characteristics? 1. Title 2. Purpose 3. Author 4. Version 5. Date 6. Instructions 7. Symbols 8. Attributes 9. Connections 10. Grouping 11. Background / layers

27 Zachman Framework Example Different views for Different people John A. Zachman, Zachman International

28 Visio Examples Floor plans Importing CAD / other formats Layers Data center floor plans Backgrounds Hyperlinking

29 3. Linking Visio To Data Sources Saves typing mistakes Enables refresh of data One diagram can serve multiple purposes Less to maintain Multiple views of one device Less to maintain Enables use Of Data Graphics Feature

30 Understanding Reality To understand infrastructure and manage change We need multiple views Rack schematics Equipment configuration Physical connectivity Logical end point connectivity End device connectivity

31 CRITICAL MAJOR MINOR USER CO MPACT COMPACT PROLIANT PROLIANT PROLIANT I microsystems ON LINE SPA RE HP MIRROR ProLi ant PCI POW ER POWER RISER DL 380 G5 S UPPLY SUPPLY CAGE DIMMS PRO C PROC UID FA NS 1 2 INTER LOCK OV ER TEMP 440 Types Of Information / Documentation What should be updated with a server or network change? 1. Update project documentation with as built details 2. Update asset/inventory list 3. Update rack diagrams 4. Update network patching records 5. Update switch port usage and capacity 6. Update floor plan rack capacity 7. Update power usage spreadsheet(s) 8. Update storage / backup system documentation 9. Update systems architecture documentation 10. Update DR lists and documents 11. Update supplier maintenance records 12. Update billing and charging data The larger the environment the more there is.

32 UK_BIRM01_BLADE-05 UK_BIRM01_BLADE-04 UK_BIRM01_BLADE-03 UK_BIRM01_BLADE-02 UK_BIRM01_BLADE-01 BLADE-BIRM01.BLADE-SW2 BLADE-BIRM01.BLADE-SW1 UK_BIRM01_BLADE-12 UK_BIRM01_BLADE-10 UK_BIRM01_BLADE-09 Multiple Device Instances in Diagrams Rack Position Floor Plan BLADE_BIRM01 Service view H/W Build Power Supply Network Connections

33 Reducing The Workload! Excel Visio Floor box list Cabinet list Patch panel list Inventory Inventory Inventory Floor plan Equipment room floor plan Backbone cabling diagram Network diagram Rack diagram Server connectivity diagram

34 Using External Data Sources New Updating 1. Purpose 1. Purpose Gather data Define shapes Time saving Gather data Check diagram for match 4. Transfer data to diagram 4. Add / Delete shape Connector, Data 5. Layout 5. Review Layout 6. Add extra detail 6. Add extra detail 7. Save 7. Save 8. Send / publish diagram 8. Send / publish diagram

35 Visio Data Graphics Standard feature 2007/10/13/16 Professional Enables use of embedded data Display multiple text fields around a shape Data bars to show capacity Use icons for status differences Change shape colour based on data value SW-BHAM-09 Switch Live SW-BHAM-09 SW-BHAM

36 Limitations Of Visio / Data Source Good for quick diagrams The data transfer and refresh is automated, but the filtering and selection is manual It doesn t connect shapes together Limits value in a network environment New devices are not added to diagrams

37 First Steps For Multiple Diagrams Control use of shapes / stencils Follow best practices for diagram information Save reference versions in common areas File locations Web site SharePoint Use a common source where possible for shape data Databases preferred to spreadsheets Create views to suit diagram information need

38 4. Automation For Larger Infrastructures Looking beyond a few spreadsheets Minimise manual maintenance effort Scale and separation of roles demands it Improving accuracy and consistency Software driven diagram production Infrastructure document management Shared across teams, controlled access

39 Automating Documentation - Example Manual method draw a rack diagram 2 5 hours Gather rack inventory data and positioning Find Visio shapes for equipment Draw the rack Automated method with software 10 seconds Tick rack for cabinet drawing Visio rack diagram produced 100 racks 16 minutes or 25 days or $26 vs $20,000 ($100hr) 6500 racks???

40 Automated Enterprise Drawing Should we draw and redraw diagrams in Visio or have a GUI that does this onto a database? Yes for simple views (i.e. rack, path) No for anything that requires layout or crosses technologies Physical floor plans, blown fiber, cabling runs, OSP Logical LAN/SAN/VLAN/WAN/VLAN system If we are refreshing data, then we have to update existing shapes, adding/removing shapes and connectors. Beyond Excel/Visio data linking

41 Extending Visio Automation New Updating 1. Purpose 1. Purpose Gather data Define shapes Time saving Gather data Check diagram for match 4. Transfer data to diagram 4. Add / Delete shape Connector, Data 5. Layout 5. Review Layout 6. Add extra detail 6. Add extra detail 7. Save 7. Save 8. Send / publish diagram 8. Send / publish diagram

42 Simple Goals Draw 60 rack diagrams and save on a file server, in folders listed by room location Check and update 100 site network diagrams with changes in devices, connections and data Refresh an updated set of build documents covering racks, hardware, cabling, power within a data center transition project When now, tonight, every Friday

43 Many Infrastructure Information Needs Plan Build Operate Risk Dispose Project and tasks Ease and speed of creation Ease of distribution Flexible to meet task needs Limited training Examples Project documentation Equipment lists Visio/CAD diagrams Test results Operations And Risk Control Ease of use by many Structured for integration & reporting Support for multiple processes Wide scope the big picture! Examples Asset and Inventory management Business / service dependencies Monitoring of performance, status Risk and Recovery

44 Leverage Data Sources Plan Build Operate Risk Dispose Documents Lists Diagrams CMDB NMS IIM CMS SAM DCIM Knowledge Contracts Monitoring Workflow Capacity Data Storage Inventory Networks Cabling Power Excel Visio Dave(s)

45 Maintain - Infrastructure Knowledge Plan Build Operate Risk Dispose Project and tasks Operations And Risk Control Ease and speed of creation Ease of distribution Flexible to meet task needs Limited training Ease of use by many Structured for integration & reporting Support for multiple processes Wide scope the big picture! Record planning decisions in the operational system Produce project docs for/from the operational system

46 Infrastructure Documentation Workflow Project/ Design teams Could we get the project teams to update operational Visio diagrams? Operations Audit team

47 CRITICAL MAJOR MINOR USER CO MPACT WS -X6 K- SUP 1A -2GE 1 SUPERVISOR 1 FAN STATUS C6509-E-FAN INSTALL RUN CISCO SYSTE MS, INC. STATUS SYSTEM WS-X6748-GE-TX 1 2 STATUS WS-X6748-GE-TX 1 2 STATUS ACTIVE PWR MGMT INPUT V ~ 16A 60/50 Hz INPUT V ~ 16A 60/50 Hz RESET WS-C6509-E INSTALL INPUT V ~ 16A 60/50 Hz INPUT V ~ 16A 60/50 Hz INPUT FAN OUTPUT INPUT FAN OUTPUT OK OK FAI L OK OK FA IL 1 2 SW-BHAM-CORE1 1 2 SWITCH MUST BE IN OFF O POSITI ON TO INSTALL/ CISCO SYSTEMS, INC. SWITCH MUST BE IN OFF O POSITION TO INSTALL/ REMOVE POWER SUPPLY. FASTENER MUST BE FULLY REM OVE POWE R S UPP LY. FAST ENE R M US T BE FULLY ENGAGED PRIOR TO OPERATING POWER SUPPLY. E NGAGE D PRIOR TO OP ERATING POWE R S UPP LY. I CONSOLE DTE/DCE 100 % 1% SW IT CH L OAD SW-BHAM-CORE1.Card SW-BHAM-CORE1.Card4 48 P O R T 10/ 10 0/ GE MOD SW-BHAM-CORE1.Card5 48 P O R T 10/ 10 0/ GE MOD SW-BHAM-CORE1.Card1 SW-BHAM-CORE1.Card9 microsystems RUN PCM CI A EJECT LINK PORT FABRIC ENABLED RJ FABRIC ENABLED RJ LINK PORT Diagram Automation Examples 1. Purpose Rack Diagram R01 Network Diagram Orlando LAN 2. Gather data Select Rack R01 Inventory Switches / Router in Orlando SW-BHAM-Trade01 3. Define shapes Match to Physical Shapes Match to Logical Shapes 4. Transfer data to diagram Create Shapes Create Shapes and connections 5. Layout Place/size to position in rack Move/size for readability 6. Add extra detail Notes, etc. Notes, etc. 7. Save Save as Rack R01 Save as Orlando LAN 8. Send / publish diagram Store on server Intranet/SharePoint Store on server Intranet/SharePoint

48 Simplify Infrastructure Data Capture Data capture focusses on delivering database load files Visualization is either created automatically, or by combining data with existing backdrops - floor plans No need to check across multiple diagrams / documents for consistency and format A faster, less complex and less costly audit, which doesn t require high skill levels within the audit team as the software system creates the visualization Excel Building Excel Rack Excel Device Excel Cable

49 Making Trusted Data A Reality 1. Establish policies, standards and ownership of data and diagrams. Make it simpler and easier for engineers and managers 2. Have project / operations use common terms & formats Supply templates, naming system, labels, etc. 3. Reduce the numbers of documents / files to maintain Consolidate into centralised systems and make them easy to find Link / create / update Visio diagrams, reports, excel from databases 4. Use operational systems to support planning processes

50 This Workshop Has Shown What can be reduced with Visio workload - skills dependent cost - $26 or $20,000 time - 16 minutes or 25 days How to improve diagram quality and accuracy All of which you can do later today - yourself!!

51 Visio Automation Tips and Techniques Lots of productivity features are unknown Save yourself and others a lot of effort planning and managing infrastructure! Learn more about Visio Linking to existing data sources has many benefits Less errors, easier to refresh diagrams and update them Use the data graphics feature to reduce diagram numbers For larger environments Assess the value of database driven systems

52 Additional Materials Evaluation software Free DCIM/CMS evaluation version Webinars Data center practices, Visio integration Free SMS Visio utilities Downloads and videos Training/webinars/videos Onsite/remote Visio training, documentation methods, etc.