Network flow automation and Visibility. Arista Networks France IX

Transcription

1 Network flow automation and Visibility Arista Networks France IX

2 Are your workloads moving and scaling at an increased rate? Corporate Overview

3 Are you still waiting for provisioning to happen in seconds not weeks? Corporate Overview

4 Do your operations run 24x7 with no planned downtime? Corporate Overview

5 How to solve the network challenges with solutions shipping today Corporate Overview

6 Agenda Introduction Evolution of Automation in Networking SDN Use Cases Telemetry Q/A 6

7 Introduction 7

8 Data Centre Transport Agreement on the Physical topology Physical Architecture CLOS Leaf/Spine Consistent any-to-any latency/throughput Consistent performance for all racks Fully non-block architecture if required Simple scaling of new racks For the East to West Traffic workflows Spine Layer 10Gbe/40Gbe Layer 2/3 Leaf layer 10Gbe/1Gbe Layer 2/3 Consistent performance, subscription and latency between all racks Consistent performance and latency with scale Architecture built for any-to-any Data center traffic workflows 8

9 Data Centre Transport Building the Layer 3 network Physical CLOS leaf/spine architecture Equal Cost Multi-Pathing for active-active forwarding Standard protocols and Standard hardware, No increase in management or operational cost, minimal risk Strength All links are active, and forwarding traffic Distributed failure domain, with multiple spine topology Mac addressed and VLANs stay in the rack Issue 1U or chassis L3 switch Layer 3 between Leaf and Spine VM cannot move between rack, Layer 3 CLOS topology allows better control of mac and vlan usage Layer 2 within the Rack Subnet-A ECMP Subnet-B Physically Distributed resilient Core Subnet-C L2/L3 switch VXLAN was created to solve this issue Subnet-D ECMP Subnet-E OSPF or BGP Subnet-F 9

10 Virtual extensible LAN Virtual extensible LAN (VXLAN) IETF framework proposal, co-authored by Arista, Vmware, Cisco, Citrix, Red hat and Broadcom Announced at VMworld 2011 Vmotion without a large L2 network VM mobility across Layer 3 boundaries Integrates seamlessly with existing infrastructure Supported in hardware or software (Vshield) Similar standards proposed by Microsoft NVGRE for Microsoft HyperV VM /24 ESX host Subnet A VM /24 Layer 3 Tunnel VM mobility Across Layer 3 subnets Subnet B VM /24 ESX host VM /24 VM mobility within a best practice layer 3 network Architecture 10

11 Overlay Network Overlay Network provides transparency - Scalable Layer 2 services across a layer 3 transport - Decouples the requirements of the Virtualized from the constraints of the physical network - Tenant network transparent to the transport for Layer 3 scale - Multi-Tenancy with 24-bit tenancy ID and overlapping VLANs - Network becomes a flexible bandwidth platform Overlay network Physical Infrastructure VNI 3000 VNI 3000 VNI 2000 Transparent L2 Services Layer 3 Transport Scalable, multi-tenant Layer 2 services transparent to the Layer 3 transport network 11

12 Virtual extensible LAN VXLAN is carrying Ethernet, so it can work for Any VMs, Physical servers Any physical Appliances Load Balancing, FW, Storage, 12

13 The past: Outmoded development models Network Operating Systems were historically bound to specific hardware platforms Required 100% vendor development no customization Had no linkages to other companies applications and platforms Network Operating System Legacy Network Infrastructure time for a change 13

14 The future: Arista architecture for the SDCN Open Partnering: connecting the network to the best and most powerful infrastructurecentric applications available Series of powerful applications to run on the network in distributed system Network Applications Modular distributed system designed to be customized for customer s IT operations Universally capable infrastructure enables any application and workload combination Virtualization think cloud Programmatic and Flexible Network Operating System Universal Cloud Network 14

15 The Foundation is Programmability OpenFlow or other external / internal agent to control custom flow path Native Vmware / Nicira integration into vsphere, vcloud, NSZ - VXLAN Integration with OpenStack to support fully automated provisioning Native API calls with key partners. Enables network automation 15

16 Evolution of Automation in Networking 16

17 OpenStack OpenStack is a cloud operating system that controls large pools of compute, storage, and networking resources throughout a datacenter, all managed through a dashboard that gives administrators control while empowering their users to provision resources through a web interface. Source

18 Openstack Development and Contribution Openstack Quantum only supported a single network device driver - commonly the Open vswitch driver A dual-stack driver to Quantum that enables concurrent physical and virtual network element provisioning Nova Quantum/ Neutron This makes Openstack Quantum deployable and integrated across real world networks OVS Virtual Driver Physical Driver Software Defined Cloud Networks 18

19 VMTracer Provides Automated Integration and Visibility VLAN Trunks Opened/Pruned based on allowed range VLANs Created/Removed based on VM demand VLAN Trunks Opened/Pruned based on VM demand 7050# show vmtracer interface Ethernet48 Ethernet48: esx1.aristanetworks.com/ndstest/dvuplink1 VM Name Network Adapter VLAN Status State Exchange Network adapter 4 7 up/up -- Apache Network adapter 3 6 up/up vmotion MySQL Network adapter 1 5 up/up FT-A 19

20 Arista EOS Extensibility: XMPP XMPP Client/Server Multi-device Management Scalable, Simple, Open - Multi-device Message Bus Open Standard Open Source Federated Architecture Scales to 10,000+ Switches Encrypted, AAA Message Replay/Logging 20

21 Puppet & Chef Integration Puppet Master Puppet Agent Puppet IPC Chef Server is centralized store of your infrastructure s configuration Client Knife is used to communicate with Nodes using ssh Client Chef Workstation is a client with local Chef repository and properly configured Knife Systems managed by Chef are called Nodes Abstraction of EOS configuration into Resources Support Template-based automation tools Automate mundane tasks, reduce errors, save OPEX, real-time response to events Natively run Client/Agent in EOS Tight integration with EOS Tools (ZTP, AEM, CLI extensibility) 21

22 SDN Use Cases 22

23 Used features for deployment example DHCP Server TFTP/HTTP Server ZTP : Zero Touch Provisioning - Allow dhcp/bootp and scripting download Advanced Event Manager - Event Manager configuration Opscode Chef automation - Allow Chef client integration for management Cloudvision: XMPP - Remote control of single and multiple equipment simultaneously 1 DHCP offer 2 3 Config file or script Config request 23

24 Chef Integration Example /usr/bin/chef-client installs using standard Omnibus package & runs natively in EOS can run as daemon or scheduled task Cookbooks eos (used for today s demonstration) ohai (used for custom Ohai plugins) Recipes eos::default -- setup environment + custom ohai plugins eos::cloudvision -- manage CloudVision extension Roles eos_base -- ohai, eos::default eos_cloudvision -- eos::cloudvision Data Bags provides configuration parameters based on Arista OUI and system mac address 24

25 Potential Use Cases Network configuration and state inventory with Ohai Standardized routing policy Extending Chef command line tools into EOS CLI Configuration version control (using git or svn) Deploying EOS extensions Standardized interface templates Security policy Software image updates Development QA Deployment Configuration Methodology 25

26 Flowchart 26

27 Deployment Example 27

28 Stage 1: Arista ZTP Factory default switch boots No startup-config triggers ZTP DHCP request sent out all ports DHCP response including option 67 (bootfile) Download specified bootfile Restart switch 28

29 Stage 2: Arista AEM Factory default switch boots No startup-config triggers ZTP DHCP request sent out all ports DHCP response including option 67 (bootfile) Download specified bootfile Restart switch AEM fires onboot trigger Python script bootstraps Chef agent 29

30 Stage 3: Opscode Chef Factory default switch boots No startup-config triggers ZTP DHCP request sent out all ports DHCP response including option 67 (bootfile) Download specified bootfile Restart switch AEM fires onboot trigger Python script bootstraps Chef agent Chef agent executes Loads OHAI data from Sysdb Checks for CloudVision extension Downloads CloudVision and installs it 30

31 Stage 4: Arista CloudVision Factory default switch boots No startup-config triggers ZTP DHCP request sent out all ports DHCP response including option 67 (bootfile) Download specified bootfile Restart switch AEM fires onboot trigger Python script bootstraps Chef agent Chef agent executes Loads OHAI data from Sysdb Checks for CloudVision extension Downloads CloudVision and installs it CloudVision configured and operational Chef agent scheduled via CLI Scheduler Periodic runs by Chef agent keeps configuration standardized 31

32 Deployment Example Factory default switch boots No startup-config triggers ZTP DHCP request sent out all ports DHCP response including option 67 (bootfile) Download specified bootfile Restart switch AEM fires onboot trigger Python script bootstraps Chef agent Chef agent executes Loads OHAI data from Sysdb Checks for CloudVision extension Downloads CloudVision and installs it CloudVision configured and operational Chef agent scheduled via CLI Scheduler Periodic runs by Chef agent keeps configuration standardized 32

33 Arista EOS and A10 ID Address On/ Off VTEP VNI 5001 VTEP VNI /24 VTEP Hardware Virtualise : - Network appliances - Storage - Servers Lost Service 33

34 Practical Examples of SDN DirectFlow: Redirecting flows without any controller /24 via Backup via Spine-B Spine-A /24 via Backup via Spine-C Leaf-A Leaf-B Host-A DirectFlow enabled path selection via Spine-B <-> Spine-C Host-B Backup HTTP SMTP/Mail SIP/Voice Spine-B Spine-C 34

35 Smart System Upgrade: Initiating Maintenance Mode Maintenance Mode initiated Snapshot stores #neighbors, peers, etc Virtualization Infrastructure 35

36 Smart System Upgrade: Initiating Maintenance Mode Maintenance Mode initiated Snapshot stores #neighbors, peers, etc Virtualization Infrastructure Directly-connected Vmware hosts put into maintenance mode A10 graceful shutdown activated 36

37 Smart System Upgrade: Initiating Maintenance Mode Maintenance Mode initiated Snapshot stores #neighbors, peers, etc Virtualization Infrastructure Directly-connected Vmware hosts put into maintenance mode A10 graceful shutdown activated Open protocols used to drain traffic Exception based flow handling redirects traffic 37

38 Smart System Upgrade: General Operation Workload is moved Overlay facilitates virtual re-cabling Virtualization Infrastructure 38

39 Smart System Upgrade: General Operation Workload is moved Overlay facilitates virtual re-cabling Virtualization Infrastructure Maintenance is performed on device Device brought back into service API calls inform other devices 39

40 Smart System Upgrade: General Operation Workload is moved Overlay facilitates virtual re-cabling Virtualization Infrastructure Maintenance is performed on device Device brought back into service API calls inform other devices Maintenance summary sent to operations team Health checks are performed Removed from maintenance mode Workloads are rebalanced 40

41 Telemetry 41

42 How much is lack of visibility costing you? 59% of Fortune 500 companies experience a minimum of 1.6 hours of downtime per week -Dunn & Bradstreet Cost of an outage $ ,00 $ ,00 $ ,00 $ ,00 Downtime costs $5,600 per minute -Ponemon Institute $ ,00 $ ,00 $ ,00 $84 000, Minutes think differently. 42

43 Timeline of a problem is your network costing you money? Application intermittently slow $0 43

44 Timeline of a problem is your network costing you money? Users begin reporting issues 30 minutes $168,000 44

45 Timeline of a problem is your network costing you money? Set-up Bridge Assemble the team 45 minutes $252,000 45

46 Timeline of a problem is your network costing you money? Find the virtual machine 60 minutes $336,000 46

47 Timeline of a problem is your network costing you money? Look at counters Review system logs 90 minutes $504,000 47

48 Timeline of a problem is your network costing you money? Get a sniffer 120 minutes $672,000 48

49 Timeline of a problem is your network costing you money? Review the capture Isolate problem 150 minutes $840,000 49

50 Advanced Mirroring Advanced mirroring is used for in-path traffic mirroring. - Capturing data traffic and forwarding directly to mirror port for analysis - Destination could be a tap aggregation/matrix switch network for forwarding to a pool of analysis tools Server-A Eth-24 Analyzer Switch in the forwarding path, and mirroring traffic for analysis Server-B Eth-1 Eth-2 50

51 How do we get from this. 51

52 To this.. 52

53 Monitoring Infrastructure in action 53

54 Network-wide Visibility with Tap Aggregation Aggregated Mirror Traffic: Live Traffic Feed, timestamped, filtered LANZ+Stream: Live Congestion Metrics Switch 1 350ns Switch 1: Latency: 350ns Status: OK Application Monitor Application Path Analysis: Switch 3 15µs Switch 6 733ns 100µs 12µs 10µs Switch 3: Latency: 15µs Status: Heavy Congestion Top 3 congested flows Source Destination Port http http Switch 8 505ns Switch 6: Latency: 733ns Status: OK Switch 8: Latency: 505ns Status: OK 54

55 Thank You 55