Network virtualisation using Crossbow Technology

Transcription

1 Network virtualisation using Crossbow Technology Uroš Nedić, MSc OpenSolaris Contributor

2 Crossbow Technical Background Network Machines Network in a Box 2

3 Crossbow Features ization > IP Instances > ization - Vs > Service ization - Flows Resource partitioning > QoS/Diffserv (without performance penalties) > SLA on a per connection basis > Class of Service Support Performance & Observability > Dynamic polling > H/W and S/W fanout to multiple cores > Real Time Usage and History Better Defense against DDOS attacks 3

4 Stacks Services and Protocols CPU 1 VIRTUAL Compute Resources CPU 2 VIRTUAL CPU 'n' VIRTUAL CPU 1 Squeue CPU 2 Squeue VOIP HTTPS DEFAULT TCP UDP DEFAULT 1 Flow Classifier 2 Flow Classifier 4

5 Stacks Services and Protocols CPU 1 VIRTUAL Compute Resources CPU 2 VIRTUAL CPU 'n' VIRTUAL VOIP CPU 1 Squeue HTTPS DEFAULT The Squeue switches the MSI interrupt per stack between interrupt and polling mode and controls the rate of packet arrival for the virtual stack. The Vs are in the control path only. The data link layer is bypassed. 1 Flow Classifier 2 Flow Classifier 5

6 Crossbow Architecture the Hardware, kernel queues, and CPU and allow creation of s Use dynamic polling on s to schedule rate of packet arrival per V Effect of dynamic polling Mpstat (older driver) intr ithr csw icsw migr smtx srw syscl usr sys wt idl Mpstat (Crossbow based driver) intr ithr csw icsw migr smtx srw syscl usr sys wt idl Use Dynamic polling for B/W partitioning and isolation without any support from switches and routers 6

7 Parallelized Stack: Made for Cores/Threads Network Kernel CPU Application C L A S S I F I E R V Kernel Qs and threads V Kernel Qs and threads V Kernel Qs and threads Squeue Squeue Squeue Dedicated Lane 1000 s of Logical Connections Neptune 2 x 10 Gbe and/or 4 x 1Gbe Crossbow ized Network Streams & Vs Multi-Core Processor Application Threads Or Solaris Containers Or Machines 7

8 Network Containers ization Exclusive IP Stack s Switches Solaris Global Zone Zone xb1-z1 Zone xb1-z2 Resource Control Bandwidth Limits & Gauarantees Priority Dedicated CPUs bge0 Exclusive IP Instance V1 (100Mbps) Exclusive IP Instance V2 (200Mbps) Observability Watch real time usage for each V Snmp and Kstat per V History at no cost Client xb2 Flow Classifier Client xb3 8

9 Machines Solaris Host OS ization Engine Host OS VIRTUAL All Traffic Solaris Guest OS 1 ization Engine HTTP Guest OS 1 VIRTUAL HTTPS DEFAULT Solaris Guest OS 2 ization Engine Guest OS 2 VIRTUAL All Traffic Host OS V Guest OS 2 V Host OS All traffic Guest OS 1 HTTP Guest OS 1 HTTPS Guest OS 1 DEFAULT Guest OS 2 All Traffic H/W Flow Classifier 9

10 Network Machines Solaris DMZ Apache Router/Firewall DNS Server Dedicated CPUs TCP/ UDP IP TCP/ UDP IP TCP/ UDP IP APIs for ISVs at each layer A A B B N2/NIU Flow Classifier Flow Classifier A B Internet Intranet 10

11 Anatomy of a Typical Router Major cost paid on bringing the packet in and route lookup etc. PORT 0 Xmit Q 1 Xmit Port 0 PORT 1 PORT 2 Route Lookup Engine Xmit Q 2 Xmit Q 3 Xmit Port 1 Xmit Port 2 PORT n Xmit Q m Xmit Port m Packets are dropped on Xmit Queues 11

12 Anatomy of Crossbow Router Network Interface OpenSolaris Network Stack Compute Interface 0 V HTTPS T/C Packet Classifier 1 2 V V Data Voice T/C T/C 16 V Video T/C Policy-based packet drop on ingress zero cost drop. Explicit mapping of Compute Threads or Cores to Network Threads creating virtual express lanes Dedicated BW, Priority, and CPU/Threads assigned to each lane High performance packet classification 12

13 Physical Network Router Host 1 Host 2 Client Port Port Port Port Port Gbps 1 Gbps Switch 3 1 Gbps 100Mbps Switch 1 Crossbow Network in a Box 1 Gbps 1

14 Example V Usage Done using dladm(1m), as with other data-link interface administration # dladm create-vnic -d bge1 vnic1 # dladm create-vnic -d bge1 -m random -p maxbw=100m -p cpus=4,5,6 vnic2 # dladm create-etherstub vswitch1 # dladm show-etherstub LINK vswitch1 # dladm create-vnic -d vswitch1 -p maxbw=1000m vnic3 # dladm show-vnic LINK OVER MACTYPE MACVALUE BANDWIDTH CPUS vnic1 bge1 factory 0:1:2:3:4:5 - - vnic2 bge1 random 2:5:6:7:8:9 max=100m 4,5,6 vnic3 vswitch1 random 4:3:4:7:0:1 max=1000m - 1

15 Join Us.... Our communities and projects are open on OpenSolaris.org: > CrossBow: > VNM: > Networking: Where you will find: > Lively discussions, design docs, FAQs, source code drops, binary releases, etc... 1