THE NETWORK AND THE CLOUD BUILDING THE FOUNDATION FOR THE MODERN DATA CENTER Andy Ingram SVP Worldwide Data Centers 1 Copyright 2012 Juniper Networks, Inc. www.juniper.net
Occam s Razor: When faced with alternatives, the simplest choice is usually correct Data Center Networks: Should be as simple as possible Why a Fabric Agenda Juniper s Vision Common Questions Alternative Fabrics 2 Copyright 2012 Juniper Networks, Inc. www.juniper.net
3 Copyright 2012 Juniper Networks, Inc. www.juniper.net
DEFINING CLOUDS CLOUD COMPUTING CLOUD INFRASTRUCTURE Service delivery model Business model? Public and private clouds Resource management model 4 Copyright 2012 Juniper Networks, Inc. www.juniper.net
CUSTOMERS ARE BUILDING CLOUDS Economics The Network A single scalable Resource pool Pooling-Clouds is the foundation Agility 5 Copyright 2012 Juniper Networks, Inc. www.juniper.net
PATH TO THE CLOUD 0 Applications 1 Consolidation Lower Cost 2 Optimization Greater Agility Availability 3 Self Provisioned Cloud 6 Copyright 2012 Juniper Networks, Inc. www.juniper.net
APPLICATION SILOS Client/User Finance Employees Customers Application A HR B 95% 7 Copyright 2012 Juniper Networks, Inc. www.juniper.net
ANY TO ANY SERVICES Portal: A HR Network Employees Devices Rich Customers media New Suppliers applications Digitized Machines information Machine Partners to Machine B Applications: Analysis Reporting CRM Database Administration Data Sources: Purchasing A A HR HR HR Inventory Employees Database Transactions Customers Partners Sensors Inventory Suppliers Devices B B 75% 8 Copyright 2012 Juniper Networks, Inc. www.juniper.net
APPLICATION EVOLUTION Application Evolution Client Server Web 2.0 SOA SaaS Server growth and standardization Storage on a Network LAN FC SAN 9 Copyright 2012 Juniper Networks, Inc. www.juniper.net
CHANGING ROLES OF THE NETWORK Traditional role connecting users North-South traffic New role connecting devices East-West traffic Ideally one hop away 75% of network Latency Tolerant traffic is now going East-West Latency Sensitive Newest role foundation of the cloud Any-to-any connectivity 95% of network traffic was going North-South Application running 10 Copyright 2012 Juniper Networks, Inc. www.juniper.net
PATH TO THE CLOUD 0 Applications 1 Consolidation Lower Cost 2 Optimization Greater Agility Availability 3 Self Provisioned Cloud 11 Copyright 2012 Juniper Networks, Inc. www.juniper.net
THE ECONOMICS OF THE DATA CENTER Implementations 97% of organizations 40-45% of workloads Physical Server Installed Base (Millions) Logical Server Installed Base (Millions) Complexity and Operating Costs Capital Savings Millions Installed Servers 80 60 40 20 1996 1997 1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 0 Source: IDC 12 Copyright 2012 Juniper Networks, Inc. www.juniper.net
PATH TO THE CLOUD 1 Consolidation 2 Optimization Greater Agility Availability 3 Self Provisioned Cloud Lower Cost Security: Connectivity: 0 Perimeter to Multi layer Applications Challenge Challenge Trees to Any-to-Any 13 Copyright 2012 Juniper Networks, Inc. www.juniper.net
CHALLENGE - NEW SECURITY MODEL Castle Model Hotel Model Perimeter security Physical separation Multi-layer security Virtual separation 14 Copyright 2012 Juniper Networks, Inc. www.juniper.net
THREE PROBLEMS WITH THE LEGACY NETWORK 1. Less is More: Multiple networks to orchestrate 2. Metcalfe s Revenge: FC SAN Geometrically increasing complexity Production Management vmotion vcenter 15 Copyright 2012 Juniper Networks, Inc. www.juniper.net
Complexity COMPLEXITY METCALFE S REVENGE Devices 400 300 200 Interactions 10,000 7,500 5,000 No. of Interactions = *N = No. of managed devices N*(N-1) 2 Solve for the smallest N possible N=1 Too Complex Interactions 100 2,500 Managed Devices 0 1000 2000 3000 No. of Ports 4000 5000 6000 16 Copyright 2012 Juniper Networks, Inc. www.juniper.net
THREE PROBLEMS WITH THE LEGACY NETWORK 1. Less is More: Multiple networks to orchestrate 2. Metcalfe s Revenge: Geometrically increasing complexity 3. Tyranny of Trees: Inconsistent application behavior 17 Copyright 2012 Juniper Networks, Inc. www.juniper.net
THE TYRANNY OF TREES 69% Typical tree configuration Bubbles Optimal performance VM One Hop Location matters in a tree architecture Of respondents said Increased Latency and Unpredictable Latency of Applications is a problem MeriTalk. 18 Copyright 2012 Juniper Networks, Inc. www.juniper.net
THE TYRANNY OF TREES Typical tree configuration Location matters in a tree architecture Appliances and VLANs Shadows VM 19 Copyright 2012 Juniper Networks, Inc. www.juniper.net
TRANSFORM THE NETWORK One Network Flat, any-to-any connectivity 20 Copyright 2012 Juniper Networks, Inc. www.juniper.net
TRANSFORM THE NETWORK One Network Flat, any-to-any connectivity Key resources are one hop away VM Key resources are ALWAYS one hop away Locality should not matter in a virtualized data center 21 Copyright 2012 Juniper Networks, Inc. www.juniper.net
TRANSFORM THE NETWORK One Network Flat, any-to-any connectivity Switch Fabric Single device N=1 Switch Fabric Data Plane Flat Any-to-any Control Plane Single device Shared state Performance and simplicity of a single switch Single switch does not scale Single point of failure 22 Copyright 2012 Juniper Networks, Inc. www.juniper.net
TRANSFORM THE NETWORK One Network Flat, any-to-any connectivity Virtual Chassis Up to 10 devices QFabric A Network Fabric has the. Performance and simplicity of a single switch Up to 128 devices And the 23 Copyright 2012 Juniper Networks, Inc. www.juniper.net Single device N=1 Switch Fabric Data Plane Flat Any-to-any Control Plane Single device Shared state Scalability and resilience of a network
SIMPLIFY THE NETWORK 3 2 1 3 The legacy network, 3 tiers Ethernet Servers NAS FC Storage FC SAN 25 Copyright 2012 Juniper Networks, Inc. www.juniper.net
SIMPLIFY THE NETWORK 3 2 1 2 Consolidate and virtualize appliances SRX5800 Ethernet SRX One Arm Design vgw Servers NAS FC Storage FC SAN 26 Copyright 2012 Juniper Networks, Inc. www.juniper.net
SIMPLIFY THE NETWORK 3 2 1 Remote Data Center MX Series Ethernet 2 Virtual Powerful chassis Edge Services at access tier Inter-DC connectivity MPLS and VPLS SRX5800 Servers NAS FC Storage FC SAN 27 Copyright 2012 Juniper Networks, Inc. www.juniper.net
SIMPLIFY THE NETWORK 3 2 1 Remote Data Center MX Series Ethernet 2 Virtual Flatten chassis to 2 tiers at of access switching tier EX8216 STP SRX5800 EX4200 Servers NAS FC Storage FC SAN 28 Copyright 2012 Juniper Networks, Inc. www.juniper.net
SIMPLIFY THE NETWORK 3 2 1 Remote Data Center MX Series 2 Data center fabric, today EX8216 SRX5800 EX4200 Servers NAS FC Storage FC SAN 29 Copyright 2012 Juniper Networks, Inc. www.juniper.net
1 TIER 3 2 1 Remote Data Center MX Series SRX5800 Servers NAS FC Storage One large, seamless resource pool 30 Copyright 2012 Juniper Networks, Inc. www.juniper.net
A New Architecture QFabric is not a network QFabric is a switch Design Goals Flat, resilient fabric Everything is one hop away Traffic converged on a single fabric Scale without complexity The ability to add capacity without adding operational complexity 31 Copyright 2012 Juniper Networks, Inc. www.juniper.net N=1
A Revolutionary New Architecture 3 Design Principles Management Plane N=1 Operational model of a single switch Control Plane Data Plane Federated Intelligence Only way to scale with resilience Rich edge, Simple core Everything is one hop away 32 Copyright 2012 Juniper Networks, Inc. www.juniper.net
DATA PLANE IN A SINGLE SWITCH Data Plane 1. The line cards contain the ports and processing intelligence 2. The fabric cards interconnects all ports any-to-any 3. A single full lookup processes the packets 33 Copyright 2012 Juniper Networks, Inc. www.juniper.net
CONTROL PLANE IN A SINGLE SWITCH Control Plane Single consciousness Centralized shared table(s) have information about all ports Management Plane All the ports are managed from a single point 34 Copyright 2012 Juniper Networks, Inc. www.juniper.net
SINGLE SWITCH DOES NOT SCALE Ports can be added to a single switch fabric. but eventually it runs out of real estate. After this, the network cannot be flat. 35 Copyright 2012 Juniper Networks, Inc. www.juniper.net
SINGLE SWITCH DOES NOT SCALE Choice: Sacrifice simplicity or change the scaling model 36 Copyright 2012 Juniper Networks, Inc. www.juniper.net
SCALING THE DATA PLANE Data Plane Interconnect vs Switch So, we separate the line cards from the fabric. And extend the copper traces with fiber links. For redundancy add multiple devices. Bandwidth: 10 Tb/s vs 10 Tb/s Power: 3 Kw vs 13 Kw ASICs in DP: 3 vs 5-12 Latency: 2 us vs 10-25 us QF/Interconnect QF/Node 37 Copyright 2012 Juniper Networks, Inc. www.juniper.net
SCALING THE DATA PLANE Data Plane QF/Interconnect So, we separate the line cards from the fabric. And replace the copper traces with fiber links. For redundancy add multiple devices. Enable large scale. QF/Node 38 Copyright 2012 Juniper Networks, Inc. www.juniper.net
SCALING THE DATA PLANE Data Plane QF/Node QF/Interconnect 1. All ports are directly connected to every other port 2. A single full lookup at the ingress QF/Node device 3. Blazingly fast: Always under 5us 3.71us (short cables) QFabric is faster than any Ethernet chassis switch ever built 39 Copyright 2012 Juniper Networks, Inc. www.juniper.net
SCALING THE CONTROL PLANE Control Plane Active Backup The intelligence and state is federated, distributed across the fabric Old Model Active/Backup The single active instance limits scalability 40 Copyright 2012 Juniper Networks, Inc. www.juniper.net
SCALING THE CONTROL PLANE Control Plane QF/Director The intelligence and state is federated, distributed across the fabric New Host Address New Model Services Oriented Control and management services use a scale out model 41 Copyright 2012 Juniper Networks, Inc. www.juniper.net
SCALING THE MANAGEMENT PLANE Management Plane QF/Director Single point of management Extensive use of automation Familiar operational model Managed as a single switch - N=1 42 Copyright 2012 Juniper Networks, Inc. www.juniper.net
OUT-OF-BAND CONTROL/MGT PLANE Out-of-band connections Fully redundant networks QF/Director Control Network 1 GbE network connected To EX4200 Control Network 2 GbE network connected To EX4200 43 Copyright 2012 Juniper Networks, Inc. www.juniper.net
BENEFITS OF A SWITCH FABRIC Scales Performs Simplifies Lowers Cost Build large, efficient clouds Every application performs better Less hardware Operational simplicity of a switch Greater reliability 44 Copyright 2012 Juniper Networks, Inc. www.juniper.net Elegance of design delivers lower OPEX and CAPEX
QUESTIONS ABOUT QFABRIC Deployment Migration Competition 45 Copyright 2012 Juniper Networks, Inc. www.juniper.net
SCALING QFABRIC M FABRIC QF/Director QF/Interconnect 8 nodes 384 ports QF/Node 46 Copyright 2012 Juniper Networks, Inc. www.juniper.net * 3:1 oversubscription
SCALING QFABRIC M FABRIC QF/Director QF/Interconnect 16 nodes 768 ports QF/Node 47 Copyright 2012 Juniper Networks, Inc. www.juniper.net * 3:1 oversubscription
SCALING QFABRIC G FABRIC QF/Director QF/Interconnect 64 nodes 3072 ports QF/Node 48 Copyright 2012 Juniper Networks, Inc. www.juniper.net * 3:1 oversubscription
SCALING QFABRIC G FABRIC QF/Director QF/Interconnect 128 nodes 6144 ports QF/Node 49 Copyright 2012 Juniper Networks, Inc. www.juniper.net * 3:1 oversubscription
CAN I STRETCH A QFABRIC? Data Center 1 Data Center 2 51 Copyright 2012 Juniper Networks, Inc. www.juniper.net
HOW DO I MIGRATE TO QFABRIC? QFabric QFX3500 Pod 1 4 Pod 2 52 Copyright 2012 Juniper Networks, Inc. www.juniper.net
3 TYPES OF FABRICS 1. Marketing Fabrics 2. Overlay Fabrics 3. Switch Fabrics 53 Copyright 2012 Juniper Networks, Inc. www.juniper.net
MARKETING FABRIC No incremental benefit 54 Copyright 2012 Juniper Networks, Inc. www.juniper.net
PROTOCOL OVERLAY FABRIC Spine Spanning Tree Leaf 55 Copyright 2012 Juniper Networks, Inc. www.juniper.net
PROTOCOL OVERLAY FABRIC Spine Leaf Benefits: Flatter topology Virtualizes locality Eliminates Spanning Tree TRILL or SPB L2 tunnels Challenges: Not flat - 3 network hops Each switch managed separately Increasing complexity limits scale 56 Copyright 2012 Juniper Networks, Inc. www.juniper.net
SWITCH FABRIC Benefits: Flat topology Faster, more predictable apps Virtualizes locality More elastic clouds Eliminates STP, TRILL, SPB Simpler (N=1) Better scaling More efficient (less hardware) Less power, space, cooling Less expensive Performance and Simplicity of a SINGLE Switch The Scale and Resiliency of a Network 57 Copyright 2012 Juniper Networks, Inc. www.juniper.net
WHAT IS NOW POSSIBLE 58 Copyright 2012 Juniper Networks, Inc. www.juniper.net
59 Copyright 2012 Juniper Networks, Inc. www.juniper.net
60 Copyright 2012 Juniper Networks, Inc. www.juniper.net
61 Copyright 2012 Juniper Networks, Inc. www.juniper.net
COFFEE BREAK DEMO AREA 63 Copyright 2012 Juniper Networks, Inc. www.juniper.net