IWAN Under the Hood - Next Gen Performance Routing and DMVPN. David Prall, Communication Architect CCIE 6508 (R&S/SP/Security)

Similar documents
PfRv3 Zero SLA Support

Intelligent WAN 2.0 Traffic Independent Design and Intelligent Path Selection

Návrh inteligentní WAN sítě

Implementing Next Generation Performance Routing PfRv3

Performance Routing Version 3 Configuration Guide

PfRv3 Inter-DC Optimization

PfRv3 Path of Last Resort

Intelligent WAN : CVU update

Intelligent WAN Multiple Data Center Deployment Guide

Intelligent WAN Multiple VRFs Deployment Guide

Cisco Intelligent WAN

Cisco recommends that you have basic knowledge of Performance Routing (PfR).

Intelligent WAN (IWAN) Design and Deployment

Chapter H through R. loss (PfR), page 28. load-balance, page 23 local (PfR), page 24 logging (PfR), page 26

Deploying Performance Routing

Help! BRKRST Cisco and/or its affiliates. All rights reserved. Cisco Public 2

IWAN APIC-EM Application Cisco Intelligent WAN

FlexVPN HA Dual Hub Configuration Example

Cisco IOS Performance Routing Version 3 Command Reference

Intelligent WAN High Availability and Scalability Deployment Guide

Performance Routing Version 3 Commands

ARCHIVED DOCUMENT. - The topics in the document are now covered by more recent content.

Intelligent WAN Design Summary

Intelligent WAN Deployment Guide

Cisco Service Advertisement Framework Deployment Guide

IWAN Intelligent WAN, Next Generation Branch Architecture. Lars Thoren Technical Marketing Engineer, ENG

Optimized Edge Routing Configuration Guide, Cisco IOS Release 15.1MT

Pressures on the WAN

DMVPN for R&S CCIE Candidates Johnny Bass CCIE #6458

Performance Routing (PfR) Master Controller Redundancy Configuration

WAN Edge MPLSoL2 Service

Deploying and Administering Cisco s Digital Network Architecture (DNA) and Intelligent WAN (IWAN) (DNADDC)

Cisco Performance Routing

Cloud Intelligent Network

GRE and DM VPNs. Understanding the GRE Modes Page CHAPTER

SD-WAN Deployment Guide (CVD)

IWAN Security for Remote Site Direct Internet Access and Guest Wireless

Configuring Basic Performance Routing

REFERENCE NETWORK ARCHITECTURE

Intelligent WAN. Technology Design Guide

Cisco recommends that you have basic knowledge of Performance Routing (PfR).

Setting Up OER Network Components

MPLS VPN over mgre. Finding Feature Information. Last Updated: November 1, 2012

Cisco Dynamic Multipoint VPN: Simple and Secure Branch-to-Branch Communications

Performance Routing Configuration Guide, Cisco IOS Release 15M&T

CVP Enterprise Cisco SD-WAN Retail Profile (Hybrid WAN, Segmentation, Zone-Based Firewall, Quality of Service, and Centralized Policies)

IWAN AVC/QoS Design. Kelly Fleshner, Communications Architect. CCIE # years BRKRST-2043

DMVPN for R&S CCIE Candidates

Network Automation and Branch Agility The Network Helps Enable Digital Business. Rajinder Singh Product Sales Specialist June 2016

Cisco Dynamic Multipoint VPN: Simple and Secure Branch-to-Branch Communications

BGP Inbound Optimization Using Performance Routing

MPLS VPN Inter-AS Option AB

Migrating Your Existing WAN to Cisco s IWAN

MPLS VPN--Inter-AS Option AB

MPLS VPN Carrier Supporting Carrier Using LDP and an IGP

Connecting to a Service Provider Using External BGP

MPLS VPN Carrier Supporting Carrier Using LDP and an IGP

Interchassis Asymmetric Routing Support for Zone-Based Firewall and NAT

Cisco Group Encrypted Transport VPN

VeloCloud Cloud-Delivered WAN Fast. Simple. Secure. KUHN CONSULTING GmbH

Enterprise SD-WAN Financial Profile (Hybrid WAN, Segmentation, Quality of Service, Centralized Policies)

IPv6 Switching: Provider Edge Router over MPLS

Shortcut Switching Enhancements for NHRP in DMVPN Networks

Configuring FlexVPN Spoke to Spoke

COURSE OUTLINE: Course: CCNP Route Duration: 40 Hours

Intelligent WAN Remote Site 4G LTE Deployment Guide

DNA SA Border Node Support

LiveAction IWAN Management

Advanced Concepts of DMVPN (Dynamic Multipoint VPN)

VRF, MPLS and MP-BGP Fundamentals

IPv6 Switching: Provider Edge Router over MPLS

Enterprise. Nexus 1000V. L2/L3 Fabric WAN/PE. Customer VRF. MPLS Backbone. Service Provider Data Center-1 Customer VRF WAN/PE OTV OTV.

Exam Questions Demo Cisco. Exam Questions CCIE SP CCIE Service Provider Written Exam

Cisco SD-WAN (Viptela) Migration, QoS and Advanced Policies Hands-on Lab

Cisco SD-WAN and DNA-C

CCIE Routing & Switching

Performing Path Traces

Adaptive QoS over DMVPN

Securizarea Calculatoarelor și a Rețelelor 32. Tehnologia MPLS VPN

CCIE R&S LAB CFG H2/A5 (Jacob s & Jameson s)

VPN WAN. Technology Design Guide

CCNA Routing and Switching Study Guide Chapters 7 & 21: Wide Area Networks

LABRST-2099 iwan Deployment using NSO

Cisco Virtual Office High-Scalability Design

Implementing MPLS VPNs over IP Tunnels

Monitoring MPLS Services

Add Path Support in EIGRP

MPLS VPN Explicit Null Label Support with BGP. BGP IPv4 Label Session

Managing Site-to-Site VPNs: The Basics

Implementing Cisco IP Routing (ROUTE)

Migrating from Dynamic Multipoint VPN Phase 2 to Phase 3: Why and How to Migrate to the Next Phase

Remote Access MPLS-VPNs

MPLS VPN Multipath Support for Inter-AS VPNs

MPLS VPN Carrier Supporting Carrier IPv4 BGP Label Distribution

ibgp Multipath Load Sharing

Technology Overview. Overview CHAPTER

Flexible Dynamic Mesh VPN draft-detienne-dmvpn-00

Managing Site-to-Site VPNs: The Basics

Highly Available Wide Area Network Design

BGP Link Bandwidth. Finding Feature Information. Prerequisites for BGP Link Bandwidth

Transcription:

IWAN Under the Hood - Next Gen Performance Routing and DMVPN David Prall, Communication Architect CCIE 6508 (R&S/SP/Security) dprall@cisco.com

Agenda Introduction Intelligent Path Control PfRv3 Operations Deployment Considerations Troubleshooting Key Takeaways

Intelligent Path Control Performance Routing v3

Intelligent WAN Solution Components Unified Branch MPLS 3G/4G-LTE Private Cloud Virtual Private Cloud Internet Public Cloud Management Automation Transport Independent Intelligent Path Control Application Optimisation Secure Connectivity Simplified Application Enhanced Application Comprehensive Hybrid WAN Aware Routing Visibility and Performance Threat Defence

Hybrid WAN: Intelligent Path Control Leveraging the Internet Voice/Video/Critical take the best delay, jitter, and/or loss path MPLS Private Cloud Branch Other traffic is load balanced to maximise bandwidth Internet PfR monitors network performance and routes applications based on application performance policies PfR load balances traffic based upon link utilisation levels to efficiently utilise all available WAN bandwidth Virtual Private Cloud Voice/Video/Critical will be rerouted if the current path degrades below policy thresholds

How PfR Works Key Operations MC Traffic Classes BR Learning Active TCs BR MC MC BR Performance Measurements BR MC Best Path BR BR MC+BR MC+BR MC+BR MC+BR MC+BR MC+BR MC+BR MC+BR MC+BR MC+BR BR MC+BR Define Your Traffic Policy Learn the Traffic Measurement Path Enforcement Define Traffic Classes and service level Policies based on Applications or DSCP Border Routers learn current traffic classes going to the WAN based on classifier definitions Measure the traffic flow and network performance and report metrics to the Master Controller Master Controller commands path changes based on traffic class policy definitions

IOS-XE 3.15 IOS 15.5(2)T Advanced Topology IWAN POP1 DC1 DCI WAN Core DC2 IWAN POP2 R10 R10 R11 R12 R13 R14 R21 R22 R23 R24 10.2.0.0/16 10.0.0.0/8 Support for multiple BRs per cloud Horizontal scaling Support for Multiple POPs Different Prefix Common Prefix DMVPN MPLS DMVPN INET R31 R41 R51 R52 10.3.3.0/24 10.4.4.0/24 10.5.5.0/24 10.2.0.0/16 10.0.0.0/8

PfRv3 Operations

IWAN Solution Components PfR path selection policies AVC/QoS PfR intelligent routing AVC/QoS Overlay routing over tunnels Overlay tunnels - DMVPN Transport routing Perimeter Security Internet Routing Perimeter Security MPLS-VPN Routing IWAN Layered Solution leveraging point to multipoint WAN connections with secure tunnel overlay architecture and intelligent policy routing to provide cost optimisation and dynamic load balancing

IWAN Domain DMVPN IWAN Prescriptive Design Transport Independent Design based on DMVPN Branch spoke sites establish an IPsec tunnel to and register with the hub site Data traffic flows over the DMVPN tunnels WAN interface IP address used for the tunnel source address (in a Front-door VRF) One tunnel per user inside VRF Overlay Routing BGP or EIGRP are typically used for scalability IP routing exchanges prefix information for each site Per-tunnel QOS is applied to prevent hub site oversubscription to spoke sites IWAN POP1 R10 R11 R12 R21 R22 R31 ATBT MPLS R41 DCI WAN Core ISLAND INET R51 IWAN POP2 10.3.3.0/24 10.4.4.0/24 10.5.5.0/24 R20 R52

Which Routing Protocol Should I Use? IWAN Profiles are based upon ibgp and EIGRP for scalability and optimal Intelligent Path Control Intelligent Path Control: PfR can be used with any routing protocols by relying on the routing table (RIB). Requires all valid WAN paths be ECMP so that each valid path is in the RIB. For BGP and EIGRP, PfR can look into protocol s topology information to determine both best paths and secondary paths thus, ECMP is not required. PfRv3 always checks for a parent route before being able to control a Traffic Class. Parent route check is done as follows: Check to see if there is an NHRP shortcut route If not Check in the order of BGP, EIGRP, Static and RIB Make sure that all Border Routers have a route over each external path to the destination sites, PfR will NOT be able to effectively control traffic otherwise.

Performance Monitoring Passive Monitoring SITE1 CPE1 2 MPLS 3 3 CPE12 CPE11 SITE2 Dual CPE CPE2 2 INET CPE10 SITE3 Single CPE Bandwidth on egress Per Traffic Class (dest-prefix, DSCP, AppName) Performance Monitor Collect Performance Metrics Per Channel - Per DSCP - Per Source and Destination Site - Per Interface

Performance Monitoring Smart Probing SITE1 CPE1 2 MPLS 3 3 CPE12 CPE11 SITE2 Dual CPE CPE2 INET CPE10 SITE3 Single CPE Integrated Smart Probes Traffic driven intelligent on/off Site to site and per DSCP Performance Monitor Collect Performance Metrics Per Channel - Per DSCP - Per Source and Destination Site - Per Interface

PfR Components The Decision Maker: Master Controller (MC) Apply policy, verification, reporting No packet forwarding/ inspection required Standalone of combined with a BR VRF Aware IPv4 only (IPv6 Future) The Forwarding Path: Border Router (BR) Gain network visibility in forwarding path (Learn, measure) Enforce MC s decision (path enforcement) VRF aware IPv4 only (IPv6 Future) Central Sites Branch Sites MC1 BR1 MC/BR MC/BR BR2 Branch Sites BR

IWAN Domain Collection of sites that share the same set of policies An IWAN domain includes: A mandatory Hub site, Optional Transit sites, As well as Branch sites. Each site has a unique identifier (Site-Id) Derived from the loopback address of the local MC Central and headquarter sites play a significant role in PfR and are called an IWAN Point of Presence (POP). Each of these sites will have a unique identifier called a POP-ID Each site runs PfR and gets its path control configuration and policies from the logical IWAN domain controller through the IWAN Peering Service R10 R11 R12 R21 R22 R31 R41 R51 R52 Site ID 10.3.0.31 DC-East Site ID 10.1.0.10 PATH1 Site ID 10.4.0.41 DCI WAN Core PATH2 DC-West Site ID 10.2.0.20 Site ID 10.5.0.51 R20

IWAN Sites Hub Site Located in an enterprise central site or headquarter location. Can act as a transit site to access servers in the datacentres or for spoke-to-spoke traffic Only one Hub site exists per IWAN domain The logical domain controller functionality resides on this site s master controller (Hub MC). Transit Site Located in an enterprise central site or headquarter location. Can act as a Transit site The local MC peers with the Hub MC Branch Site DMVPN spoke, and are a stub site where traffic transit is not allowed. The local MC peers with the Hub MC

Hub Site One central site is assigned the role of Hub Site Each central site is allocated a unique POP- ID in the entire domain. POP-ID = 0 for the Hub Site The MC is assigned the Domain Controller (DC) role DC + MC = Hub Master Controller Central point of provisioning for PfR policies Listen for incoming peering request BRs are Hub BRs Peer with the local MC HUB SITE Site ID = 10.1.0.10 R10 POP-ID 0 R20 10.2.0.0/16 R11 R12 R21 R22 R31 DMVPN MPLS R41 DMVPN INET R51 R52 10.3.3.0/24 10.4.4.0/24 10.5.5.0/24

R10 PfR Deployment Hub domain IWAN vrf default master hub source-interface Loopback0 enterprise-prefix prefix-list ENTERPRISE_PREFIX site-prefixes prefix-list SITE1_PREFIX Policies Monitors HUB SITE Site ID = 10.1.0.10 R10 POP-ID 0 R11 domain IWAN vrf default border master 10.1.0.10 source-interface Loopback0! interface Tunnel100 description -- Primary Path -- domain IWAN path MPLS path-id 1 Site Prefix: static definition of prefixes for a site MANDATORY Path MPLS Id 1 R11 R12 Path INET Id 2 1 2 3 R12 domain IWAN vrf default border master 10.1.0.10 source-interface Loopback0! interface Tunnel200 description Secondary Path -- domain IWAN path INET path-id 2 Performance Monitors instances (PMI) Monitor1 Site Prefix Learning (egress direction) Monitor2 Aggregate Bandwidth per Traffic Class (egress direction) Monitor3 Performance measurements (ingress direction)

Enterprise Prefix List The main use of the enterprise prefix list is to determine the enterprise boundary. With enterprise-prefix If a prefix doesn't match any site-prefix but matches enterprise-prefix then the prefix belongs to a site that is not participating in PfRv3 but it does belong to the enterprise. PfR will not influence traffic towards sites that have NOT enabled PFR. Without enterprise-prefix All the traffic that would be going towards a spoke that is NOT PfR enabled will be learnt as internet traffic class and therefore subjected to load balancing. domain IWAN vrf default master hub source-interface Loopback0 enterprise-prefix prefix-list ENTERPRISE_PREFIX! ip prefix-list ENTERPRISE_PREFIX seq 10 permit 10.0.0.0/8

Redundant MC Anycast IP What happens when a MC fails? Traffic forwarded based on routing information IE: no drop What happens when the Hub MC fails? Branch MCs keep their configuration and policies Continue to optimise traffic A backup MC can be defined on the hub. Using the same IP address as the primary Routing Protocol is used to make sure BRs and branch MC connect to the primary Stateless redundancy Backup MC will re-learn the traffic R10 Hub MC 10.1.0.10/32 R11 DMVPN MPLS HUB SITE R100 Backup Hub MC 10.1.0.10/31 R12 DMVPN INET R31 R41 R51 R52

Transit Site Introduce Transit Site" concept for the 2nd Central site Up to 63 in theory Each POP is allocated a unique POP-ID in the entire domain POP-ID configured Transit MC Behaves like a Hub MC without provisioning Peers with the Hub MC Transit BRs Similar as a Hub BR Peer with the local MC HUB SITE Site ID = 10.1.0.10 R10 TRANSIT SITE Site ID = 10.2.0.20 R20 10.2.0.0/16 R11 R12 R21 R22 R31 DMVPN MPLS R41 DMVPN INET R51 POP-ID 1 10.3.3.0/24 10.4.4.0/24 10.5.5.0/24 IOS-XE 3.15 IOS 15.5(2)T R52

R20 PfR Deployment Transit Site domain IWAN vrf default master transit 1 source-interface Loopback0 site-prefixes prefix-list SITE2_PREFIX hub 10.1.0.10 TRANSIT SITE Site ID = 10.2.0.20 R20 POP-ID 1 10.2.0.0/16 R21 domain IWAN vrf default border master 10.2.0.20 source-interface Loopback0! interface Tunnel100 description -- Primary Path -- domain IWAN path MPLS path-id 1 R22 domain IWAN vrf default border master 10.2.0.20 source-interface Loopback0! interface Tunnel200 description Secondary Path -- domain IWAN path INET path-id 2 Site Prefix: static definition of prefixes for a site MANDATORY Path MPLS Id 1 R21 Performance Monitors instances (PMI) 2 3 Monitor1 Site Prefix Learning (egress direction) 1 R22 Path INET Id 2 Monitor2 Aggregate Bandwidth per Traffic Class (egress direction) Monitor3 Performance measurements (ingress direction)

Branch Sites Hub MC listening for incoming requests Branch MC connects to Hub MC Service Exchange Timers Policies and Monitor configurations Site Prefixes MC Peering HUB SITE Site ID = 10.1.0.10 R10 TRANSIT SITE Site ID = 10.2.0.20 R20 10.2.0.0/16 R11 R12 R21 R22 DMVPN MPLS DMVPN INET BRANCH SITE Site3 Site ID = 10.3.0.31 R31 R41 R51 R52 10.3.3.0/24 10.4.4.0/24 10.5.5.0/24

PfR Deployment Single CPE Branch HUB SITE Site ID = 10.1.0.10 TRANSIT SITE Site ID = 10.2.0.20 R31 R41 domain IWAN vrf default master branch source-interface Loopback0 hub 10.8.3.3 border master local source-interface Loopback0 R10 R20 10.2.0.0/16 R11 R12 R21 R22 DMVPN MPLS DMVPN INET Single CPE Branch Sites Branch MCs connect to the Hub R31 R41 R51 R52 10.3.3.0/24 10.4.4.0/24 10.5.5.0/24

PfR Deployment Dual CPE Branch R51 domain IWAN vrf default master branch source-interface Loopback0 hub 10.8.3.3 border master local source-interface Loopback0 HUB SITE Site ID = 10.1.0.10 R10 TRANSIT SITE Site ID = 10.2.0.20 R20 10.2.0.0/16 R11 R12 R21 R22 R52 domain IWAN vrf default border master 10.2.12.12 source-interface Loopback0 DMVPN MPLS DMVPN INET Dual CPE Branch Sites Branch MCs connect to the Hub BRs directly connected (mandatory) R31 R41 R51 R52 10.3.3.0/24 10.4.4.0/24 10.5.5.0/24

Automatic Interface Discovery Transit BRs have path names manually defined, ie MPLS and INET Transit BRs send Discovery Packet with path names from to all discovered sites Discovery probes generated from the Hub/Transit Border Routers R10 MPLS Path-Id 1 HUB SITE Site ID = 10.1.0.10 R20 R11 R12 R21 R22 INET Path-ID 2 MPLS Path-ID 1 TRANSIT SITE Site ID = 10.2.0.20 INET Path-Id 2 DMVPN MPLS DMVPN INET WAN Path is detected on the branch - Path Name - Path Id - DSCP R31 R41 R51 R52 10.3.3.0/24 10.4.4.0/24 10.5.5.0/24

WAN Interface Performance Monitors Apply 3 Performance Monitors instances (PMI) over external interfaces Monitor1 Site Prefix Learning (egress direction) Monitor2 Aggregate Bandwidth per Traffic Class (egress direction) Monitor3 Performance measurements (ingress direction) 1 2 3 1 2 3 R31

Site Prefix Discovery HUB SITE Site ID = 10.1.0.10 Every MC in the domain owns a Site Prefix database Gives the mapping between site and prefixes 2 options: Static Automatic Learning R10 R11 MPLS R12 INET R31 R41 R51 R52 10.3.3.0/24 10.4.4.0/24 10.5.5.0/24

Site Prefix Discovery HUB SITE Site ID = 10.1.0.10 Source Prefix and Mask collected from Performance Monitor R10 SAF - Site 3 Monitor interval is 30 sec 10.3.3.0/24 R11 R12 BR send to its local MC MC send information to all peers via Peering MPLS INET Source Destination DSCP App 10.1.10.200 10.8.1.200 AF41 AppXY SAF - Site 3 10.3.3.0/24 SAF - Site 3 SAF- Site 3 1 10.3.3.0/24 10.3.3.0/24 1 R31 R41 R51 R52 R10 MC Site-Pfx Mask 10.3.3.0 /24 10.3.3.0/24 10.4.4.0/24 10.5.5.0/24

Site Prefix Discovery HUB SITE Site ID = 10.1.0.10 TRANSIT SITE Site ID = 10.2.0.10 R10 R20 10.2.0.0/16 Site Prefix List Site1 Site2 10.2.0.0/16 Site3 10.3.3.0/24 Site4 10.4.4.0/24 Site5 10.5.5.0/24 R11 R12 R21 R22 DMVPN MPLS DMVPN INET R31 R41 R51 R52 10.3.3.0/24 10.4.4.0/24 10.5.5.0/24

Site Prefixes Static Configuration This allows configuring site-prefix manually instead of learning. This configuration should be used at the site if the site is used for transit. For example, Site A reaches Site B via Hub-Site, where Hub-Site is transit site. The configuration is used to prevent learning of Site A prefix as Hub-Site prefix when it is transiting from Hub. MC1 Hub MC 10.8.3.3/32 BR1 IWAN POP1 BR2 domain IWAN vrf default master hub source-interface Loopback0 site-prefixes prefix-list DC1_PREFIX! ip prefix-list DC1_PREFIX seq 10 permit 10.8.0.0/16! Source Destination DSCP App 10.1.10.200 10.1.11.200 AF41 AppXY

Define PfR Traffic Policies CLASS MATCH ADMIN PERFORMANCE Define your Traffic Policy Identify Traffic Classes based on Application or DSCP Performance thresholds (loss, delay and Jitter), Preferred Path Centralised on a Domain Controller Voice Interactive Video Critical Data DSCP Application DSCP Application DSCP Application Preferred: MPLS Fallback: INET Next Fallback: 4G Preferred: MPLS Fallback: INET Preferred: MPLS Fallback: INET Delay threshold Loss threshold Jitter threshold Delay threshold Loss threshold Jitter threshold Delay threshold Loss threshold Jitter threshold Best Effort DSCP Application - Delay threshold Loss threshold Jitter threshold

IWAN Policies DSCP or App Based domain IWAN vrf default master hub load-balance class MEDIA sequence 10 match application <APP-NAME1> policy real-time-video match application <APP-NAME2> policy custom priority 1 one-way-delay threshold 200 priority 2 loss threshold 1 path-preference MPLS fallback INET class VOICE sequence 20 match dscp <DSCP-VALUE> policy voice path-preference MPLS fallback INET class CRITICAL sequence 30 match dscp af31 policy low-latency-data Policies: DSCP or Application Based Policies (NBAR2) DSCP marking can be used with NBAR2 on the LAN interface (ingress on BR) Default Class is load balanced Custom thresholds Pre-defined thresholds R10

Built-in Policy Templates Pre-defined Template Threshold Definition Voice priority 1 one-way-delay threshold 150 threshold 150 (msec) priority 2 packet-loss-rate threshold 1 (%) priority 2 byte-loss-rate threshold 1 (%) priority 3 jitter 30 (msec) Real-time-video priority 1 packet-loss-rate threshold 1 (%) priority 1 byte-loss-rate threshold 1 (%) Low-latency-data priority 2 one-way-delay threshold 150 (msec) priority 3 jitter 20 (msec) priority 1 one-way-delay threshold 100 (msec) priority 2 byte-loss-rate threshold 5 (%) priority 2 packet-loss-rate threshold 5 (%) Predefined Template Bulk-data Best-effort scavenger Threshold Definition priority 1 one-way-delay threshold 300 (msec) priority 2 byte-loss-rate threshold 5 (%) priority 2 packet-loss-rate threshold 5 (%) priority 1 one-way-delay threshold 500 (msec) priority 2 byte-loss-rate threshold 10 (%) priority 2 packet-loss-rate threshold 10 (%) priority 1 one-way-delay threshold 500 (msec) priority 2 byte-loss-rate threshold 50 (%) priority 2 packet-loss-rate threshold 50 (%)

PfRv3 works on Traffic Class DSCP Based DSCP Based Policies Prefix DSCP AppID Dest Site Next- Hop 10.3.3.0/24 EF N/A Site 3? 10.3.3.0/24 AF41 N/A Site 3? 10.3.3.0/24 AF31 N/A Site 3? 10.3.3.0/24 0 N/A Site 3? 10.4.4.0/24 EF N/A Site 4? 10.4.4.0/24 AF41 N/A Site 4? 10.4.4.0/24 AF31 N/A Site 4? 10.4.4.0/24 0 N/A Site 4? 10.5.5.0/24 EF N/A Site 5? 10.5.5.0/24 AF41 N/A Site 5? 10.5.5.0/24 AF31 N/A Site 5? 10.5.5.0/24 0 N/A Site 5? HUB SITE Site ID = 10.1.0.10 R10 TRANSIT SITE Site ID = 10.2.0.20 R20 10.2.0.0/16 R11 R12 R21 R22 DMVPN MPLS DMVPN INET Traffic with EF, AF41, AF31 and 0 Traffic Class Destination Prefix DSCP Value Application (N/A when DSCP policies used) R31 R41 R51 R52 10.3.3.0/24 10.4.4.0/24 10.5.5.0/24

PfRv3 works on Traffic Class Application Based Application based Policies Prefix DSCP AppID Dest Site Next-Hop 10.3.3.0/24 EF N/A Site 3? 10.3.3.0/24 AF41 App1 Site 3? 10.3.3.0/24 AF41 App2 Site 3? 10.3.3.0/24 AF41 N/A Site 3? 10.3.3.0/24 AF31 N/A Site 3? 10.3.3.0/24 0 N/A Site 3? 10.4.4.0/24 EF N/A Site 4? 10.4.4.0/24 AF41 App1 Site 4? 10.4.4.0/24 AF31 N/A Site 4? 10.4.4.0/24 0 N/A Site 4? 10.5.5.0/24 EF N/A Site 5? 10.5.5.0/24 AF41 App2 Site 5? 10.5.5.0/24 AF31 N/A Site 5? 10.5.5.0/24 0 N/A Site 5? Traffic with EF, AF41, AF31 and 0 App1, App2, etc Traffic Class Destination Prefix DSCP Value Application (N/A when DSCP policies used) HUB SITE Site ID = 10.1.0.10 R10 TRANSIT SITE Site ID = 10.2.0.20 R11 R12 R21 R22 R31 R20 10.2.0.0/16 DMVPN MPLS R41 DMVPN INET R51 10.3.3.0/24 10.4.4.0/24 10.5.5.0/24 R52

Channels from Branch to Central Sites IWAN POP MC1 Hub MC 10.1.0.10/32 Present Channel 10 Site 1 MPLS Path 1 DSCP AF41 Present Channel 11 Site 1 MPLS Path 2 DSCP AF41 BR1 MPLS BR2 BR3 INET Backup Channel 12 Site 1 INET Path 3 DSCP AF41 R10 R11 R12 R13 10.3.3.0/24 10.4.4.0/24 10.5.5.0/24

Channel Between Branch Sites MC1 Hub MC 10.1.0.10/32 BR1 IWAN POP BR2 Between Any Pair of Sites that has traffic! Present Channel 13 Site 4 MPLS DSCP EF MPLS INET Backup Channel 14 Site 4 INET DSCP EF R31 R41 R51 R52 10.3.3.0/24 10.4.4.0/24 10.5.5.0/24

Channel Monitoring performance per channel Channel per destination site, DSCP, Path Name and Path Id Destination Prefix from Site Prefix database Include all sites advertising that prefix Load balance may be done between POPs if prefix is shared between multiple transit sites Track individual BR performance on the hub A PfR-label uniquely identify a path between sites across clouds (embedded in GRE encapsulation) POP-ID PATH-ID POP-ID PATH-ID R10 Path MPLS Id 1 10.2.0.0/16 HUB SITE Site ID = 10.1.0.10 R11 R12 R21 R22 R31 10.3.3.0/16 Path INET Id 2 DMVPN MPLS 10.2.0.0/16 TRANSIT SITE Site ID = 10.2.0.20 R20 Path MPLS Id 1 DMVPN INET IOS-XE 3.15 IOS 15.5(2)T Path INET Id 2 10.2.0.0/16

TC to Channel Mapping Channel created for each destination site, path name, next-hop (path identifier) and DSCP. Destination Prefix announced by destination site TC => Destination Prefix, DSCP => Mapped to the corresponding Channel R31-Site3-Spoke#sh domain IWAN master channel dscp ef Channel Id: 53 Dst Site-Id: 10.1.0.10 Link Name: MPLS DSCP: ef [46] pfr-label: 0:1 0:0 [0x10000] TCs: 1 Channel Created: 3w5d ago Provisional R31-Site3-Spoke#sh State: Initiated and domain open IWAN master channel dscp ef Operational state: Available Channel to hub: Channel TRUE Id: 57 Dst Site-Id: 10.1.0.10 Link Name: INET DSCP: ef [46] pfr-label: 0:2 0:0 [0x20000] TCs: Site Prefix 0 List 10.1.0.10/32 Channel (Routable) Created: 3w5d ago Provisional (Active) State: Initiated and open 10.2.0.0/16 Operational (Routable) state: Available Channel to hub: TRUE Site Prefix List 10.1.0.10/32 (Routable) (Active) 10.2.0.0/16 (Routable)

Destination Site: Collecting Performance Metrics Smart Probes Without actual traffic 20 pps for channel without traffic IOS-XE: BR sends 10 probes spaced 20ms apart in the first 500ms and another similar 10 probes in the next 500ms IOS: BR sends one packet every 50ms With actual traffic Lower frequency when real traffic is observed over the channel Probes sent every 1/3 of [Monitor Interval], ie every 10 sec by default Measured by Performance Monitor just like other data traffic

Performance Violation Performance notification exported ONLY when there is a violation on a specific channel Generated from ingress monitor attached on destination BRs to the source site MC Based on Monitor interval (30 sec default, configurable) Via all available external interfaces. R31 TCA Delay DSCP AF41 Path MPLS HUB SITE Site ID = 10.1.0.10 R10 TRANSIT SITE Site ID = 10.2.0.10 R20 10.2.0.0/16 R11 R12 R21 R22 DMVPN MPLS DMVPN INET R31 R41 R51 R52 10.3.3.0/24 10.4.4.0/24 10.5.5.0/24

Policy Decision and Path Enforcement Search MC database for TC to site R31 with DSCP EF going over path MPLS Auto Tunnel between Border Routers Option1: next hop is local to the BR Option2: next hop is another BR, forward through the auto-tunnel (GRE encap used) R10 Flow Auto-tunnel mgre interface Option2 HUB SITE Site ID = 10.1.0.10 R11 R12 Option1 MPLS INET

Deployment Considerations

IWAN 2.0 Hub/Transit MC Scaling ASR 1002-X 2000 sites ASR 1001-X 1000 sites ISR 4431 50 sites ISR 4451 200 sites CSR1000v 1 vcpu 200 sites CSR1000v 2 vcpu 500 sites

IWAN Application Policies NBAR2: Asymmetric routing issue Some applications require DPI to see both sides of the flow Inherent to all DPI engines Workaround HSRP Master PBR statement on the return path R10 HUB SITE Site ID = 10.8.3.3 TRANSIT SITE Site ID = 10.9.3.3 R20 R11 R12 R21 R22 DMVPN MPLS DMVPN INET R51 R52

Unreachable Timer HUB SITE Site ID = 10.1.0.10 TRANSIT SITE Site ID = 10.2.0.20 Channel Unreachable PfRv3 considers a channel reachable as long as the site receives a PACKET on that channel A channel is declared unreachable in both directions if There is NO traffic on the Channel, probes are the only way of detecting unreachability. So if no probe is received within 1 sec, PfR detects unreachability. When there IS traffic on the channel, if PfR does not see any packet for more than a second on a channel PfR detects unreachability. Default: 1 Sec Recommended: 4 sec Advanced options with 3.16 15.5(3)S / 15.5(3)M channel-unreachable-timer 4 R10 Path MPLS Id 1 R11 R12 R21 R22 Path INET Id 2 DMVPN MPLS R31 10.3.3.0/24 R20 Path MPLS Id 1 DMVPN INET Path INET Id 2

Failover Time HUB SITE Site ID = 10.1.0.10 TRANSIT SITE Site ID = 10.2.0.20 Ingress Performance Violation detected Delay, loss or jitter thresholds Based on Monitor-interval Default 30 Seconds Single Fast Monitor Interval Configurable domain IWAN vrf default master hub monitor-interval 4 dscp ef monitor-interval 4 dscp af41 monitor-interval 4 dscp cs4 monitor-interval 4 dscp af31 R10 Path MPLS Id 1 R20 R11 R12 R21 R22 Path INET Id 2 DMVPN MPLS R31 10.3.3.0/24 Path MPLS Id 1 DMVPN INET Path INET Id 2

Load Balancing Current Situation - Load balancing works on physical links - Load sharing on NH on the same DMVPN network (XE 3.16.1 and IOS 15.5(3)M1) : - between R11 and R21 - Between R12 and R22 Default Classes TCs - Load balancing at any time (not only at creation time). - TC will be moved to ensure bandwidth on all links is within the defined range Performance TCs - Initial load-balancing while placing the TCs, on a per TC basis. PfR does not account for the TCs getting fatter. R10 Path MPLS Id 1 10.2.0.0/16 HUB SITE Site ID = 10.1.0.10 R11 R12 R21 R22 Path INET Id 2 MPLS R31 TRANSIT SITE Site ID = 10.2.0.20 R20 Path MPLS Id 1 INET Path INET Id 2 10.2.0.0/16

Path Selection Direction from POPs to Spokes Each POP is a unique site by itself and so it will only control traffic towards the spoke on the WAN s that belong to that POP. PfRv3 will NOT be redirecting traffic between POP across the DCI or WAN Core. If it is required that all the links are considered from POP to spoke, then the customer will need to use a single MC. Only one next hop (on branch) per DMVPN network No PfR control between Transit Sites R10 Path MPLS Id 1 HUB SITE Site ID = 10.1.0.10 Hub MC POP-ID 0 R20 R11 R12 R21 R22 Path INET Id 2 DMVPN MPLS R31 10.3.3.0/24 Path MPLS Id 1 TRANSIT SITE Site ID = 10.2.0.20 DMVPN INET Transit MC POP-ID 1 Path INET Id 2

Path Selection Direction from Spokes to POPs The spoke considers all the paths (multiple NH s) towards the POPs The concept of "active" and "standby" next hops based on routing metrics and advertised mask length in routing is used to gather information about the preferred POP for a given prefix. Example: If the best metric for a given prefix is on DC1 then all the next hops on that DC for all the ISPs are tagged as active (only for that prefix). R10 Path MPLS Id 1 DC1 Site ID = 10.1.0.10 R20 R11 R12 R21 R22 Path INET Id 2 DMVPN MPLS R31 10.3.3.0/24 Path MPLS Id 1 DC2 Site ID = 10.2.0.20 10.1.0.0/24 10.1.0.0/24 DMVPN INET Path INET Id 2 LP 100000 LP 20000 LP 3000 LP 400

Next Hop Status for Prefix Active next hop: A next hop is considered active if it is located at the POP site which has the next hop with the best routing metric for a given prefix Standby next hop: A next hop is considered standby if it is located at the POP site which advertises a route for prefix but does not have any next hop with best metric. Routable* next hop: A next hop is considered routable for a given prefix if it advertises one or more routes for the prefix and it was not a candidate channel for any traffic class Unreachable next hop: A next hop is considered unreachable for a given prefix if it is down or does not advertise any route for the prefix The sorting for active/standby considers all the channels/next hops on all WAN interfaces which are Routable. Note: Routable is a new status visible starting from XE 3.16.1/15.5(3)M1. On the border prior to XE 3.16.1/15.5(3)M1 active, standby and unreachable were supported.

PfRv3 Routing Definitions Best Metric A next hop in a given list is considered to have a best metric based on following metrics/criteria: Advertised mask length ( ) BGP: Weight( ), Local-Preference ( ) EIGRP : FD ( ), Successor FD ( ) Mask length takes precedence. Only if advertised mask lengths are equal, the protocol specific metrics are used.

Channels DC1 Site ID = 10.1.0.10 DC2 Site ID = 10.2.0.20 Channel to all next-hops, per DSCP Depending on the routing prefix advertisements, metrics and PfR Site Prefix List, destination-prefix will be active/standby/routable R10 R11 R12 R21 R22 Path MPLS Id 1 Path INET Id 2 R20 Path MPLS Id 1 Path INET Id 2 CHANNEL PATH NEXT HOPS PREFIX STATUS 1 MPLS R11? 2 INET R12? 3 MPLS R21? 4 INET R22? Ch1 Ch2 Ch3 Ch4 R31 10.3.3.0/24

Use Case #1 Separate Prefix BGP Site1 advertises and 10.0.0.0/8 Site2 advertises 10.2.0.0/16 and 10.0.0.0/8 R10 SITE1 PfR Site-Prefix R20 SITE2 PfR Site-Prefix 10.2.0.0/16 10.2.0.0/16 PfR: Site1 Site-Prefix: Site2 Site-Prefix: 10.2.0.0/16 BGP R11 Path MPLS Id 1 R12 R21 R22 Path INET Id 2 Path MPLS Id 1 Path INET Id 2 BGP CHANNEL PATH NEXT HOP PREFIX STATUS 1 MPLS R11 Active 10.0.0.0/8 Ch1 Ch2 Ch3 Ch4 10.2.0.0/16 10.0.0.0/8 2 INET R12 Active 3 MPLS R21 10.2.0.0/16 Active 4 INET R22 10.2.0.0/16 Active R31 10.3.3.0/24

Path Selection SITE1 PfR Site-Prefix SITE2 PfR Site-Prefix 10.2.0.0/16 R10 R20 10.2.0.0/16 BGP R11 R12 R21 R22 BGP 10.0.0.0/8 10.2.0.0/16 10.0.0.0/8 R31 PfR View PREFIX PATH PREFERENCE NEXT-HOPS ORDER Status DMVPN MPLS DMVPN INET MPLS Preferred INET Fallback R11 R12 Active Active No Preference R11, R12 Active R31 10.3.3.0/24

Channels Site1 R31-Site3-Spoke#show domain IWAN master channel dscp ef Channel Id: 5 Dst Site-Id: 10.1.0.10 Link Name: MPLS DSCP: ef [46] pfr-label: 0:1 0:0 [0x10000] TCs: 1 Channel Created: 00:03:56 ago Provisional State: Initiated and open Operational state: Available Channel to hub: TRUE Site Prefix List 10.1.0.10/32 (Routable) (Active) Label 0:1 POP 0 Path-ID 1 R11 Channel Id: 6 Dst Site-Id: 10.1.0.10 Link Name: INET DSCP: ef [46] pfr-label: 0:2 0:0 [0x20000] TCs: 0 Channel Created: 00:03:56 ago Provisional State: Initiated and open Operational state: Available Channel to hub: TRUE Site Prefix List 10.1.0.10/32 (Routable) (Active) Label 0:2 POP 0 Path-ID 2 R12 [Output omitted for brevity]

Channels Site2 R31-Site3-Spoke#show domain IWAN master channel dscp ef Channel Id: 15 Dst Site-Id: 10.2.0.20 Link Name: MPLS DSCP: ef [46] pfr-label: 1:1 0:0 [0x1010000] TCs: 1 Channel Created: 00:02:26 ago Provisional State: Initiated and open Operational state: Available Channel to hub: TRUE Site Prefix List 10.2.0.20/32 (Routable) 10.2.0.0/16 (Active) Label 1:1 POP 1 Path-ID 1 R21 Channel Id: 16 Dst Site-Id: 10.2.0.20 Link Name: INET DSCP: ef [46] pfr-label: 1:2 0:0 [0x1020000] TCs: 0 Channel Created: 00:02:26 ago Provisional State: Initiated and open Operational state: Available Channel to hub: TRUE Site Prefix List 10.2.0.20/32 (Routable) 10.2.0.0/16 (Active) Label 1:2 POP 1 Path-ID 2 R22 [Output omitted for brevity]

Use Case #2 Shared Prefix DC Stickiness with more Specific Prefix Dual datacentre Same prefixes shared across Site1/Site2 Site1 preferred for Site2 preferred for 10.2.0.0/16 R31 PfR View CHANNEL PATH NEXT HOP PREFIX STATUS 1 MPLS R11 2 INET R12 3 MPLS R21 4 INET R22 10.2.0.0/16 10.2.0.0/16 10.2.0.0/16 10.2.0.0/16 Active Standby Active Standby Standby Active Standby Active BGP R10 R11 10.0.0.0/8 Path MPLS Id 1 SITE1 PfR Site-Prefix 10.2.0.0/16 R20 SITE2 PfR Site-Prefix 10.2.0.0/16 R12 R21 R22 Path INET Id 2 10.2.0.0/16 Ch1 Ch2 Ch3 Ch4 R31 10.3.3.0/24 Path MPLS Id 1 Path INET Id 2 10.2.0.0/16 10.0.0.0/8 BGP

Path Selection R10 SITE1 PfR Site-Prefix 10.2.0.0/16 10.2.0.0/16 R20 SITE2 PfR Site-Prefix 10.2.0.0/16 R31 PfR View R11 Path MPLS Id 1 R12 R21 R22 Path INET Id 2 Path MPLS Id 1 Path INET Id 2 PREFIX PATH PREFERENCE MPLS Preferred INET Fallback NEXT-HOPS ORDER R11 R12 R21 R22 Status Active Active Standby Standby Ch1 Ch2 Ch3 Ch4 No Preference R11, R12 R21, R22 Active Standby R31 10.3.3.0/24

Channels Site1 R31-Site3-Spoke#show domain IWAN master channel dscp ef Channel Id: 5 Dst Site-Id: 10.1.0.10 Link Name: MPLS DSCP: ef [46] pfr-label: 0:1 0:0 [0x10000] TCs: 1 Channel Created: 00:17:25 ago Provisional State: Initiated and open Operational state: Available Channel to hub: TRUE Site Prefix List 10.1.0.10/32 (Routable) (Active) 10.2.0.0/16 (Standby) Label 0:1 POP 0 Path-ID 1 R11 Channel Id: 6 Dst Site-Id: 10.1.0.10 Link Name: INET DSCP: ef [46] pfr-label: 0:2 0:0 [0x20000] TCs: 0 Channel Created: 00:17:25 ago Provisional State: Initiated and open Operational state: Available Channel to hub: TRUE Site Prefix List 10.1.0.10/32 (Routable) (Active) 10.2.0.0/16 (Standby) Label 0:2 POP 0 Path-ID 2 R12 [Output omitted for brevity]

Channels Site2 R31-Site3-Spoke#show domain IWAN master channel dscp ef Channel Id: 15 Dst Site-Id: 10.2.0.20 Link Name: MPLS DSCP: ef [46] pfr-label: 1:1 0:0 [0x1010000] TCs: 1 Channel Created: 00:15:55 ago Provisional State: Initiated and open Operational state: Available Channel to hub: TRUE Site Prefix List 10.2.0.20/32 (Routable) (Standby) 10.2.0.0/16 (Active) Label 1:1 POP 1 Path-ID 1 R21 Channel Id: 16 Dst Site-Id: 10.2.0.20 Link Name: INET DSCP: ef [46] pfr-label: 1:2 0:0 [0x1020000] TCs: 0 Channel Created: 00:15:55 ago Provisional State: Initiated and open Operational state: Available Channel to hub: TRUE Site Prefix List 10.2.0.20/32 (Routable) (Standby) 10.2.0.0/16 (Active) Label 1:2 POP 1 Path-ID 2 R22 [Output omitted for brevity]

Use Case #3 Shared Prefix DC Stickiness with Different Metrics BGP: Both Site1 and Site2 advertise and 10.2.0.0/16 DC preference can be determined per branch R31 PfR View CHANNEL PATH NEXT HOP PREFIX STATUS 1 MPLS R11 2 INET R12 3 MPLS R21 4 INET R22 10.2.0.0/16 10.2.0.0/16 10.2.0.0/16 10.2.0.0/16 Active Active Active Active Standby Standby Standby Standby BGP 10.2.0.0/16 10.0.0.0/8 R10 R11 LP 100000 SITE1 PfR Site-Prefix 10.2.0.0/16 LP 20000 10.2.0.0/16 R20 R12 R21 R22 R31 10.3.3.0/24 LP 3000 Ch1 Ch2 Ch3 Ch4 SITE2 PfR Site-Prefix 10.2.0.0/16 LP 400 BGP 10.2.0.0/16 10.0.0.0/8

Path Selection Transit Site Affinity introduced in 15.5(3)M1 and XE 3.16.1 R10 SITE1 PfR Site-Prefix 10.2.0.0/16 10.2.0.0/16 R20 SITE2 PfR Site-Prefix 10.2.0.0/16 R11 R12 R21 R22 R31 PfR View PREFIX PATH PREFERENCE NEXT-HOPS ORDER Status BGP 10.2.0.0/16 10.0.0.0/8 LP 100000 LP 20000 LP 3000 LP 400 BGP 10.2.0.0/16 10.0.0.0/8 MPLS Preferred INET Fallback R11 R12 R21 R22 Active Active Standby Standby Ch1 Ch2 Ch3 Ch4 No Preference R11, R12 R21, R22 Active Standby R31 10.3.3.0/24

Channels Site1 R31-Site3-Spoke#show domain IWAN master channel dscp ef Channel Id: 73 Dst Site-Id: 10.1.0.10 Link Name: MPLS DSCP: ef [46] pfr-label: 0:1 0:0 [0x10000] TCs: 2 Channel Created: 00:03:47 ago Provisional State: Initiated and open Operational state: Available Channel to hub: TRUE Site Prefix List 10.1.0.10/32 (Routable) (Active) 10.2.0.0/16 (Active) Label 0:1 POP 0 Path-ID 1 R11 Channel Id: 82 Dst Site-Id: 10.1.0.10 Link Name: INET DSCP: ef [46] pfr-label: 0:2 0:0 [0x20000] TCs: 0 Channel Created: 00:03:10 ago Provisional State: Initiated and open Operational state: Available Channel to hub: TRUE Site Prefix List 10.1.0.10/32 (Routable) (Active) 10.2.0.0/16 (Active) Label 0:2 POP 0 Path-ID 2 R12 [Output omitted for brevity]

Channels Site2 R31-Site3-Spoke#show domain IWAN master channel dscp ef Channel Id: 79 Dst Site-Id: 10.2.0.20 Link Name: MPLS DSCP: ef [46] pfr-label: 1:1 0:0 [0x1010000] TCs: 0 Channel Created: 00:03:17 ago Provisional State: Initiated and open Operational state: Available Channel to hub: TRUE Site Prefix List 10.2.0.20/32 (Routable) (Standby) 10.2.0.0/16 (Standby) Label 1:1 POP 1 Path-ID 1 R21 Channel Id: 86 Dst Site-Id: 10.2.0.20 Link Name: INET DSCP: ef [46] pfr-label: 1:2 0:0 [0x1020000] TCs: 0 Channel Created: 00:02:41 ago Provisional State: Initiated and open Operational state: Available Channel to hub: TRUE Site Prefix List 10.2.0.20/32 (Routable) (Standby) 10.2.0.0/16 (Standby) Label 1:2 POP 1 Path-ID 2 R22 [Output omitted for brevity]

Use Case #4 No DC Stickiness Dual Central Sites Same Prefix To disable and come back to previous default: R31 PfR View domain IWAN vrf default master hub advanced no transit-site-affinity CHANNEL PATH NEXT HOP PREFIX STATUS 1 MPLS R11 Active BGP 10.2.0.0/16 10.0.0.0/8 R10 R11 LP 1000 SITE1 PfR Site-Prefix 10.2.0.0/16 R20 R12 R21 R22 LP 1000 LP 1000 Ch1 Ch2 Ch3 Ch4 SITE2 PfR Site-Prefix LP 1000 BGP 10.2.0.0/16 10.0.0.0/8 2 INET R12 Active 3 MPLS R21 Active 4 INET R22 Active R31 10.3.3.0/24

Path Selection R10 SITE1 PfR Site-Prefix 10.2.0.0/16 10.2.0.0/16 R20 SITE2 PfR Site-Prefix 10.2.0.0/16 R11 R12 R21 R22 R31 PfR View PREFIX PATH PREFERENCE MPLS Preferred INET Fallback No Preference NEXT-HOPS ORDER R11, R21 R12, R22 R11, R12, R21, R22 Status Active, Active Active, Active Active, Active, Active, Active BGP 10.0.0.0/8 LP 100000 LP 20000 LP 3000 Ch1 Ch2 Ch3 Ch4 R31 10.3.3.0/24 LP 400 10.0.0.0/8 BGP

Channels Site1 R31-Site3-Spoke#show domain IWAN master channel dscp ef Channel Id: 90 Dst Site-Id: 10.1.0.10 Link Name: MPLS DSCP: ef [46] pfr-label: 0:1 0:0 [0x10000] TCs: 1 Channel Created: 00:01:57 ago Provisional State: Initiated and open Operational state: Available Channel to hub: TRUE Site Prefix List 10.1.0.10/32 (Routable) (Active) 10.2.0.0/16 (Active) Label 0:1 POP 0 Path-ID 1 R11 Channel Id: 91 Dst Site-Id: 10.1.0.10 Link Name: INET DSCP: ef [46] pfr-label: 0:2 0:0 [0x20000] TCs: 0 Channel Created: 00:01:57 ago Provisional State: Initiated and open Operational state: Available Channel to hub: TRUE Site Prefix List 10.1.0.10/32 (Routable) (Active) 10.2.0.0/16 (Active) Label 0:2 POP 0 Path-ID 2 R12 [Output omitted for brevity]

Channels Site2 R31-Site3-Spoke#show domain IWAN master channel dscp ef Channel Id: 92 Dst Site-Id: 10.2.0.20 Link Name: MPLS DSCP: ef [46] pfr-label: 1:1 0:0 [0x1010000] TCs: 1 Channel Created: 00:01:57 ago Provisional State: Initiated and open Operational state: Available Channel to hub: TRUE Site Prefix List 10.2.0.20/32 (Routable) (Active) 10.2.0.0/16 (Active) Label 1:1 POP 1 Path-ID 1 R21 Channel Id: 93 Dst Site-Id: 10.2.0.20 Link Name: INET DSCP: ef [46] pfr-label: 1:2 0:0 [0x1020000] TCs: 0 Channel Created: 00:01:57 ago Provisional State: Initiated and open Operational state: Available Channel to hub: TRUE Site Prefix List 10.2.0.20/32 (Routable) (Active) 10.2.0.0/16 (Active) Label 1:2 POP 1 Path-ID 2 R22 [Output omitted for brevity] [Output omitted for brevity]

Use Case #5 Path of Last Resort Path of last resort (PLR) option for metered links PLR Channels muted when in standby mode Once it is active, smart probes will only be sent on dscp 0 (zero sla) to conserve bandwidth Smart probe frequency will be reduced to 1 packet every 10 secs from 20 packets per secs. Unreachable detection will be extended to 60 secs R10 R11 SITE1 Site ID = 10.1.0.10 R12 R13 R21 R22 DMVPN MPLS DMVPN INET R20 SITE2 Site ID = 10.2.0.20 DMVPN LTE R23 R13 R23 interface Tunnel300 description LTE Path -- domain IWAN path LTE path-id 3 path-last-resort R31 10.3.3.0/24

Troubleshooting

Check Traffic Classes Summary R31-Site3-Spoke#show domain IWAN master traffic-classes summary APP - APPLICATION, TC-ID - TRAFFIC-CLASS-ID, APP-ID - APPLICATION-ID SP - SERVICE PROVIDER, PC = PRIMARY CHANNEL ID, BC - BACKUP CHANNEL ID, BR - BORDER, EXIT - WAN INTERFACE UC - UNCONTROLLED, PE - PICK-EXIT, CN - CONTROLLED, UK - UNKNOWN Dst-Site-Pfx Dst-Site-Id APP DSCP TC-ID APP-ID State SP PC/BC BR/EXIT 20.1.100.0/28 Internet N/A af21 10 N/A CN INET 19/NA 10.3.0.31/Tunnel200 10.4.4.0/24 10.4.0.41 N/A ef 7 N/A CN MPLS 13/14 10.3.0.31/Tunnel100 10.1.0.10 N/A default 9 N/A CN INET 3/1 10.3.0.31/Tunnel200 10.1.0.10 N/A ef 8 N/A CN MPLS 4/5 10.3.0.31/Tunnel100 Total Traffic Classes: 4 Site: 3 Internet: 1 R31-Site3-Spoke# Traffic Class Controlled Path Information - Channels

Check Traffic Classes Details R31-Site3-Spoke#show domain IWAN master traffic-classes dscp ef Dst-Site-Prefix: DSCP: ef [46] Traffic class id:8 Clock Time: 15:46:41 (EST) 01/15/2016 TC Learned: 00:20:40 ago Present State: CONTROLLED Current Performance Status: in-policy Current Service Provider: MPLS since 00:20:10 Previous Service Provider: Unknown BW Used: 20 Kbps Present WAN interface: Tunnel100 in Border 10.3.0.31 Present Channel (primary): 4 MPLS pfr-label:0:1 0:0 [0x10000] Backup Channel: 5 INET pfr-label:0:2 0:0 [0x20000] Destination Site ID bitmap: 1 Destination Site ID: 10.1.0.10 Class-Sequence in use: 10 Class Name: VOICE using policy User-defined priority 2 packet-loss-rate threshold 5.0 percent priority 1 one-way-delay threshold 150 msec priority 2 byte-loss-rate threshold 5.0 percent BW Updated: 00:00:10 ago Reason for Latest Route Change: Delay Check Traffic Class Voice for site 1 Active Path used Check Channels used (Primary and Backup) Path name and Path Id (Next Hop) reason for last change

Check Traffic Classes Details R31-Site3-Spoke#show domain IWAN master traffic-classes dscp ef [Output omitted for brevity] Reason for Latest Route Change: Delay Route Change History: Date and Time Previous Exit Current Exit Reason 1: 15:50:27 (EST) 01/15/16 MPLS(0:1 0:0)/10.3.0.31/Tu100 (Ch:4) INET(0:2 0:0)/10.3.0.31/Tu200 (Ch:5) Out-of-Policy (One Way Delay : 283 msec) 2: 15:26:31 (EST) 01/15/16 None(0:0 0:0)/0.0.0.0/None (Ch:0) MPLS(0:1 0:0)/10.3.0.31/Tu100 (Ch:4) Uncontrolled to Controlled Transition History of Route Changes: Last 5 reasons Route change from MPLS to INET due to Delay

Monitoring Channels R31-Site3-Spoke#sh domain IWAN master channels dscp ef Channel Id: 4 Dst Site-Id: 10.1.0.10 Link Name: MPLS DSCP: ef [46] pfr-label: 0:1 0:0 [0x10000] TCs: 0 Channel Created: 22:05:08 ago Provisional State: Initiated and open Operational state: Available Channel to hub: TRUE Interface Id: 15 Supports Zero-SLA: Yes Muted by Zero-SLA: No Estimated Channel Egress Bandwidth: 40 Kbps Immitigable Events Summary: Total Performance Count: 0, Total BW Count: 0 Site Prefix List 10.1.0.10/32 (Routable) (Active) ODE Statistics: Received: 484 [SNIP]

Monitoring Channels (Cont d) ODE [CONTD] ODE Stats Bucket Number: 1 Last Updated : 00:00:01 ago Packet Count : 38 Byte Count : 3192 One Way Delay : 283 msec* Loss Rate Pkts: 0.0 % Loss Rate Byte: 0.0 % Jitter Mean : 4783 usec Unreachable : FALSE ODE Stats Bucket Number: 2 Last Updated : 00:00:03 ago Packet Count : 37 Byte Count : 3108 One Way Delay : 284 msec* Loss Rate Pkts: 0.0 % Loss Rate Byte: 0.0 % Jitter Mean : 5081 usec Unreachable : FALSE On Demand Export (ODE) Delay Out of Policy

Monitoring Channels (Cont d) TCA [CONTD] TCA Statistics: Received: 441 ; Processed: 128 ; Unreach_rcvd: 0 ; Local Unreach_rcvd: 0 TCA lost byte rate: 0 TCA lost packet rate: 7 TCA one-way-delay: 0 TCA network-delay: 434 TCA jitter mean: 0 Latest TCA Bucket Last Updated : 00:00:03 ago One Way Delay : 284 msec* Loss Rate Pkts: NA Loss Rate Byte: NA Jitter Mean : NA Unreachability: FALSE Threshold Crossing Alert (TCA) One Way Delay OOP

Key Takeaways

Performance Routing Phases Summary IWAN 2.0 PfR version 3 IOS 15.4(3)M IOS-XE 3.13 PfR version 3 IOS 15.5(1)T IOS-XE 3.14 PfR version 3 IOS 15.5(2)T IOS-XE 3.15 PfR version 3 IOS 15.5(3)M IOS-XE 3.16 IWAN 2.1 PfR version 3 IOS 15.5(3)M1 IOS-XE 3.16.1 PfR Domain One touch provisioning Auto Discovery of sites NBAR2 support Passive Monitoring (performance monitor) Smart Probing VRF Awareness IPv4/IPv6 (Future) <10 lines of configuration and centralised Zero SLA WCCP Support Transit Sites Multiple Next Hop per DMVPN Multiple POPs Syslog (TCA) Show last 5 TCA Path of Last Resort EIGRP IWAN Simplification (Stub site) POP Affinity Blackout ~ sub second Brownout ~ 2 sec Scale 2000 sites

Performance Routing Platform Support Cisco CSR-1000 Cisco ASR-1000 MC BR* Cisco ISR G2 family 3900-AX 2900-AX 1900-AX 890 Cisco ISR 4000 4400 4300 MC BR MC BR MC BR * BR support 3.18

Key Takeaways IWAN Intelligent Path Control pillar is based upon Performance Routing (PfR) Maximises WAN bandwidth utilisation Protects applications from performance degradation Enables the Internet as a viable WAN transport Provides multisite coordination to simplify network wide provisioning. Application-based policy driven framework and is tightly integrated with existing AVC components. Smart and Scalable multi-sites solution to enforce application SLAs while optimising network resources utilisation. PfRv3 is the 3 rd generation Multi-Site aware Bandwidth and Path Control/Optimisation solution for WAN/Cloud based applications. Available on ASR1k, ISR4k, and ISR-G2

More Information Cisco.com IWAN and PfRv3 Page: http://www.cisco.com/go/iwan http://www.cisco.com/go/pfr DocWiki http://docwiki.cisco.com/wiki/pfrv3:home dcloud http://dcloud.cisco.com dcloud IWAN 4D Lab: https://dcloud-cms.cisco.com/demo/16360 CVD IWAN 2.x WAN CVD s http://www.cisco.com/go/cvd/wan Intelligent WAN Technology Design Guide - February 2016: http://www.cisco.com/c/dam/en/us/td/docs/solutions/cvd/feb2016/cvd-iwandesignguide-feb16.pdf Intelligent WAN Configuration Files Guide - February 2016: http://www.cisco.com/c/dam/en/us/td/docs/solutions/cvd/feb2016/cvd-iwanconfigurationfilesguide-feb16.pdf IWAN Security for Remote Site DIA and Guest Wireless Design Guide March 2015: http://www.cisco.com/c/dam/en/us/td/docs/solutions/cvd/mar2015/cvd-iwan-diadesignguide-mar15.pdf IWAN Application Optimisation using Cisco WAAS and Akamai Connect Technology Design Guide - March 2015: http://www.cisco.com/c/dam/en/us/td/docs/solutions/cvd/mar2015/cvd-iwan-waasdesignguide-mar15.pdf

IWAN Book Pre-order available https://t.co/csseg1gkfk VIRL lab available

Q & A

Complete Your Online Session Evaluation Give us your feedback and receive a Cisco 2016 T-Shirt by completing the Overall Event Survey and 5 Session Evaluations. Directly from your mobile device on the Cisco Live Mobile App By visiting the Cisco Live Mobile Site http://showcase.genie-connect.com/ciscolivemelbourne2016/ Visit any Cisco Live Internet Station located throughout the venue T-Shirts can be collected Friday 11 March at Registration Learn online with Cisco Live! Visit us online after the conference for full access to session videos and presentations. www.ciscoliveapac.com

Thank you