Designing Programmable Access Networks

Transcription

1

2 Designing Programmable Access Networks Ahmed Abeer, Sr. Technical Marketing Engineer Nicolas Breton, Product Manager BRKSPG-2210

3 Cisco Spark How Questions? Use Cisco Spark to chat with the speaker after the session 1. Find this session in the Cisco Live Mobile App 2. Click Join the Discussion 3. Install Spark or go directly to the space 4. Enter messages/questions in the space Cisco Spark spaces will be available until July 3, cs.co/ciscolivebot#brkspg Cisco and/or its affiliates. All rights reserved. Cisco Public

4 Agenda What is Programmable Network Network Deployment or Device Automation Design & Build the Programmable Infrastructure Programmable Transport Network Discovery Compute & Program the Transport Path Next Step: Network Optimization, Service Enablement & Service Assurance Design Recommendation Conclusion 2017 Cisco and/or its affiliates. All rights reserved. Cisco Public

5 Session Objectives To understand how programmability impacts existing network designs. To learn techniques and tips to design programmable underlay and overlay. To learn concrete design recommendations. BRKSPG Cisco and/or its affiliates. All rights reserved. Cisco Public 5

6 Network High Level View & Requirement

7 Trends in the Service Provider Transport Access and Aggregation Scale the access within a domain Number of nodes and services increasing Bandwidth growth 10GE -> 100G Traffic load optimization Agile service deployment across domains End to End service deployments Access Domain A Core Access Domain C Virtualization Virtual CPE, Virtual NID Access Domain B At the same time, keep the same Services KPI s OAM, Traffic load management, Transparent Node and Service insertion BRKSPG Cisco and/or its affiliates. All rights reserved. Cisco Public 7

8 Challenges and Requirements Effortless device provisioning ZTD/PNP SDN-friendly infrastructure Standardized API for network monitoring, management and control Simple Operations Increased Network Visibility Agile End-to-end Service Deployment Flexible Traffic Engineering BRKSPG Cisco and/or its affiliates. All rights reserved. Cisco Public 8

9 What is Programmable Network

10 Network Programmability What is changing in the network? Traditional Programmatic Approach Access Domain C Access Domain C IP/MPLS/ L2 Segment Routing Core Core Access Domain A Access Domain A SNMP CLI Access Domain B Topology Discovery Path Computation Programmable Interfaces Access Domain B NMS Service Assurance OSS BSS Orchestration WAN Optimization Engine XR Transport Controller Open Source BRKSPG Cisco and/or its affiliates. All rights reserved. Cisco Public 10

11 Programmable Network New Operation Model Configuration Management Operational State Traffic Engineering APIC EM IOS XR XML Netconf Restconf Telemetry BGP-LS PCEP API Protocols Programmatic Interfaces Model Driven Programmable Interfaces Open Protocols BRKSPG Cisco and/or its affiliates. All rights reserved. Cisco Public 11

12 Automatic Device Provisioning The Day 0 Challenge

13 Day 0 Challenges Simplify Day 0 device deployments Limited or no Cli changes on site Rely on the network ( in band ) for all steps of device preparations. Also called Zero Touch Provisioning Rapid Nodes and Service deployments Hours to minutes Orchestrated Service-Ready Infrastructure Standard programming interfaces Model driven: Uniform service provisioning Flexible traffic engineering Optional requirements Service turn-up verifications Secured operations Indestructible management channel Expected to be service ready on bringup Large number of devices to bring up Devices distributed in different physical locations BRKSPG Cisco and/or its affiliates. All rights reserved. Cisco Public 13

14 Requirements to achieve full automation Bootstrap Boot process initiated through the firmware Boot from WEB server using HTTP Uses DHCP to learn HTTP link for the bootable image Discovery L2 VLAN discovery DHCP request/response Management interface ( out of band ) versus network interfaces ( inband ) Any network/topology Downloads Configuration downloads Image download Image installation Persistent connection with Management system Zero Touch Provisioning Zero Touch Deployment Zero Pre-staging Plug&Play BRKSPG Cisco and/or its affiliates. All rights reserved. Cisco Public 14

15 Use Case 1: ZTP High Level Design DHCP Client & TFTP Client 4201/4202/4206 ME1200 DHCP Client & TFTP Client TFTP Request VL4094 DHCP Request DHCP Reply TFTP Reply ibgp NCS Aggregation Node Provides both DHCP Server & TFTP Server Functions MPLS Management VPN Copy configuration file & preconfigure aggregation node ebgp DCN GW Management VPN Peering Point DCN Generates Configuration Files & Preconfigures Aggregation Node DCN GW EPNM BRKSPG Cisco and/or its affiliates. All rights reserved. Cisco Public 15

16 Use Case 2: ZTP Configuration is removed from ASR920 and the router is reloaded to start ZTP Process BRKSPG Cisco and/or its affiliates. All rights reserved. Cisco Public 16

17 Designing the Programmable Underlay Step 1: Build a Programmable Transport

18 Why Segment Routing? More Control and Programmable Segment Routing Labels are assigned manually or programmed Simplifies the Control plane stack. Extension to IGP s ( ISIS, OSPF) Programmable MPLS Program MPLS labels Service label SR-TE path OR CLI> Seamless migration SR mapping server Traffic Engineering: SR-TE Single touch point at the headend Flexibility to optimize traffic load Control the path at very granular level Head-End Domain A ABR 1 ABR 2 Domain B BRKSPG Cisco and/or its affiliates. All rights reserved. Cisco Public 18

19 Unified MPLS vs Segment Routing Intra Domain LDP/IGP Service Label Program MPLS labels: Prefix SID Service Label CLI> OR LDP LDP Prefix SIDs LDP PW LDP LDP PW ISIS-SR Unified MPLS Programmable MPLS MPLS Labels Unifed MPLS Segment Routing Transport Labels Dynamic Label allocation (LDP) Programmed or cli Service Labels Dynamic Label allocation (LDP) Programmed or cli BRKSPG Cisco and/or its affiliates. All rights reserved. Cisco Public 19

20 Unified MPLS vs Segment Routing Inter Domain Unified MPLS Programmable MPLS Program MPLS labels Prefix SID Service Label CLI> OR ABR 1 ABR 2 ABR 1 ABR 2 Domain A Domain B Domain A Domain B 3 1 Service Label BGP Label 3 2 Swap LDP Label LDP Drop 3 2 TE Label 3 4 Push 3 Service Label 2 Destination Label 1 Next Hop Label BGP Label 3 2 IGP / LDP BGP-LU TE FRR / Remote LFA IGP / LDP IGP BRKSPG-2210 BGP-LU IGP 2017 Cisco and/or its affiliates. All rights reserved. Cisco Public 20

21 Designing the Programmable Underlay Step 2: PCE Network Multi-Domain Visibility

22 BGP-LS Overview Build TED for Multi-area Optimal Path Computation Scalable Solution is BGP, not IGP. BGP-LS is an address-family afi=16388, safi=71 Defined to carry IGP link-state database via BGP Supports both IS-IS and OSPF Delivers topology information to outside agents Domain 0 BGP-LS PCE BGP-LS BGP-LS RR Traffic Engineering Databse (TED) Domain 1 Domain 2 BRKSPG Cisco and/or its affiliates. All rights reserved. Cisco Public 22

23 This network topology results in 18 BGP-LS objects. Common topology abstraction model IGP network modeled Three classes of objects Nodes Links prefixes Postman REST API JSON/XML ODL/XTC WAE RR Lo: BGP-LS.102 Node2 Link: Link1&2 Node1.100 Link3&4 Link: Node1 BGP-LS Objects 3 nodes 6 links 9 prefix Lo: Link: Node3 Lo: BRKSPG Cisco and/or its affiliates. All rights reserved. Cisco Public 23

24 BGP Link State Device Configuration BGP Link State Configuration only on 1 node per domain Node 1 only requires BGP LS configuration BGP LS configured on this node Node1 Lo: Link: Node Link1&2.101 Link: Node2 Link3& Node3 Lo: Lo: Link: router ospf 1 distribute bgp-ls router-id address-family ipv4 unicast area 0 interface Loopback0 network point-to-point! interface GigabitEthernet0/0/0/0 network point-to-point! interface GigabitEthernet0/0/0/18 network point-to-point!!! router bgp bgp router-id address-family ipv4 unicast! address-family link-state link-state! neighbor remote-as update-source MgmtEth0/RSP0/CPU0/0 address-family ipv4 unicast! address-family link-state link-state route-reflector-client BRKSPG-2210 Distribute OSPF link state database into BGP-LS Enable link-state addresses Specify BGP-LS peer 2017 Cisco and/or its affiliates. All rights reserved. Cisco Public 24

25 ODL Configuration ODL Beryllium installation PCEP/BGP-LS installation inside ODL BRKSPG Cisco and/or its affiliates. All rights reserved. Cisco Public 25

26 ODL Configuration Modify ~/etc/opendaylight/karaf/41-bgp-example.xml Change the local BGP RIB info. Search for "example-bgp-rib" and change the "localas" and "bgp-rib-id" values to be your local AS and ODL's IP address. Add the peer (Node: ). Look for the "example-bgp-peer" module, remove the comments around it, and edit the IP address. BRKSPG Cisco and/or its affiliates. All rights reserved. Cisco Public 26

27 BGP Link State Verification RP/0/RSP0/CPU0:ASR9K0#sh bgp link-state link-state BGP router identifier , local AS number BGP generic scan interval 60 secs Non-stop routing is enabled BGP table state: Active Table ID: 0x0 RD version: 39 BGP main routing table version 39 BGP NSR Initial initsync version 11 (Reached) BGP NSR/ISSU Sync-Group versions 0/0 BGP scan interval 60 secs Check here for the Prefix codes Status codes: s suppressed, d damped, h history, * valid, > best i - internal, r RIB-failure, S stale, N Nexthop-discard Origin codes: i - IGP, e - EGP,? - incomplete Prefix codes: E link, V node, T IP reacheable route, u/u unknown I Identifier, N local node, R remote node, L link, P prefix L1/L2 ISIS level-1/level-2, O OSPF, D direct, S static/peer-node a area-id, l link-id, t topology-id, s ISO-ID, c confed-id/asn, b bgp-identifier, r router-id, i if-address, n nbr-address, o OSPF Route-type, p IP-prefix d designated router address Network Next Hop Metric LocPrf Weight Path *> [V][O][I0x0][N[c64496][b ][a ][r ]]/ I *>[V][O][I0x0][N[c64496][b ][a ][r ]]/ i *> [V][O][I0x0][N[c64496][b ][a ][r ]]/ I Node V= node O= OSPF N= local node c= Confed ID/ ASN b=bgp-id a=area-id r=router-id *>[E][O][I0x0][N[c64496][b ][a ][r ]][R[c64496][b ][a ][r ]][L[i ][n ]]/ i BRKSPG Cisco and/or its affiliates. All rights reserved. Cisco Public 27

28 BGP Link State Verification *>[E][O][I0x0][N[c64496][b ][a ][r ]][R[c64496][b ][a ][r ]][L[i ][n ]]/ i *>[E][O][I0x0][N[c64496][b ][a ][r ]][R[c64496][b ][a ][r ]][L[i ][n ]]/ I *> [T][O][I0x0][N[c64496][b ][a ][r ]][P[o0x01][p /24]]/ i *> [T][O][I0x0][N[c64496][b ][a ][r ]][P[o0x01][p /24]]/ i *> [T][O][I0x0][N[c64496][b ][a ][r ]][P[o0x01][p /32]]/ i *> [T][O][I0x0][N[c64496][b ][a ][r ]][P[o0x01][p /24]]/ i *> [T][O][I0x0][N[c64496][b ][a ][r ]][P[o0x01][p /24]]/ Prefix 0 i *> [T][O][I0x0][N[c64496][b ][a ][r ]][P[o0x01][p /32]]/ i Processed 18 prefixes, 18 paths T= IP reacheable route N=node c= Confed ID/ ASN b=bgp-id a=area-id r=router-id P=prefix o= ospf-route-typ -- 0x01 p= ip prefix /32 Link E=link N=node c= Confed ID/ ASN b=bgp-id a=area-id r=router-id R= remote node c= Confed ID/ ASN b=bgp-id a=area-id r=router-id L=link i= if-address n=nbr-address BRKSPG Cisco and/or its affiliates. All rights reserved. Cisco Public 28

29 Northbound BGP-LS Verification with RESTCONF Postman REST ODL JSON/XML Node2 Lo: BGP-LS.102 Node1.100 Link3&4 Link: Lo: Node3 Lo: BRKSPG Cisco and/or its affiliates. All rights reserved. Cisco Public 29

30 Northbound BGP-LS Verification with RESTCONF GET BGP-LS Topology { "topology": [ { "topology-id": "example-linkstate-topology", "link": [ { "link-id": "bgpls://ospf:0/type=link&local-as=64496&local-domain= &local-area=0&local-router= &remoteas=64496&remote-domain= &remote-area=0&remote-router= &ipv4-iface= &ipv4-neigh= , "source": { SOURCE "source-tp": "bgpls://ospf:0/type=tp&ipv4= ", "source-node": "bgpls://ospf:0/type=node&as=64496&domain= &area=0&router= " }, } }, "destination": { "dest-node": "bgpls://ospf:0/type=node&as=64496&domain= &area=0&router= ", "dest-tp": "bgpls://ospf:0/type=tp&ipv4= " } }, ---- Trim ---- TOPOLOGY LINK DESTINATION BRKSPG Cisco and/or its affiliates. All rights reserved. Cisco Public 30

31 1 OpenDaylight BGP-LS Topology Discovery 2 3 BRKSPG Cisco and/or its affiliates. All rights reserved. Cisco Public 31

32 BGP-LS Deployment Scenarios PCE Topology TE Database PCE Topology TE Database Physical or Virtual RR BGP-LS BGP-RR SID: BGP-LS SID: SID: BGP-LS SID: Head-End (PCC) SID: IGP Domain A ABR 1 ABR 2 IGP Domain B Head-End (PCC) SID: IGP Domain A ABR 1 ABR 2 BGP Speakers IGP Domain B SID: SID: Design Scenario 1: Border Routers Peering with PCE Design Scenario 2: BGP RR Peering with PCE In Bold, design recommendation BRKSPG Cisco and/or its affiliates. All rights reserved. Cisco Public 32

33 Designing the Programmable Underlay Step 3: Cisco PCE Path Computation & Deployment

34 PCEP Architectural Introduction Path computation Large, multi-domain and multi-layer networks Path computation element (PCE) Computes network paths (topology, paths, etc.) Stores TE topology database (synchronized with network) May initiate path creation Stateful - stores path database included resources used (synchronized with network) PCEP PCC PCE LSP DB TED Path computation client (PCC) May send path computation requests to PCE May send path state updates to PCE Used between head-end router (PCC) and PCE to: Request/receive path from PCE subject to constraints State synchronization between PCE and router Hybrid CSPF Open/Close/Keepalive PCC PCE Open/Close/Keepalive Request PCC PCE Reply Notification PCC PCE Notification BRKSPG Cisco and/or its affiliates. All rights reserved. Cisco Public 34

35 Stateful PCE Models PCC Initiated SR Policy PCE Initiated SR Policy LSP DB LSP DB PCE TED SR Policy & Path Request REST/NETCONF PCE TED PCEP PCEP PCEP PCEP PCC SR Policy Initiator IGP-SR Domain A BGP-LS Speaker BGP-LS Speaker BGP-LS IGP-SR Domain B PCC IGP-SR Domain A BGP-LS Speaker BGP-LS Speaker BGP-LS IGP-SR Domain B ABR 1 ABR 2 ABR 1 ABR 2 PCC initiates LSPs or SR Policy PCE Compute Path b/w end points Out-of-network, stateful PCE server PCE always initiates LSPs BRKSPG Cisco and/or its affiliates. All rights reserved. Cisco Public 35

36 PCEP Device Configuration PCE configuration will be done on each node under mpls traffic-eng Node 1 only requires BGP LS configuration ODL (PCE) PCEP Postman REST Node1 (PCC) Lo: Lo: Link: Node Link: Node Node3 Lo: Link: interface tunnel-te0 ipv4 unnumbered Loopback0 signalled-name bar destination pce delegation!!! mpls traffic-eng interface GigabitEthernet0/0/0/0! interface GigabitEthernet0/0/0/18! pce peer ipv ! stateful-client instantiation delegation!! auto-tunnel pcc tunnel-id min 101 max 200 PCC Initiated LSP & Delegated to PCE. Configuration Not Required in Case of PCE initiated Tunnel Global Configuration under MPLS TE PCE Modes: Stateful PCE Initiated LSP or PCC Initiated & Delegated to PCE Tunnel ID Rance. Add LSP by PCE. PCE creates tunnel using assign Tunnel ID from given range Lo: BRKSPG Cisco and/or its affiliates. All rights reserved. Cisco Public 36

37 PCEP ODL Configuration ODL Beryllium installation odl-restconf odl-l2switch-switch odlmdsal-apidocs odl-dlux-all odl-bgpcep-bgp-all odl-bgpcep-pcepall PCEP installation inside ODL Note: No Configuration Required. There is no need to Modify any file for on ODL for PCEP BRKSPG Cisco and/or its affiliates. All rights reserved. Cisco Public 37

38 PCEP Verification ODL Server: netstat -an grep 4189 tcp6 0 0 :::4189 :::* LISTEN tcp : :39330 ESTABLISHED tcp : :55641 ESTABLISHED tcp : :14570 ESTABLISHED Verifying PCEP session on the server ( PCE) Node 1: RP/0/RSP0/CPU0:ASR9K0#show mpls traffic-eng pce peer Address Precedence State Learned From Up Static config Verifying PCEP session on the PCC BRKSPG Cisco and/or its affiliates. All rights reserved. Cisco Public 38

39 PCEP Example 1: PCC Initiated Tunnel (RSVP TE) & Path Computation from PCE via Update LSP PCE configuration will be done on each node under mpls traffic-en ODL (PCE) PCEP Postman REST Node1 (PCC) Lo: Lo: Link: Node Link: Lo: Link: Node3 interface tunnel-te0 ipv4 unnumbered Loopback0 signalled-name bar destination pce delegation!!! mpls traffic-eng interface GigabitEthernet0/0/0/0! interface GigabitEthernet0/0/0/18! pce peer ipv ! stateful-client instantiation delegation!! auto-tunnel pcc tunnel-id min 101 max 200 PCC Initiated LSP & Delegated to PCE. Configuration Not Required in Case of PCE initiated Tunnel Global Configuration under MPLS TE PCE Modes: Stateful PCE Initiated LSP or PCC Initiated & Delegated to PCE Tunnel ID Range. Add LSP by PCE. PCE creates tunnel using assign Tunnel ID from given range Lo: BRKSPG Cisco and/or its affiliates. All rights reserved. Cisco Public 39

40 PCE Update LSP: PCE Path Computation PCEP Postman REST ODL Node1 JSON/XML Lo: Lo: Node2 Tunnel Te0.101 Lo: Lo: Node3 { PCC node "input" : { "node" : "pcc:// ", "name" : "foo", "network-topology-ref": "/network-topology:network-topology/networktopology:topology[network-topology:topology-id=\"pcep-topology\"]", "arguments": { "lsp": { "administrative": "true", "delegate": "true" } }, "ero" : { "subobject" : [ { "loose" : "false", "ip-prefix" : { "ip-prefix" : " /32" } }, { "loose" : "false", "ip-prefix" : { "ip-prefix" : " /32" } }, { "loose" : "false", "ip-prefix" : { "ip-prefix" : " /32" } } ] } BRKSPG-2210 IP address explicit path 2017 Cisco and/or its affiliates. All rights reserved. Cisco Public 40

41 PCEP Update LSP: Verification RP/0/RSP0/CPU0:ASR9K0#sh mpls traffic-eng tunnels 1 detail Name: tunnel-te1 Destination: Ifhandle:0x160 Signalled-Name: foo Status: Admin: up Oper: up Path: valid Signalling: connected Tunnel is up and connected path option 10, (verbatim) type explicit (autopcc_te1) (Basis for Setup, path weight 0) G-PID: 0x0800 (derived from egress interface properties) Bandwidth Requested: 0 kbps CT0 Creation Time: Wed Jun 15 23:49: (17:58:27 ago) Config Parameters: Bandwidth: 0 kbps (CT0) Priority: 7 7 Affinity: 0x0/0xffff Metric Type: TE (global) Path Selection: Tiebreaker: Min-fill (default) Hop-limit: disabled Cost-limit: disabled Path-invalidation timeout: msec (default), Action: Tear (default) AutoRoute: enabled LockDown: disabled Policy class: not set Forward class: 0 (default) Forwarding-Adjacency: disabled Autoroute Destinations: 0 Loadshare: 0 equal loadshares Auto-bw: disabled Fast Reroute: Disabled, Protection Desired: None Path Protection: Not Enabled BFD Fast Detection: Disabled Reoptimization after affinity failure: Enabled Soft Preemption: Disabled PCE Delegation: Symbolic name: foo PCEP ID: 2 Delegated to: SNMP Index: 39 Binding SID: History: Tunnel has been up for: 02:05:43 (since Thu Jun 16 15:42:20 UTC 2016) Current LSP: Uptime: 02:05:43 (since Thu Jun 16 15:42:20 UTC 2016) Current LSP Info: Instance: 2, Signaling Area: PCE controlled Uptime: 02:05:43 (since Thu Jun 16 15:42:20 UTC 2016) Outgoing Interface: GigabitEthernet0/0/0/18, Outgoing Label: Router-IDs: local downstream Soft Preemption: None SRLGs: not collected Path Info: Outgoing: Explicit Route: Strict, Strict, Strict, Tunnel is delegated to PCE PCE control Explicit path Record Route: Disabled Tspec: avg rate=0 kbits, burst=1000 bytes, peak rate=0 kbits Session Attributes: Local Prot: Not Set, Node Prot: Not Set, BW Prot: Not Set Soft Preemption Desired: Not Set Output Trim BRKSPG Cisco and/or its affiliates. All rights reserved. Cisco Public 41

42 PCEP Example 2: PCE Initiated Tunnel (SR TE): Add LSP Operation PCE configuration will be done on each node under mpls traffic-en ODL (PCE) PCEP Postman REST Node1 (PCC) Lo: Lo: SID: Link: Node Link: Lo: SID: Link: Node3 Lo: SID: interface tunnel-te100 ipv4 unnumbered Loopback0 signalled-name SRTE destination pce delegation!!! mpls traffic-eng interface GigabitEthernet0/0/0/0! interface GigabitEthernet0/0/0/18! pce peer ipv ! segment-routing stateful-client instantiation delegation!! auto-tunnel pcc tunnel-id min 101 max 200 BRKSPG-2210 PCC Initiated LSP & Delegated to PCE. Configuration Not Required in Case of PCE initiated Tunnel Global Configuration under MPLS TE PCE Modes: Stateful PCE Initiated LSP or PCC Initiated & Delegated to PCE Tunnel ID Rance. Add LSP by PCE. PCE creates tunnel using assign Tunnel ID from given range 2017 Cisco and/or its affiliates. All rights reserved. Cisco Public 42

43 PCE Initiated Tunnel: Add LSP Operation Postman REST JSON/XML ODL PCEP Node Lo: Lo: SID: Node2.101 Lo: SID: Node3 Lo: onf/operations/network-topology-pcep:add-lsp { "input" : { "node" : "pcc:// ", "name" : "SRTE-Labels-WebJSON", "network-topology-ref": "/networktopology:network-topology/networktopology:topology[network-topology:topologyid=\"pcep-topology\"]", "arguments": { "lsp": { "administrative": true, "delegate": true }, "lspa": { "hold-priority": 0, "include-any": 0, "setup-priority": 0 }, "endpoints-obj": { "ipv4": { "destination-ipv4-address": " ", "source-ipv4-address": " " } }, "ero": { } } } "subobject": [ { "loose": false, "m-flag": true, "sid": 16002, "sid-type": "ipv4-node-id" }, { "loose": false, "m-flag": true, "sid": 16001, "sid-type": "ipv4-node-id" } ] }, "path-setup-type": { "pst": 1 } LSP Path SID: BRKSPG Cisco and/or its affiliates. All rights reserved. Cisco Public 43

44 PCEP Add LSP: Verification Name: tunnel-te106 Destination: Ifhandle:0x2e0 (auto-tunnel pcc) Signalled-Name: SRTE-Labels-WebJSON Status: Admin: up Oper: up Path: valid Signalling: connected path option 10, (Segment-Routing) type explicit (autopcc_te106) (Basis for Setup) Protected-by PO index: none G-PID: 0x0800 (derived from egress interface properties) Bandwidth Requested: 0 kbps CT0 Creation Time: Thu Jun 16 21:41: (00:00:39 ago) Config Parameters: Bandwidth: Metric Type: TE (global) Path Selection: Tiebreaker: Min-fill (default) Protection: any (default) Hop-limit: disabled Cost-limit: disabled 0 kbps (CT0) Priority: 0 0 Affinity: 0x0/0x0 Path-invalidation timeout: msec (default), Action: Tear (default) AutoRoute: disabled LockDown: disabled Policy class: not set Forward class: 0 (default) Forwarding-Adjacency: disabled Autoroute Destinations: 0 Loadshare: 0 equal loadshares Auto-bw: disabled Path Protection: Not Enabled BFD Fast Detection: Disabled Reoptimization after affinity failure: Enabled SRLG discovery: Disabled Up and connected Initiated by PCE Auto PCC: Symbolic name: SRTE-Labels-WebJSON PCEP ID: 107 Delegated to: Created by: PCE Delegation: Symbolic name: SRTE-Labels-WebJSON PCEP ID: 107 Delegated to: SNMP Index: 49 Binding SID: History: Tunnel has been up for: 00:00:39 (since Thu Jun 16 21:41:30 UTC 2016) Current LSP: Uptime: 00:00:39 (since Thu Jun 16 21:41:30 UTC 2016) Prior LSP: ID: 2 Path Option: 10 Removal Trigger: reoptimization completed Current LSP Info: Instance: 3, Signaling Area: PCE controlled Uptime: 00:00:39 (since Thu Jun 16 21:41:30 UTC 2016) Soft Preemption: None SRLGs: not collected Path Info: Segment-Routing Path Info (PCE controlled) Segment0[Node]: , Label: Segment1[Node]: , Label: Displayed 1 (of 2) heads, 0 (of 1) midpoints, 0 (of 0) tails Displayed 1 up, 0 down, 0 recovering, 0 recovered heads Tunnel is created and controlled by PCE Explicit path BRKSPG Cisco and/or its affiliates. All rights reserved. Cisco Public 44

45 PCEP Example 3: Remove LSP Operation PCE configuration will be done on each node under mpls traffic-eng Postman REST ODL (PCE) Node2.102 PCEP Link: Node1 (PCC) Lo: SID: Link: Lo: Lo: SID: Link: Node3 Lo: SID: BRKSPG Cisco and/or its affiliates. All rights reserved. Cisco Public 45

46 Cisco PCE - XR Transport Controller (XTC) An IOS XR-powered Stateful Path Computation Element (PCE) Multi-Domain Topology Collection Real-time reactive feed Computation Native SR-TE algorithms Applicable to Centralized (Controller) and Distributed (Router) deployments XTC WAE Multi-Domain Topology Collection BGP-LS ISIS / OSPF North-Bound API Custom app Computation Deployment PCEP or BGP-SAFI BRKSPG Cisco and/or its affiliates. All rights reserved. Cisco Public 46

47 XTC - Stateful PCE 2: REQUEST: vpe1 with Min LAT? SR PCE 5: BGP-LS update: DCI1 is down 3: REPLY {16003, 16002, 16001, 17002, 17001, 20001} 6: UPDATE{16003, 16002, 16001, 17002, 17011, 20001} Overlay CTRL, RR 1: Overlay route OV1 vpe1 with TE policy (minimize latency) DC A1 METRO A WAN METRO B DCB2 vpe ToR Spine DCI LSR AGG LSR AGG LSR DCI Spine ToR vpe DCI XTC remembers the request and updates the SID list upon any topology change Anycast SID s and Local FRR (TILFA) minimize traffic loss during the stateful re-optimization BRKSPG Cisco and/or its affiliates. All rights reserved. Cisco Public 47

48 XTC High Avalability 5 Overlay CTRL, RR vpe ToR Spine DCI : REQUEST: vpe1 with Min LAT? LSR AGG SR PCE1 Primary LSR : REPLY {16003, 16002, 16001, 17002, 17001, 20001} 1: Overlay route OV1 vpe1 with TE policy (minimize latency) DC A1 METRO A WAN METRO B AGG LSR : REPORT: {16003, 16002, 16001, 17002, 17001, 20001} is OK, PCE1 is master DCI Spine DCB2 ToR SR PCE2 Secondary 7: REPORT: PCE2 becomes master vpe : (optionally, if this PCE would have a different SID list as solution) UPDATE: (new SID list) 6: wait for some timer 9: (optionally if 8 happened), REPORT (new SID list): OK We leverage well-known standardized PCE HA BRKSPG Cisco and/or its affiliates. All rights reserved. Cisco Public 48

49 SR PCE SR PCE SR PCE SR PCE SR PCE SR PCE SR PCE SR PCE XTC - Fundamentally Distributed DC A1 METRO A WAN METRO B DCB2 vpe ToR Spine DCI LSR AGG LSR AGG LSR DCI Spine ToR vpe DCI AGG AGG DCI XTC not to be considered as a single god box XTC is closer to RR Different vpe s can use different pairs of XTC s XTC preference can either be based on proximity or service BRKSPG Cisco and/or its affiliates. All rights reserved. Cisco Public 49

50 XTC - Stitching Policies SR PCE 3: REPLY {16003, 4001, 20001} ;; instead of {16003, 16002, 16001, 17002, 17001, 20001} 1: REPORT {16002, 16001, 17002, 17001}, UP, BindingSID : vpe1 with Min LAT? DC A1 METRO A WAN METRO B DCB2 vpe ToR Spine DCI LSR AGG LSR AGG LSR DCI Spine ToR vpe End-to-end policies can be composed from more basic ones An SRTE policy is bound by default to a Binding SID Benefits: shorter SID list and churn isolation between domains Even if the WAN-MetroA sub-path changes, the related Binding SID 4001 is constant BRKSPG Cisco and/or its affiliates. All rights reserved. Cisco Public 50

51 XTC Use Cases Inter-Domain Path Low Latency (TE) Inter-Domain Path Best Effort (IGP) Domain1 SR PCE SR PCE Domain2 Domain1 SR PCE SR PCE Domain2 ID-list: 30102, 30203} I:100 5 I:100 4 SID-list: {16002, 16003} I:100 5 I: I:100 Default IGP link metric: I:10 Default TE link metric: T:10 I:100 There is no a-priori route distribution between domains I:100 Default IGP link metric: I:10 Default TE link metric: T:10 I:100 There is no a-priori route distribution between domains An end-to-end policy is requested BRKSPG Cisco and/or its affiliates. All rights reserved. Cisco Public 51

52 XTC Use Cases (Contd ) Service Disjointness - Node Service Disjointness - Link Domain1 SR PCE SR PCE Domain2 Domain1 SR PCE SR PCE Domain2 SID-list: {30102, 30203} I:100 5 I: I:100 SID-list: {30102, 30203} 5 I:100 4 SID-list: {16007, 16008} I:100 Default IGP link metric: I:10 I:100 Two dynamic paths between two different pairs of (headend, endpoint) must be disjoint from each other SID-list: {16007, 16008} I:100 Default IGP link metric: I:10 I:100 Two dynamic paths from same headend must be disjoint from each other via Link XTC supports Disjointness SRLG but not covered here 2017 Cisco and/or its affiliates. All rights reserved. Cisco Public 52

53 Next Step: Network Optimization, Service Enablement & Service Assurance

54 WAE: WAN Automation Engine Multi-Application Engine for the SP WAN Network planning and optimization On Demand Bandwidth Calendaring Demand placement Interact with traffic management apps Topology and traffic abstraction Multi-Vendor platform Traffic Management Applications REST REST/NETCONF SDN Orchestration & Control Configlet NSO ODL/OSC EMS/NMS NETCONF/PCEP/BGP-LS Compliments NSO and Open SDN Controller (ODL) Sourc e Destination BRKSPG Cisco and/or its affiliates. All rights reserved. Cisco Public 54

55 Network Services Orchestrator (NSO) Multi-vendor service orchestrator o o o Distributed service configuration management Transaction integrity Validation and rollback Single pane of glass for: o o o L2-L7 networking Hardware Devices Virtual Appliances YANG Model Driven Orchestration o o o Service Data models Device Data Model Network Element Driver Highly Scalable for large infrastructure o One of the existing deployment is managing 60K devices on the network Management Applications REST, Java, NETCONF Network Services Orchestrator (NSO) Service Manager Device Manager Network-wide CLI, Web UI Network Element Drivers NETCONF, CLI, SNMP, REST, etc. Network Engineer Service Models Device Models End-to-End Transactions Applications Controllers BRKSPG Cisco and/or its affiliates. All rights reserved. Cisco Public 55

56 Design Recommendations

57 High-Level Solution Building Blocks NSO (Network Orchestrator) Service Abstraction Service models & orchestration WAE Network Abstraction Path computation, Network model XTC NSO (NEDs) Device Abstraction Controllers, Protocols, NED s SNMP CLI NetFlow BGP- LS PCEP CLI NETCONF/ YANG Protocols SB network protocols Segment Routing Network Equipment and Devices BRKSPG Cisco and/or its affiliates. All rights reserved. Cisco Public 57

58 Use BGP-LS and build a Topology Database One BGP-LS speaker per domain Collects LS for the all IGP domain Scalable solution Wan Optimization WAE Topology can be shared northbound Controller vrouter ODL XRv9000 XTC Topology Database Share the topology with other apps. XTC preferred BGP-LS Topology information shared with WAE/NSO through Netconf or REST IGP-SR Domain A Speaker BGP-LS Speaker BGP-LS IGP-SR Domain B ABR 1 ABR 2 In Bold, design recommendation BRKSPG Cisco and/or its affiliates. All rights reserved. Cisco Public 58

59 Enable Path Computation and Engineer the network Rely on SR Policy Controller ODL Path and tunnel computation vrouter XRv9000 XTC XTC is for both inter and intra domain path computation Wan Optimization Controller WAE ODL Compute Path based on User s constraints Reachability Low Latency Disjointness Program SR Policy PCE Initiated PCC Initiated PCC vrouter IGP-SR Domain A BGP-LS Speaker BGP-LS XRv9000 XTC Speaker BGP-LS PCEP IGP-SR Domain B ABR 1 ABR 2 In Bold, design recommendation BRKSPG Cisco and/or its affiliates. All rights reserved. Cisco Public 59

60 Enable Path Computation and Engineer the network Controller Wan vrouter Optimization ODL XRv9000 WAE XTC For inter domain optimization, use WAE Controller ODL WAN Optimization, Bandwidth Calendaring GUI Interface Analytics Network Topology XTC shares Topology information through Netconf/Yang vrouter Wan Optimization Controller vrouter NETCONF/REST XRv9000 XTC WAE ODL XRv9000 XTC PCEP PCC BGP-LS Speaker Speaker IGP-SR Domain A BGP-LS BGP-LS IGP-SR Domain B ABR 1 ABR 2 In Bold, design recommendation BRKSPG Cisco and/or its affiliates. All rights reserved. Cisco Public 60

61 Service Creation Applications REST Controller Wan vrouter Optimization ODL XRv9000 WAE XTC Service creation with NSO Yang model service definition Orchestrator NSO Controller vrouter ODL XRv9000 XTC Service Options: MEF services (ELINE, ELAN) Business Services ( VPNs) Residential Services Consistent service definition Multi vendor environment PCC Wan Optimization Controller vrouter NETCONF/YANG BGP-LS Speaker WAE ODL XRv9000 XTC Speaker PCEP Northbound interface for Apps IGP-SR Domain A BGP-LS BGP-LS IGP-SR Domain B ABR 1 ABR 2 In Bold, design recommendation BRKSPG Cisco and/or its affiliates. All rights reserved. Cisco Public 61

62 On-demand Next-hop (ODN) Solution Highlights NSO WAE XTC-AS1-11 SR PCE XRv-1 XTC-AS1-12 SR PCE XRv-3 XRv-5 XTC-AS2-13 SR PCE XRv-7 XTC-AS2-14 SR PCE XRv-9 Automatic SR policies Inter-AS & Seamless MPLS: no need for BGP-LU (RFC3107) ISIS SR Access West (L2) AS ISIS SR Core (L2) AS64002 ISIS SR Access East (L1) AS64002 XRv-2 XRv-4 XRv-6 XRv-8 XRv-10 Recommendation: Use RR and PCE Separately On-demand Next-hop automates and simplifies the service head end configuration No SR-TE tunnel config on the head end router No explicit steering on the service head end for the service For example: no autoroute-announce, no static routes The SR Policy is deployed when needed The learning of the service route, initiates the SR policy, and traffic-to-policy mapping Example of a service route: vpnv4 route BRKSPG Cisco and/or its affiliates. All rights reserved. Cisco Public 62

63 SR ODN Solution Workflow NSO/CLI 1 NSO instantiates an L3 VPN service on PEs Note: NO transport elements configured by NSO XRv-1 XRv-3 XRv-5 XRv-7 XRv XRv XRv XRv XRv XRv-10 ISIS SR Access West (L2) AS ISIS SR Core (L2) AS64002 ISIS SR Access East (l1) BRKSPG Cisco and/or its affiliates. All rights reserved. Cisco Public 63

64 SR ODN Solution Workflow BGP VPNv4 BGP comm. gold BGP VPNv4 BGP RR 2 Routes tagged with a user-defined community to convey SLA requirements VPN routes propagated via BGP BGP RR BGP VPNv4 BGP comm. gold XRv-1 XRv-3 XRv-5 XRv-7 XRv XRv XRv XRv XRv XRv-10 ISIS SR Access West (L2) AS ISIS SR Core (L2) AS64002 ISIS SR Access East (l1) BRKSPG Cisco and/or its affiliates. All rights reserved. Cisco Public 64

65 SR ODN Solution Workflow (cont.) <policy_sample> IF BGP comm == gold THEN contact PCE request path to BGP NH minimize TE metric PCReq 3 Ingress PE matches on user-specified BGP community Ingress PE enforces policy associated with the community SR PCE Need a path to node (9)? Minimizing TE metric XRv-1 XRv-3 XRv-5 XRv-7 XRv XRv XRv XRv XRv XRv-10 ISIS SR Access West (L2) AS ISIS SR Core (L2) AS64002 ISIS SR Access East (l1) BRKSPG Cisco and/or its affiliates. All rights reserved. Cisco Public 65

66 SR ODN Solution Workflow (cont.) 4 PCE computes path PCE replies to PCC with SR-EROs (segment (SID) list) SR PCE PCRep SR-EROs Label 1 Label 2 Label XRv-1 XRv-3 XRv-5 XRv-7 XRv XRv XRv XRv XRv XRv-10 ISIS SR Access West (L2) AS ISIS SR Core (L2) AS64002 ISIS SR Access East (l1) BRKSPG Cisco and/or its affiliates. All rights reserved. Cisco Public 66

67 SR ODN Solution Workflow (cont.) FIB Y/24 via label PE programs SR-TE policy in FIB PE allocates a Binding-SID (B-SID) to it PE programs forwarding for VPN route via B-SID of SR-TE policy B-SID = XRv-1 XRv-3 XRv-5 XRv-7 XRv XRv XRv XRv XRv XRv-10 ISIS SR Access West (L2) AS ISIS SR Core (L2) AS64002 ISIS SR Access East (l1) BRKSPG Cisco and/or its affiliates. All rights reserved. Cisco Public 67

68 SR ODN Solution Workflow (cont.) 6 Traffic destined to VPN prefixes automatically steered onto SR-TE policy Note: NO feature required for steering (no auto-route announce, no PBR, no PBTS) IP DA Y FIB Y/24 via label B-SID = XRv-1 XRv-3 XRv-5 XRv-7 XRv XRv XRv XRv XRv XRv-10 ISIS SR Access West (L2) AS ISIS SR Core (L2) AS64002 ISIS SR Access East (l1) BRKSPG Cisco and/or its affiliates. All rights reserved. Cisco Public 68

69 Conclusions

70 Summary Controllers, Orchestrators 5- Turn on PCEP Automation Configuration through Netconf/Yang Models Network Simplification with Segment Routing Enable Topology Discovery 2- Use of Netconf/Yang 1- Automate the network setup 4- Turn on BGP-LS Core Access Domain C Enable inter Domains Traffic Engineering Access Domain B 3- Simplify MPLS transport with Segment routing Programmatic Approach BRKSPG Cisco and/or its affiliates. All rights reserved. Cisco Public 70

71 References Agile Carrier Ethernet Demonstration on Youtube - Segment Routing.net - Segment Routing Demo Friday - Cisco Programmability Yang blog - Tail-f netconf yang tutorials - BGP-LS linkedin blog: Netconf linkedin blog: BRKSPG Cisco and/or its affiliates. All rights reserved. Cisco Public 71

72 Complete Your Online Session Evaluation Give us your feedback to be entered into a Daily Survey Drawing. A daily winner will receive a $750 gift card. Complete your session surveys through the Cisco Live mobile app or on Don t forget: Cisco Live sessions will be available for viewing on demand after the event at Cisco and/or its affiliates. All rights reserved. Cisco Public

73 Continue Your Education Demos in the Cisco campus Walk-in Self-Paced Labs Lunch & Learn Meet the Engineer 1:1 meetings Related sessions BRKSPG Cisco and/or its affiliates. All rights reserved. Cisco Public 73

74 Thank you

75

76 Design Cisco Education Offerings Course Description Cisco Certification Designing Cisco Network Service Architectures (ARCH) Version 3.0 Provides learner with the ability to perform conceptual, intermediate, and detailed design of a network infrastructure that supports desired capacity, performance, availability required for converged Enterprise network services and applications. CCDP (Design Professional) (Available Now) Designing for Cisco Internetwork Solutions (DESGN) Version 3.0 Instructor led training focused on fundamental design methodologies used to determine requirements for network performance, security, voice, and wireless solutions. Prepares candidates for the CCDA certification exam. CCDA (Design Associate) (Available Now) For more details, please visit: Questions? Visit the Learning@Cisco Booth BRKSPG Cisco and/or its affiliates. All rights reserved. Cisco Public 76

77 Network Programmability Cisco Education Offerings Course Description Cisco Certification Developing with Cisco Network Programmability (NPDEV) Designing and Implementing Cisco Network Programmability (NPDESI) Provides Application Developers with comprehensive curriculum to develop infrastructure programming skills; Addresses needs of software engineers who automate network infrastructure and/or utilize APIs and toolkits to interface with SDN controllers and individual devices Provides network engineers with comprehensive soup-to-nuts curriculum to develop and validate automation and programming skills; Directly addresses the evolving role of network engineers towards more programmability, automation and orchestration Cisco Network Programmability Developer (NPDEV) Specialist Certification Cisco Network Programmability Design and Implementation (NPDESI) Specialist Certification Programming for Network Engineers (PRNE) Learn the fundamentals of Python programming within the context of performing functions relevant to network engineers. Use Network Programming to simplify or automate tasks Recommended pre-requisite for NPDESI and NPDEV Specialist Certifications Cisco Digital Network Architecture Implementation Essentials (DNAIE) This training provides students with the guiding principles and core elements of Cisco s Digital Network Architecture (DNA) architecture and its solution components including; APIC-EM, NFV, Analytics, Security and Fabric. None For more details, please visit: Questions? Visit the Learning@Cisco Booth BRKSPG Cisco and/or its affiliates. All rights reserved. Cisco Public 77

78 Service Provider Cisco Education Offerings Course Description Cisco Certification Deploying Cisco Service Provider Network Routing (SPROUTE) & Advanced (SPADVROUTE) Implementing Cisco Service Provider Next-Generation Core Network Services (SPCORE) Edge Network Services (SPEDGE) Building Cisco Service Provider Next-Generation Networks, Part 1&2 (SPNGN1), (SPNGN2) Implementing Cisco Service Provider Mobility UMTS Networks (SPUMTS); Implementing Cisco Service Provider Mobility CDMA Networks (SPCDMA); Implementing Cisco Service Provider Mobility LTE Networks (SPLTE) Implementing and Maintaining Cisco Technologies Using IOS XR (IMTXR) SPROUTE covers the implementation of routing protocols (OSPF, IS-IS, BGP), route manipulations, and HA routing features; SPADVROUTE covers advanced routing topics in BGP, multicast services including PIM-SM, and IPv6; SPCORE covers network services, including MPLS-LDP, MPLS traffic engineering, QoS mechanisms, and transport technologies; SPEDGE covers network services, including MPLS Layer 3 VPNs, Layer 2 VPNs, and Carrier Ethernet services; all within SP IP NGN environments. The two courses introduce networking technologies and solutions, including OSI and TCP/IP models, IPv4/v6, switching, routing, transport types, security, network management, and Cisco OS (IOS and IOS XR). The three courses (SPUMTS, SPCDMA, SPLTE) cover knowledge and skills required to understand products, technologies, and architectures that are found in Universal Mobile Telecommunications Systems (UMTS) and Code Division Multiple Access (CDMA) packet core networks, plus their migration to Long-Term Evolution (LTE) Evolved Packet Systems (EPS), including Evolved Packet Core (EPC) and Radio Access Networks (RANs). Service Provider/Enterprise engineers to implement, verification-test, and optimize core/edge technologies in a Cisco IOS XR environment. CCNP Service Provider CCNA Service Provider Cisco Service Provider Mobility CDMA to LTE Specialist; Cisco Service Provider Mobility UMTS to LTE Specialist Cisco IOS XR Specialist For more details, please visit: Questions? Visit the Learning@Cisco Booth BRKSPG Cisco and/or its affiliates. All rights reserved. Cisco Public 78