Interoperability Testing In Heterogeneous Networks. Carsten Rossenhoevel, Managing Director European Advanced Networking Test Center

Transcription

1 Interoperability Testing In Heterogeneous Networks Carsten Rossenhoevel, Managing Director European Advanced Networking Test Center

2 About the European Advanced Networking Test Center Vendor independent network quality assurance since 1991 Unique technical expertise of network design and testing in latest technology areas 20-year testing experience matches highest quality standards Business Areas Test and certification of network components for manufacturers Network design consultancy and proof of concept testing for service providers Request for Proposal (RfP) support, acceptance testing and network audits for large enterprises and government organizations Vendor neutral technology seminars

3 Setting the Scene for Interoperability Testing Multiple (potentially many) device types Different feature sets and commands Growing Complexity Multiple layers of test scenarios Different protocols and interdependencies Multiple manufacturers Different configuration and management interfaces

4 EANTC Multi-Vendor Interoperability Test Events EANTC periodically invites vendors to join our test events Two weeks of in-depth testing Four months of test plan/configuration guide preparation 40+ engineers from participating vendors and EANTC Test scenarios in 3-5 groups

5 Autumn Spring Participating Vendors 2012

6 CEWC2012 Interop Network Physical Topology Spirent TestCenter Omnitron GM4 Spirent Paragon-X Ericsson MINI-LINK TN Symmetricom SSU 2000e PackeTime PTP Omnitron GM4 Aviat Eclipse HFR Packet Node CET Omnitron GM4 Ixia IxNetwork Albis ACCEED 1416 Ericsson SPO1460 Omnitron GM4 Ericsson SPO :50:00 Symmetricom Aviat Eclipse Ericsson TimeProvider 5000 Packet Node MINI-LINK SP210 NEC ipaso- LINK 400 IDU Ixia ImpairNet 12:50:00 Symmetricom TimeProvider 5000 Ixia IxNetwork NEC Ericsson MINI-LINK Ericsson ipasolink 400 PT2010 MINI-LINK SP310 HFR CET SIAE ALFOplus80 NEC ipasolink Ericsson 400 IDU MINI-LINK SP310 Ericsson SPO1410 Ixia IxNetwork Spirent TestCenter Omnitron GM4 SIAE ALCplus2e Albis ACCEED 1416 NEC ipasolink 400 Spirent Paragon-X Albis ACCEED 1104 Ixia IxNetwork Albis ACCEED 2202 Ixia ImpairNet Ixia Anue 3500 Ixia IxNetwork Spirent Paragon-X

7 MPLS & Ethernet World Congress 2012 Physical Topology

8 Interoperability Test Areas Carrier Ethernet 2.0 Fault Mgmt, Perf. Monitoring Service Activation E-Access/Wholesale Interconnect Ring Protection Mobile Backhaul Clock Sync (IEEE 1588, SyncE) Multi-CoS Packet Microwave MPLS MPLS-TP Protection VPLS Termination/Interworking IPv6 Migration Scenarios VPN Support Residential Services

9 Carrier Ethernet Technology Status 2011 Visibility MPLS-TP Performance Monitoring Y.1731 Y.1564 Service Activation ERPS SyncE IEEE 1588:2008 Ethernet Microwave Technology Progress Technology Trigger Peak of Expectations Trough of Disillusionment Slope of Enlightenment Plateau of Productivity European Advanced Networking Test Center eantc.com Oct 2011 Hype Cycle model (five stages) Gartner 1995

10 Carrier Ethernet Technology Status 2012 Visibility Y.1564 Service Activation IEEE 1588 Boundary Clocks Multi-Vendor MPLS-TP Multi-Vendor MPLS-TP Single-Vendor ERPS Performance Monitoring Y.1731 SyncE Technology Trigger Peak of Expectations IEEE 1588 Slave Clocks Trough of Disillusionment Ethernet Microwave Slope of Enlightenment Plateau of Productivity Technology Progress European Advanced Networking Test Center eantc.com Sep 2012 Hype Cycle model (five stages) Gartner 1995

11 Carrier Ethernet 2.0: Y.1564 Service Activation Automation Readiness New: Tests done Equipment Configuration QoS (terminated) by access config varies widely devices Test Device Configuration Differing views how automated implement execution in the mind ITU Y.1564 standard Single-ended; Protocol defined with Complexity Variety of test cases built into standard Root Cause Analysis Very time- Excess information rate testing remains a consuming, challenge standard for does now not support segmenting

12 Carrier Ethernet 2.0: Hierarchical Service OAM Automation Readiness Equipment Configuration Multilayer config very complex; quite Complex CLI commands 3 Different domains Alarm Indication (ETH-AIS) Test Device Configuration Again, multi-layer config non-trivial Lock Message (ETH-LCK) Complexity Automation improves control, reduces human errors Test Message (ETH-Test) Root Cause Analysis Extremely time-consuming for latency & partial loss issues

13 Clock Synchronization Transparent Clock Automation Readiness Tested four vendor pairs Equipment Configuration One-off configuration All combinations enables multiple passed test combinations G.823SEC mask Test Device Configuration Alignment of multiple test devices is primary 3% task; Floor impairment Packet generation on multiple lines potentially much more expensive than manual rewiring Packet population using 1- Percentage (FPP) limit as defined in G Complexity Straightforward test Compared correction fields at transparent clock Root Cause Analysis Very timeconsuming for latency variation issues

14 Synchronous Ethernet over Link Aggr. Results Symmetricom SSU 2000 Reference clock Extreme E4G-400 Master Ericsson Mini-Link SP310 Slave Requires versatile data collection API from test equipment

15 Carrier Ethernet Transport Ethernet Ring Protection (ERPS) Automation Readiness Equipment Configuration Physical and logical reconfiguration required for different test cases Two different rings to accommodate different CFM rates supported by vendors Test Device Configuration Major test area of protection requires single family of configurations Complexity Straightforward tests, mostly layer 1 switch config challenge ERPS in access, MPLS- TP in core Root Cause Analysis Performance analysis achieved through combinatory analysis of test runs

16 Introduction of Layer 1 Crossconnect Great idea! DUT1 Network Interfaces DUT3 DUT2 Test Interfaces Physical Layer Crossconnect Test Device 1 Test Device 2 Test Device 3

17 Impairment Generator Introduction of Layer 1 Crossconnect (cont d) Introduction of impairment? DUT1 DUT3 DUT2 Physical Layer Crossconnect Test and Network Interfaces Test Device 1 Test Device 2 Test Device 3

18 Impairment Generator Introduction of Layer 1 Crossconnect (cont d) Scale for number of ports? Crossconnects are not easily stackable DUT1 DUT2 DUT50 Crossconnect 1 Crossconnect 2 Crossconnect 3 Test Device 1 Test Device 2 Test Device 3

19 Time Spent for Manual Interoperability Test Execution 6 weeks Test Plan Development 2 weeks Configuration Planning 2 days Racking and Installation 8 days Test Execution 2 weeks Documentation

20 Conclusion Exact planning required to reap automation benefits for interoperability testing Automation better suited for continued regression testing than for campaign-based testing of new protocols and solutions Introduction of interoperable APIs for advanced test equipment configuration needed for sustainable lab execution model Interoperable APIs for device under test configuration are a dream

21 Further Information 16-page public white papers available free of charge EANTC AG Salzufer 14, Berlin, Germany office