ONOS Performance Test. Jin Huawei HUAWEI TECHNOLOGIES CO., LTD. HUAWEI TECHNOLOGIES CO., LTD. Page 1

Transcription

1 ONOS Performance Test Jin Huawei Page 1 HUAWEI TECHNOLOGIES CO., LTD. HUAWEI TECHNOLOGIES CO., LTD.

2 Project: ONOS Performance Benchmark and Improvement Why we need this performance test? External 1. Benchmark reports are around the industries. 2. Different versions, operations can leads to different results. 3. Anyway, people will ask you about that. Internal 1. Developers do testing base on the need of Quality Assurance. 2. There are bunch of professional testing devices out there. 3. Some problem can be seem through benchmarking. ONOS NB VTN RESTConf Performance 1 node v.s. 3 nodes Time (ms) Network Subnet Port Router FloatingIP Router Interface Network Subnet Port Router FloatingIP Network Subnet Port Router FloatingIP Router Interface FloatingIP Router Port Subnet Network Create Add Update Read Remove Delete 1 Node 3 Nodes Page 2

3 Project: ONOS Performance Benchmark and Improvement What is ONOS Performance Benchmark and Improvement Project A long term performance benchmark project in ONOS community. ON.Lab, CAICT, SDN Lab and Huawei are contributing to the project Provides mutual-agreed methodology to test on ONOS controller scenarios (OpenFlow, BGP-LS, PCEP...). Use the benchmark result as a reflection of ONOS s performance and reference to improve ONOS. Benchmarking Design Benchmark Method System Improvement Methodology Improvement Analysis Result By analyzing result: 1. Reference to improve controller s performance 2. Alter test methods to be more reliable Page 3

4 ON Lab: Testing Tool Deploy ONOS controllers (s!) Configure ONOS controllers Set up test scenario 1. Too many operation needs. 2. Different groups doing the test can configure the controller in different ways. 3. Some performance tests are capturing the time in ms, manual operation wouldn t work. Capture test result Page 4

5 ON Lab: Testing Tool TestON Framework Configuration: Parameter Topology Dependency Driver API CLI REST TestON Test Executor TestBench Node: Java Environment Maven, Karaf ONOS TestON Framework Southbound Devices ssh keyless access SDN Cluster Test Node: Java Environment OpenFlow Protocol Mininet Spirent Test Center Tradition Protocol TestON Framework: 1. Design desired testing case, drive 2. Edit configure file 3. Executor will first set up testing environment (controller cluster, devices etc.) 4. Collect result through automatically Page 5

6 ON Lab: Testing Tool 1. TestON/Core is where the test is paresd and executed. 2. Drivers are a collection of functions that belong to a specific test components. 3. Test Suite File: there are three main files that define a specific test: I..topo file: defines all the components and options that TestON will use to execute test. II..param file: is a custom file in order to modularize the test case III..py: this is where all of the test-cases are written. It calls upon functions implemented. Page 6

7 Demo 1: ONOS Batch Flow Response Time (SCPFbatchFlowResp) Test Tool Initial status check (REST) 1. detect device ids 2. detect flows on each devices (require to detect device ids again) Prepare flows to add Generate random flows based on deivice_ids Prepare flows information in queue for multi-thread posting Add flows (REST) 3. post flows to add (add controller time) Confirm flows (REST) recursively 4. check flows on each devices (require to detect device ids again) (add confirm time) Remove flows (REST) 5. 1 delete flows that added (1 flow per call) 5. 2 delete all flows (200 flows per call) (remove controller time) Confirm flows (REST) recursively 6. check flows on each devices (require to detect device ids again) (remove confirm time) ONOS OVS Mininet (15, 31, 63) Page 7

8 Demo 2: ONOS OpenFlow Capacity SDN Servers Virtual Machine Setup Environment VM 1 VM 2 10G Switch /21 CPU RAM 8 Core 8 GB VM 3 VM 4 OS Ubuntu Linux generic x86_64 VM 5 VM 6 Spirent Test Center JVM Oracle 1.8.0_91 8G of java heap Default garbage collector VM 7 Page 8

9 How to contribute What you can contribute to this project: Testing Methodologies Southbound Simulation Contribute to TestON Automation Test Case External Testing Tool s Driver Mininet Thank you and Welcome! Page 9