TOLLY. No December 2001 Fujitsu, Ltd. GeoStream R940 IP Switching Node Performance Evaluation. Cause

Transcription

1 T H E TOLLY G R O U P No December 2001 GeoStream R940 IP Switching Node Performance Evaluation Test Summary Premise: Carrier-class routers designed for the core backbone of the Internet must exhibit the capability of delivering high throughput and low latency for IP and MultiProtocol Label Switching (MPLS) traffic flows. Additional features and functionality, such as packet filtering should not affect router performance or latency. Such routers should also provide failover redundancy to assure minimal service interruption for networks. commissioned The Tolly Group to evaluate its GeoStream R940 IP Switching Node, a high-performance router designed for use in Internet service provider backbone networks. Tolly Group engineers conducted a battery of tests ranging from an evaluation of system redundancy and interoperability of standard protocols (RIP/OSPF/BGP/ MPLS), to baseline IP and MPLS forwarding and latency measurements. Testing took place in December Results Delivers high availability due to unit redundancy realizing minimal interruption 0 for power failure, 19.3 microseconds for processing-module failure Executes on-line software upgrade with almost no interruption just 524 microseconds Demonstrates compatibility with Cisco router and Juniper M5 router for RIP, OSPF, BGP and MPLS routing protocols Achieves full line-rate forwarding and maintains performance even when ancillary features like packet filtering are enabled Cause Test Highlights Average service interruption Power failure 0 Processor module failure Online software upgrade GeoStream R940 Availability Benchmarks 19.3 microseconds 524 microseconds Source: The Tolly Group, December 2001 Figure 1 Redundant Unit Fail-over When engineers simulated a power failure by turning off the power switch for half of the duplicated power system, they observed zero downtime. When engineers simulated a processor module failure by removing the processor controller card, they recorded minimal downtime of 19.3 microseconds on average. An important fact to note is that since 2002 The Tolly Group Page 1

2 GeoStream R940 Zero-Loss Throughput 16-Port, Gigabit Ethernet as Reported by RouterTester % 100% 100% 100% 100% 100% 100% Percentage of theoretical maximum throughput Baseline IP Baseline MPLS Longest-match lookup Packet filtering 1 64 byte IMIX port IMIX tests were not conducted for packet filtering. 2 The packet-length distribution is a composite of the following ratio of IP packet lengths: 56.05% of 64-byte; 4.55% of 76-byte; 16.67% of 576-byte; and 22.73% of 1,500-byte. Source: The Tolly Group, December 2001 Figure 2 the BGP forwarding table was duplicated onto the redundant system controller card, downtime virtually is eliminated in the event of controller card failure. On-line Software Upgrade Feature Verification Test results show that an average of 524 packets were lost from an advertised rate of 1,000,000 packets per second while engineers performed an on-line software upgrade, demonstrating that the switchover from an active controller to a standby controller (that is necessary for performing the upgrade) consumes approximately 524 microseconds. Microseconds GeoStream R940 Latency 16-Port, Gigabit Ethernet as Reported by RouterTester Baseline IP byte IMIX 68.2 Baseline MPLS The packet-length distribution is a composite of the following ratio of IP packet lengths: 56.05% of 64-byte; 4.55% of 76-byte; 16.67% of 576-byte; and 22.73% of 1,500-byte. Source: The Tolly Group, December 2001 Figure The Tolly Group Page 2

3 Interoperability Features Verification Test results demonstrate that the GeoStream R940 can interoperate successfully with both Cisco and Juniper M5 routers via RIPv1/v2, BGP4, OSPFv2 and MPLS-LDP routing protocols. Baseline IP Forwarding and Latency Measurements Test results show that the GeoStream R940 forwarded 100% of line rate for 64-byte IP packets with zero loss and delivered average latency of less than one millisecond at the zero-loss rate for up to two ports per line card or 50% of the line card s port capacity. When traffic distribution was altered to represent a more real-world traffic scenario than forwarding continuous streams of 64-byte packets, the GeoStream R940 forwarded at levels similar to the 64-byte test, although latency increased slightly from 72.1 microseconds to microseconds. (See Figures 2 and 3.) Longest-Match Lookup Times In these tests, engineers sought to verify that there is no impact of route lookups for mixedlength prefixes on device forwarding rates and latency. Testing demonstrated that regardless of the lookup, performance was not affected. (See Figures 2.) Packet Filtering Engineers determined the point at which packet-filtering rules degrade the forwarding rate or impact the average latency. Test results show that all filter types tested work as expected by allowing or denying traffic based on ingress or egress ports. Furthermore, average latency is not increased while processing filter rules on packet streams. (See Figure 2.) Baseline MPLS Forwarding and Latency Testing demonstrated that the GeoStream R940 forwarded 100% of line rate for 64-byte MPLS packets with zero loss for up to two ports per line card and delivered average latency of less than one millisecond at the zero-loss rate. When the traffic distribution was altered to represent a more real-world traffic scenario than forwarding continuous streams of the same packet, the GeoStream R940 forwarded at levels similar to the 64-byte test, although latency increased slightly from 68.2 microseconds to microseconds. (See Figure 3.) Analysis This series of tests demonstrates that the Fujitsu GeoStream R940 IP Switching Node maintains a high level of availability due to both the redundant power supply and main controller module. Tests of these components revealed minimal to no service interrup- GeoStream R940 IP Switching Node Performance Evaluation GeoStream R940 IP Switching Node Product Specifications* Switching capacity: 40 Gbit/s IP packet handling capacity: 48 million packets/s (OC-3c POS, 40 bytes/packet) Expansion: Eight 2.5 Gbit/s slots Redundancy: Control module, switching module, packet-forwarding module, power supply, 1+1 Automatic Protection Switching (POS/ATM) Interfaces: POS: OC-3c/STM-1, OC-12c/STM-4, OC-48c/STM-16 ATM: OC-3c/STM-1, OC-12c/STM-4 Ethernet: 1000Base-SX/LX, 10/100Base-T Protocols: IPv4: Static, RIP/RIPv2, OSPFv2, BGP4, IGMP/IGMP2, PIM-SM IPv6: Static, RIPng, OSPFv3, BGP4+ MPLS: LDP, RSVP-TE Filtering: IP address, ToS/DSCP, protocol, port number Traffic engineering: MPLS-TE QoS: DiffServ VPN: BGP/MPLS VPN, VLAN- VPN mapped MPLS Management: CLI, Telnet, FTP, SNMP Power: DC-48V, AC 200V Operating temperature: 5 C to 40 C Humidity: 5% to 85% RH Size (WxDxH): 484mm x 699mm 950mm Weight: Maximum of 180 kg Power consumption: Max. of 1,920 watts For more information contact: Global Business Group Solid Square East Tower 580 Horikawa-cho, Saiwai-ku, Kawasaki JAPAN Phone: Fax: URL: * Vendor-supplied information not verified by The Tolly Group 2002 The Tolly Group Page 3

4 Performance Test Bed Fast Ethernet Four (Used with module-level lest) or 32 (Used with system-level test) Gigabit Ethernet connections Console Agilent RouterTester with Eight 4-port Gigabit Ethernet modules Agilent RouterTester with Eight 4-port Gigabit Ethernet modules Fujitsu GeoStream R940 with Eight 4-port Gigabit Ethernet modules (SUT) Source: The Tolly Group, December 2001 Figure 4 tion associated with a component failure, 0 for power failure, 19.3 microseconds for processing module failure. Testing also validated that the GeoStream is capable of continually forwarding traffic with almost no interruption (524 microseconds) even while software is being updated on line. Many service providers need to know that the devices they deploy in the network are compatible with others already implemented as part of an existing infrastructure. Testing validated that the GeoStream R940 is compatible with both the Cisco and the Juniper M5 routers for most of the significant routing protocols. IP and MPLS forwarding performance tests demonstrated that the GeoStream R940, when utilizing four-port Gigabit Ethernet modules, was capable of forwarding up to 2.5 Gbit/s of IP traffic without packet loss at all packet sizes tested, regardless of the total number of modules present in the chassis. Latency measurements for all tests were well below the millisecond threshold. In tests where two ports per module or 16 ports per system were utilized, the GeoStream R940 was capable of full linerate throughput for the utilized ports without packet loss, for all packet sizes tested, with the only limitation due to the line card processing capacity of the system under test. Each module has a maximum throughput level of 2.5 Gbit/s for a total system throughput of 20.1 Gbit/s when fully populated with eight 4-port Gigabit Ethernet interface modules a total of 32 Gigabit Ethernet ports. Additional tests demonstrate that there was no performance degradation when additional functions, such as access control lists, were enabled. Test Configuration and Methodology The Tolly Group tested a Fujitsu GeoStream R940 IP Switching Node, software version E10V01L00C91 (and version E10V01L00C86 for MPLS testing), outfitted with eight Gigabit Ethernet modules and configured to support Border Gateway Protocol 4 (BGP4) protocol. For module-level performance tests, the GeoStream was connected to an Agilent Technologies RouterTester equipped with a 4-port Gigabit Ethernet E7904A module and an HP Netserver LP 1000R controller running NT SVR 4.0, SP6. All interfaces connected via Gigabit Ethernet. Tests of IP and MPLS forwarding and latency tests also included system-level performance tests in which the aforementioned GeoStream equipped with eight 4-port Gigabit Ethernet line 2002 The Tolly Group Page 4

5 Interoperability Test Bed Agilent RouterTester (OSPF, BGP, MPLS) Cisco Router Fast Ethernet OR Gigabit Ethernet Fast Ethernet Console Fast Ethernet Linux / Zebra PC (RIP) Fujitsu GeoStream R940 (SUT) Juniper M5 Router Source: The Tolly Group, December 2001 Figure 5 cards connected to eight Agilent RouterTesters modules via Gigabit Ethernet. (See Figure 4.) For tests of RIP interoperability, engineers connected a Linux/ Zebra PC, Fujitsu FMV-CX357, running the Vine Linux operating system to the GeoStream R940 via Fast Ethernet. The GeoStream R940 connected via Fast Ethernet to a Cisco Systems 12012, running a Cisco IOS 12.0(18)ST and a Juniper Networks, M5, running the 5.1R1.4 operating system at same time. For tests of BGP, OSPF, and MPLS interoperability, engineers connected an Agilent RouterTester to the GeoStream R940 via Gigabit Ethernet. The GeoStream R940 connected via Fast Ethernet to a Cisco Systems 12012, running a Cisco IOS 12.0(18)ST and a Juniper Networks, M5, running 5.1R1.4 operating system at the same time. (See Figure 5.) For tests of zero-loss throughput and latency tests of IP traffic, engineers sent packets to each interface on the test bed. Router- Tester tests advertised over 120,000 BGP routes and traffic flows consisting of either 64-byte IP packets or a mix of packet sizes 1 designed to simulate traffic traditionally found on the Internet. Zero-loss throughput tests were at 100% of line rate and decreased by 1% increments of line rate until zero loss was obtained. For tests of longest-match lookup times, RouterTester advertised over 100,000 BGP long prefixes (i.e. 24-bit mask), plus 20,000 shorter prefixes (16-bit mask); engineers compared the test results against baseline results. For tests of packet filtering, engineers configured four filters covering as many items as there are prefixes of that length (i.e., prefixes from /16 to /24) on the device under test, two on the ingress port and two on the egress port. These filters were set for ALLOW or DENY. The RouterTester generated a known number of 64-byte IP packets that hit every prefix in the routing tables. Engineers compared results to baseline results. For tests of baseline packet forwarding and latency of MPLS traffic, engineers configured RouterTester to initiate four label-switched paths (LSPs) for module-level tests and 16 LSPs for system-level tests, at each edge interface one label for each of the possible destination interfaces. Again, Router- Tester offered 64-byte IP packets or a mix of packet sizes 2 designed 1 The packet-length distribution is composed of the following ratio of IP packet lengths: 56.05% of 64-byte; 4.55% of 76-byte; 16.67% of 576 byte; and 22.73% of 1,500-byte. 2 The packet-length distribution is composed of the following ratio of IP packet lengths: 56.05% of 64-byte; 4.55% of 76-byte; 16.67% of 576 byte; and 22.73% of 1,500-byte The Tolly Group Page 5

6 to simulate traffic traditionally found on the Internet. Traffic was offered at 100% of line rate and decreased by 1% increments of line rate until zero loss was obtained. For interoperability tests, engineers configured the Agilent Router-Tester to advertise 1,000 routes via BGP4, OSPFv2 and MPLS-LDP routing protocols. For interoperability tests using RIP, engineers configured the Zebra PC to advertise 1,000 routes via RIPv2. Engineers verified the routing table in each router and the successful passing of traffic across the routers via the PING command. All connections were via Fast Ethernet. Engineers performed three iterations of each test. For redundant unit fail-over tests, engineers configured the device under test with both redundant power supplies and controller cards. Engineers then simulated a processor module fail-over by removing a controller card or a power failover by turning off the power switch for half of the duplicated power system. Agilent s RouterTester recorded the number of lost packets, if any, during fail-over. If a packet is transferred at a known rate, then the time during which the packet cannot be passed through the device under test can be estimated based on the number of lost packets during fail-over. For on-line software upgrade tests, engineers configured one Agilent RouterTester to pass unidirectional traffic to another Agilent RouterTester via the GeoStream R940. Engineers then conducted a software-file upgrade by command operation and verified the file-upgrade by checking the software file version number. The RouterTester recorded the number of lost packets, if any, during the file upgrade process. The Tolly Group gratefully acknowledges the providers of test equipment used in this project. Vendor Product Web address Agilent Technologies RouterTester Tolly Group Services With more than a decade of testing experience of leadingedge network technologies, The Tolly Group employs time-proven test methodologies and fair testing principles to benchmark products and services with the highest degree of accuracy. Plus, unlike narrowly focused testing shops, The Tolly Group combines its vast technology knowledge with focused marketing services to help clients better position product benchmarks for maximum exposure. The company offers an unparalleled array of reports and services including: Test Summaries, Tolly Verifieds, performance certification programs, educational Webcasts, white paper production, proof-of-concept testing, network planning, industry studies, end-user services, strategic consulting and integrated marketing services. Learn more about The Tolly Group services by calling (732) , or send to info@tolly.com. For info on the Fair Testing Charter, visit: Project Profile Sponsor: Document number: Product class: Carrier-class IP Router Products under test: Fujitsu GeoStream R940 IP Switching Node Testing window: December 2001 Software versions tested: Fujitsu GeoStream R940, version E10V01L00C86 Fujitsu GeoStream R940, version E10V01L00C91 Software status: Generally available Additional information available: Configuration Files Files For more information on this document, visit our Web site at send to info@tolly.com, or call (732) Internetworking technology is an area of rapid growth and constant change. The Tolly Group conducts engineering-caliber testing in an effort to provide the internetworking industry with valuable information on current products and technology. While great care is taken to assure utmost accuracy, mistakes can occur. In no event shall The Tolly Group be liable for damages of any kind including direct, indirect, special, incidental, and consequential damages which may result from the use of information contained in this document. All trademarks are the property of their respective owners. The Tolly Group doc rev. clk 06 Feb The Tolly Group Page 6