S12700 Agile Switches CSS2 Introduction www.huawei.com Copyright 2014 Huawei Technologies Co., Ltd. All rights reserved.
Preface With the gradual increase of the amount of data access and network reliability requirements for enterprise campus networks and datacenter network, a single switch has been unable to meet the demands, two switches can form a cluster to improve forwarding performance and reliability. This course will mainly introduce Huawei S12700 switch s CSS2(Cluster Switch System Generation2) concepts, applications, principles, configurations. Copyright 2014 Huawei Technologies Co., Ltd. All rights reserved. Page 1
Objectives On completion of this course, you will be able to: Understand the basic concepts of CSS Describe the differences between CSS and CSS2 Describe the applications of CSS2 Master the fundamental of CSS2 Configure CSS2 on S12700 Switch Master maintenance of CSS2 Copyright 2014 Huawei Technologies Co., Ltd. All rights reserved. Page 2
Contents Basic concepts of CSS/CSS2 Applications of CSS/CSS2 Fundamental of CSS2 Configuration of CSS2 Maintaining command of CSS2 CSS&iStack Assistant Copyright 2014 Huawei Technologies Co., Ltd. All rights reserved. Page 3
Introduction to CSS A cluster switch system (CSS), is a logical switch consisting of two clustering-capable switches. The advantages of CSS:High reliability High scalability Simplified configuration and management css link Copyright 2014 Huawei Technologies Co., Ltd. All rights reserved. Page 4
CSS VS CSS2 CSS technology development has experienced two stages: Traditional CSS: clustering through CSS cards on the MPUs and service port connection supported by the S7700 and S9700 Cluster Switch System Generation 2 (CSS2):: by connecting CSS cards on switch fabric units (SFUs) supported by the S12700 Compared with the traditional CSS, CSS2 has the following advantages: Clustering through CSS cards on the SFUs 1+N backup of MPUs in a cluster Copyright 2014 Huawei Technologies Co., Ltd. All rights reserved. Page 5
CSS Connection Modes: CSS Cards on the MPUs Member switches are connected using dedicated CSS cards installed on MPUs and cluster cables. Copyright 2014 Huawei Technologies Co., Ltd. All rights reserved. Page 7
CSS Connection Modes: Service Port Connections Member switches are connected using service ports, without a need for CSS cards. Copyright 2014 Huawei Technologies Co., Ltd. All rights reserved. Page 8
CSS Connection Modes: CSS Cards on the SFUs Member switches are connected using dedicated CSS cards installed on SFUs and cluster cables. applicable to S12708&S12712 applicable to S12704 Copyright 2014 Huawei Technologies Co., Ltd. All rights reserved. Page 9
Software and Hardware Requirements Device Model S12704 S12708 S12712 Software Version V200R008 C00 and later V200R005 C00 and later Whether a License Is Required No No No SFU SFUA/SF UC SFUA/SF UC/SFUD SFUA/SF UD Hot Swap CSS card: hot swappable SFU: hot swappable Hardware Configuration Two member switches of the same or different models can form a CSS. For example, two S12704s can form a CSS; one S12708 and one S12712 can form a CSS. Copyright 2014 Huawei Technologies Co., Ltd. All rights reserved. Page 10
Basic Concepts Master switch: The master switch manages the entire CSS. Standby switch: the backup of the master switch. CSS ID: used to identify and manage member switches in a CSS. Each member switch has a unique CSS ID. CSS priority: A larger value indicates a higher priority that the member switch is elected as the master switch. Switch A Master switch CSS link Switch B Standby switch CSS ID = 1 CSS priority = 200 CSS ID = 2 CSS priority = 100 Copyright 2014 Huawei Technologies Co., Ltd. All rights reserved. Page 11
Contents Basic concepts of CSS/CSS2 Applications of CSS/CSS2 Fundamental of CSS2 Configuration of CSS2 Maintaining command of CSS2 CSS&iStack Assistant Copyright 2014 Huawei Technologies Co., Ltd. All rights reserved. Page 12
Applications of CSS1 and CSS2 Traditional Network Topology VRRP CSS Network Topology S12700CSS2 MSTP NMS S9700 /S7700CSS The logical topology The logical topology Copyright 2014 Huawei Technologies Co., Ltd. All rights reserved. Page 13
Scene 1: Bandwidth Expansion and Inter-Chassis Link Redundancy More physical links on uplink, increasing the uplink bandwidth. Downstream switches connect to the CSS through inter-chassis Eth- Trunks. enhancing network reliability. CSS link Eth-Trunk Data flow before a failure Data flow after a failure Copyright 2014 Huawei Technologies Co., Ltd. All rights reserved. Page 14
Scene 2: Simplifying Network Topology Two switches are virtualized into a logical switch Does not require MSTP Does not require VRRP MSTP + VRRP css link CSS link Eth-Trunk Copyright 2014 Huawei Technologies Co., Ltd. All rights reserved. Page 15
Scene 3:Long-Distance Clustering Long-distance clustering enables switches far from each other to form a CSS The maximum distance can be 80km CSS link Eth-Trunk Building A CSS Building B Copyright 2014 Huawei Technologies Co., Ltd. All rights reserved. Page 16
Contents Basic concepts of CSS/CSS2 Applications of CSS/CSS2 Fundamental of CSS2 Configuration of CSS2 Maintaining command of CSS2 CSS&iStack Assistant Copyright 2014 Huawei Technologies Co., Ltd. All rights reserved. Page 17
CSS Setup Steps of CSS Setup: Role Election Software Version Synchronization Configuration File Synchronization Configuration File Backup Copyright 2014 Huawei Technologies Co., Ltd. All rights reserved. Page 18
CSS Setup(1/4): Role Election The master switch of a CSS is elected based on the following rules: The switch that starts first becomes the master switch. The switch with a higher priority becomes the master switch. The switch with a smaller MAC address becomes the master switch. The switch with a smaller CSS ID becomes the master switch. Copyright 2014 Huawei Technologies Co., Ltd. All rights reserved. Page 19
CSS Setup(2/4): Software Version Synchronization If the software version running on the standby switch is different from that on the master switch, the standby switch downloads the system software from the master switch, restarts with the new system software, and joins the CSS again. Copyright 2014 Huawei Technologies Co., Ltd. All rights reserved. Page 20
CSS Setup(3/4): Configuration File Synchronization CSS technology uses a strict configuration file synchronization mechanism to ensure that member switches in a CSS work like one device. After the standby switch starts, it synchronizes its configuration file with the master switch. When the CSS is running, all the configurations performed by users are recorded in the configuration file of the master switch and synchronized to the standby switch. The configuration file synchronization mechanism ensures that the member switches save the same configuration file. If the master switch fails, the standby switch can take over all services using the same configuration file. Copyright 2014 Huawei Technologies Co., Ltd. All rights reserved. Page 21
CSS Setup(4/4): Configuration File Backup After a switch enters the CSS state, it automatically backs up its configuration file used in standalone state by adding the extension.bak to the configuration file name. After disabling the CSS function, you need to restore the original configuration of a switch manually. Copyright 2014 Huawei Technologies Co., Ltd. All rights reserved. Page 22
CSS Login and File System Access Interface Numbering Rules: Interfaces are numbered in the CSS ID/slot ID/subcard ID/port sequence number format. e.g. GE1/0/1 with CSS ID 2 will change to GE2/1/0/1. Copyright 2014 Huawei Technologies Co., Ltd. All rights reserved. Page 23
CSS Login and File System Access CSS Login Local login: Log in through the console interface on any MPU of the CSS. Remote login: Log in through the management interface or another Layer 3 interface of any MPU in the CSS. Telnet, STelnet, web, and SNMP are supported. After logging in to a CSS, you have actually logged in to the master switch, no matter through which member switch you log in. Copyright 2014 Huawei Technologies Co., Ltd. All rights reserved. Page 24
File System Access To access the root directory of the CF card or flash memory on the system master MPU, set drive to cfcard: or flash:. To access the root directory of the CF card or flash memory on the system standby MPU or candidate system standby MPU, set drive to chassis ID/slot ID#cfcard: or chassis ID/slot ID#flash:. (The chassis ID is the CSS ID.) For example, 1/8#cfcard: means the root directory of the CF card in slot 8 of chassis 1. Copyright 2014 Huawei Technologies Co., Ltd. All rights reserved. Page 25
CSS Feature Features supported by CSS: Cluster Link Aggregation Local Preferential Forwarding New Member Joining CSS Merging 1+N Backup of MPUs in a Cluster CSS Split and MAD Master/Standby Switchover CSS Upgrade Copyright 2014 Huawei Technologies Co., Ltd. All rights reserved. Page 26
CSS feature(1/8): Cluster Link Aggregation Cluster link aggregation can improve network availability Link fails make sure the network normal work Switch fails make sure the network normal work CSS link Eth-Trunk Data flow 1 Data flow 2 Normal Link failure Device failure Copyright 2014 Huawei Technologies Co., Ltd. All rights reserved. Page 27
CSS feature (2/8): Local Preferential Forwarding Switch support the local preferential forwarding feature, which means that traffic reaching the local switch is preferentially forwarded through a local interface. CSS link Eth-Trunk Data flow 1 Data flow 2 Local preferential forwarding not supported Local preferential forwarding supported Copyright 2014 Huawei Technologies Co., Ltd. All rights reserved. Page 28
CSS feature (3/8): New Member Joining A new member switch can join a running single-chassis CSS. Switch A Master CSS ID = 1 priority= 200 Switch B New member CSS ID= 2(predefinded) Switch A Master CSS ID = 1 priority = 200 CSS link CSS ID = 2 priority = 100 Switch B Standby Copyright 2014 Huawei Technologies Co., Ltd. All rights reserved. Page 29
CSS feature(4/8): CSS Merging Two single-chassis CSS systems can merge into one CSS. Switch A Master Switch A Master CSS ID = 1 priority= 100 CSS ID = 2 priority= 200 Switch A Standby CSS Link Switch B Master CSS ID = 1 priority= 100 CSS ID = 2 priority= 200 Copyright 2014 Huawei Technologies Co., Ltd. All rights reserved. Page 30
CSS feature (5/8): 1+N Backup of MPUs in a Cluster 1+N backup of MPUs indicates that a CSS2 cluster set up on two S12700s can run stably as long as one MPU of any chassis in the cluster is working normally. Copyright 2014 Huawei Technologies Co., Ltd. All rights reserved. Page 31
CSS feature(6/8): CSS Split and MAD CSS split CSS Link Master Standby Master Master If a cluster cable, CSS card, MPU, or SFU fails or one switch is powered off or restarted, communication between the two switches is interrupted. When the heartbeat timeout timer (8s) expires, the CSS splits into two single-chassis CSS systems. Through direct links Relay agent Eth Trunk Master CSS Link Standby Master CSS Link Standby Copyright 2014 Huawei Technologies Co., Ltd. All rights reserved. Page 32
CSS feature(7/8): Master/Standby Switchover MPU failures may trigger master/standby switchover events. Roles in a CSS may change if a system MPU of the CSS fails: Figure 1 Changes of roles after a failure of the system master MPU Copyright 2014 Huawei Technologies Co., Ltd. All rights reserved. Page 34
CSS feature(8/8): CSS Upgrade A CSS can be upgraded using the traditional upgrade method (specify the next-startup files and restart the entire CSS) or the fast upgrade function. Process of the fast upgrade The standby switch first restarts with the new system software. Data traffic is forwarded by the master switch during this period. After the standby switch completes the upgrade, it becomes the master switch and starts to forward data traffic. Then the original switch restarts with the new system software. After the original switch completes the upgrade, it becomes the standby switch. If the standby switch fails in the upgrade, it rolls back to the old version. The CSS upgrade fails. Copyright 2014 Huawei Technologies Co., Ltd. All rights reserved. Page 35
Contents Basic concepts of CSS/CSS2 Applications of CSS/CSS2 Fundamental of CSS2 Configuration of CSS2 Maintaining command of CSS2 CSS&iStack Assistant Copyright 2014 Huawei Technologies Co., Ltd. All rights reserved. Page 36
CSS Configuration Notes Features Not Supported in a CSS Synchronous Ethernet clock Notes About Clustering Through CSS Cards on the MPUs If MPUs of S7700 switches have flexible service units (FSUs) installed, the CSS connection mode cannot be set to CSS card connection. Notes About the Service Port Connection Mode Hardware Installation Software Configuration Version Rollback Notes About Clustering Through CSS Cards on the SFUs Copyright 2014 Huawei Technologies Co., Ltd. All rights reserved. Page 37
CSS Configuration Examples(1/8): Networking requirements Switch A and Switch B at the core layer set up a CSS through CSS card connections. Core layer G0/0/1 Network G0/0/2 Switch A is the master switch G1/1/0/4 G2/1/0/4 Switch B is the standby switch Switches at the aggregation layer connect to the CSS through Eth- Trunks. The CSS connects to the upstream network through an Eth-Trunk. Switch A G1/1/0/3 G1/1/0/5 G2/1/0/5 G2/1/0/3 Aggregation layer Switch B G1/0/2 G1/0/1 G1/0/1 G1/0/2 CSS link Eth-Trunk Copyright 2014 Huawei Technologies Co., Ltd. All rights reserved. Page 39
CSS Configuration Examples(2/8): Configuration Roadmap Install CSS cards and connect cluster cables. Set the connection mode CSS IDs and priorities: connection mode:css-card Switch A :ID =1, priority=100 Switch B :ID =2,priority=10 Enable the CSS function on SwitchA and then on SwitchB to ensure that SwitchA becomes the master switch. Check whether a CSS is established successfully Configure downlink Eth-Trunks for the CSS to improve forwarding bandwidth and reliability. Copyright 2014 Huawei Technologies Co., Ltd. All rights reserved. Page 40
CSS Configuration Examples (3/8): Connect cluster cables Connecting cluster cables as follows(applicable to S12708&S12712): Copyright 2014 Huawei Technologies Co., Ltd. All rights reserved. Page 41
CSS Configuration Examples (3/8): Connect cluster cables Connecting cluster cables as follows(applicable to S12704): Copyright 2014 Huawei Technologies Co., Ltd. All rights reserved. Page 42
CSS Configuration Examples (4/8): Configure basic parameters Configure the CSS ID, CSS priority, and CSS connection mode # Set the CSS ID, CSS priority, and CSS connection mode to 1, 100, and CSS card connection for SwitchA. <HUAWEI> system-view [HUAWEI] sysname SwitchA [SwitchA] set css mode css-card [SwitchA] set css id 1 [SwitchA] set css priority 100 # Set the CSS ID, CSS priority, and CSS connection mode to 2, 10, and CSS card connection for SwitchB. <HUAWEI> system-view [HUAWEI] sysname SwitchB [SwitchB] set css mode css-card [SwitchB] set css id 2 [SwitchB] set css priority 10 Copyright 2014 Huawei Technologies Co., Ltd. All rights reserved. Page 43
CSS Configuration Examples(5/8): Enable the CSS function Enable the CSS function on SwitchA and then on SwitchB to ensure that SwitchA becomes the master switch. # Enable the CSS function on SwitchA and restart SwitchA. [SwitchA] css enable Warning: The CSS configuration takes effect only after the system is rebooted. T he next CSS mode is CSS-card. Reboot now? [Y/N]:y # Enable the CSS function on SwitchB and restart SwitchB. [SwitchB] css enable Warning: The CSS configuration takes effect only after the system is rebooted. T he next CSS mode is CSS-card. Reboot now? [Y/N]:y Copyright 2014 Huawei Technologies Co., Ltd. All rights reserved. Page 44
CSS Configuration Examples(5/8):Check CSS Status View the indicator status If the MASTER indicator on a CSS card of SwitchA is steady on, the MPU with the CSS card installed is the master MPU and SwitchA is the master switch. If the MASTER indicator on a CSS card of SwitchB is off, SwitchB is the standby switch. Check whether the CSS is established successfully by command display device display css status display css channel Copyright 2014 Huawei Technologies Co., Ltd. All rights reserved. Page 45
CSS Configuration Examples(5/8): Check CSS status <SwitchA> display css status CSS Enable switch On Chassis Id CSS Enable CSS Status CSS Mode Priority Master Force ------------------------------------------------------------------------------ 1 On Master CSS-Card 100 Off 2 On Standby CSS-Card 10 Off The command output shows the status of css, indicating that the CSS has been established successfully. <SwitchA> display css channel Chassis 1 Chassis 2 -------------------------------------------------------------------------------- Num [Port] [Speed] [Speed] [Port] 1 1/11/0/1 10G 10G 2/11/0/1 2 1/11/0/2 10G 10G 2/11/0/2 3 1/11/0/3 10G 10G 2/11/0/3 31 1/14/0/7 10G 10G 2/14/0/7 32 1/14/0/8 10G 10G 2/14/0/8 -------------------------------------------------------------------------------- The command output shows that all the cluster links are in Up state, indicating that the CSS has been established successfully. Copyright 2014 Huawei Technologies Co., Ltd. All rights reserved. Page 47
CSS Configuration Examples(6/8): Configure Eth-Trunk [HUAWEI] sysname CSS # Configure an Eth-Trunk on the CSS and add uplink ports to the Eth-Trunk. [CSS] interface eth-trunk 10 [CSS-Eth-Trunk10] quit [CSS] interface gigabitethernet 1/1/0/4 [CSS-GigabitEthernet1/1/0/4] eth-trunk 10 [CSS-GigabitEthernet1/1/0/4] quit [CSS] interface gigabitethernet 2/1/0/4 [CSS-GigabitEthernet2/1/0/4] eth-trunk 10 [CSS-GigabitEthernet2/1/0/4] quit # Configure an Eth-Trunk on the CSS and add the downlink ports connected to SwitchC to the Eth- Trunk. [CSS] interface eth-trunk 20 [CSS-Eth-Trunk20] quit [CSS] interface gigabitethernet 1/1/0/3 [CSS-GigabitEthernet1/1/0/3] eth-trunk 20 [CSS-GigabitEthernet1/1/0/3] quit [CSS] interface gigabitethernet 2/1/0/5 [CSS-GigabitEthernet2/1/0/5] eth-trunk 20 [CSS-GigabitEthernet2/1/0/5] quit Copyright 2014 Huawei Technologies Co., Ltd. All rights reserved. Page 48
CSS Configuration Examples(7/8): Configuring MAD in direct mode Network Core layer Switch A Aggregatoin layer G1/2/0/0 G2/10/0/0 Switch B CSS link Eth-Trunk [HUAWEI] interface gigabitethernet 1/2/0/0 [HUAWEI-GigabitEthernet1/2/0/0] mad detect mode direct [HUAWEI] interface gigabitethernet 2/10/0/0 [HUAWEI-GigabitEthernet2/10/0/0] mad detect mode direct <HUAWEI> display mad verbose Current MAD domain: 0 Current MAD status: Detect Mad direct detect interfaces configured: GigabitEthernet1/2/0/0 GigabitEthernet2/10/0/0 Mad relay detect interfaces configured: Excluded ports(configurable): Excluded ports(can not be configured): 40GE1/4/0/0 40GE1/4/0/1 40GE1/5/0/0 40GE1/5/0/1 40GE2/7/0/1 40GE2/7/0/0 Copyright 2014 Huawei Technologies Co., Ltd. All rights reserved. Page 49
CSS Configuration Examples(8/8): Configuring MAD in relay mode Core layer Switch A G1/2/0/5 Network G2/9/0/5 Switch B Configure MAD in relay mode for the inter-device Eth-Trunk. <HUAWEI> system-view [HUAWEI] interface eth-trunk 1 [HUAWEI-Eth-Trunk1] trunkport gigabitethernet 1/2/0/5 [HUAWEI-Eth-Trunk1] trunkport gigabitethernet 2/9/0/5 [HUAWEI-Eth-Trunk1] mad detect mode relay [HUAWEI-Eth-Trunk1] quit Configure MAD in relay mode for the inter-device Eth-Trunk. <HUAWEI> system-view [HUAWEI] sysname SwitchC [SwitchC] interface eth-trunk 1 [SwitchC-Eth-Trunk1] trunkport gigabitethernet 1/0/19 [SwitchC-Eth-Trunk1] trunkport gigabitethernet 1/0/21 [SwitchC-Eth-Trunk1] mad relay [SwitchC-Eth-Trunk1] quit G1/0/19 G1/0/21 Aggregatoin layer CSS link Eth-Trunk Check detailed MAD configuration of the CSS. <HUAWEI> display mad verbose Current MAD domain: 0 Current MAD status: Detect Mad direct detect interfaces configured: Mad relay detect interfaces configured: Eth-Trunk1 Excluded ports(configurable): Copyright 2014 Huawei Technologies Co., Ltd. All rights reserved. Page 50
Contents Basic concepts of CSS/CSS2 Applications of CSS/CSS2 Fundamental of CSS2 Configuration of CSS2 Maintaining command of CSS2 CSS&iStack Assistant Copyright 2014 Huawei Technologies Co., Ltd. All rights reserved. Page 51
Monitoring CSS status display css status Check the CSS status. display css channel Check cluster link connections and status. display css port Check status of CSS ports in CSS card connection mode. display css css-port Check the configuration of logical CSS ports and physical member ports when the CSS is set up through service port connections. Copyright 2014 Huawei Technologies Co., Ltd. All rights reserved. Page 52
Performing a Master/Standby switchover Slave switchover enable enable master/standby switchover Slave switchover perform a master/standby switchover Copyright 2014 Huawei Technologies Co., Ltd. All rights reserved. Page 53
Upgrading CSS Software Procedure: Load the new system software version to the master MPU of the CSS. Run the startup system-software system-file all command to configure the software file name all the MPUs use for next startup. Run the reboot command to upgrade the CSS using the system restart method. Run the css fast upgrade command to quickly upgrade the CSS. Copyright 2014 Huawei Technologies Co., Ltd. All rights reserved. Page 54
System restart VS Quick upgrade System restart Command :reboot May cause service interruption for a relatively long period of time. Elect master switch by priority and MAC address. Quick upgrade Command:css fast upgrade Ensure uninterrupted service forwarding during the upgrade, minimizing the impact of the upgrade on services. The original standby switch becomes the master switch. The original master switch becomes the standby switch. Copyright 2014 Huawei Technologies Co., Ltd. All rights reserved. Page 55
Contents Basic concepts of CSS/CSS2 Applications of CSS/CSS2 Fundamental of CSS2 Configuration of CSS2 Maintaining command of CSS2 CSS&iStack Assistant Copyright 2014 Huawei Technologies Co., Ltd. All rights reserved. Page 56
CSS&iStack Assistant Usage Guide(1/4) 1 Choose Switch series 2 Next Visit the link : http://support.huawei.com/onlinetoolsweb/virtual/en/s/css_index.html Copyright 2014 Huawei Technologies Co., Ltd. All rights reserved. Page 57
CSS&iStack Assistant Usage Guide(2/4) 1 Choose MPU type, CSS mode 2 Next Visit the link : http://support.huawei.com/onlinetoolsweb/virtual/en/s/css_index.html Copyright 2014 Huawei Technologies Co., Ltd. All rights reserved. Page 58
CSS&iStack Assistant Usage Guide(3/4) 1 Choose LPU, Cluster cable 2 Submit Visit the link : http://support.huawei.com/onlinetoolsweb/virtual/en/s/css_index.html Copyright 2014 Huawei Technologies Co., Ltd. All rights reserved. Page 59
CSS&iStack Assistant Usage Guide(4/4) 1. CSS precautions 2. Connect Cluster Cables 3. Configure Software 4. Check CSS Status 5. Maintain CSS Visit the link : http://support.huawei.com/onlinetoolsweb/virtual/en/s/css_index.html Copyright 2014 Huawei Technologies Co., Ltd. All rights reserved. Page 60
Summary Basic concepts of CSS/CSS2 Applications of CSS/CSS2 Fundamental of CSS2 Configuration of CSS2 Maintaining command of CSS2 CSS&iStack Assistant Copyright 2014 Huawei Technologies Co., Ltd. All rights reserved. Page 61
Questions Which kinds of CSS modes do S7700/9700 switches support( ), which kind of modes do S12700 switches support( )? A: CSS cards on the MPUs B: Service port connections C: CSS cards on the SFUs D: istack Which of following statements is true about CSS select the master switch( )? A. The switch CSS state first finish becomes the master switch B. The switch with a higher priority becomes the master switch C. The switch with a smaller MAC address becomes the master switch D. The switch with a smaller CSS ID becomes the master switch Copyright 2014 Huawei Technologies Co., Ltd. All rights reserved. Page 62
Learning Recommend CSS&iStack Assistant http://support.huawei.com/onlinetoolsweb/virtual/en/s/css_inde x.html S12700 Product Documentation http://support.huawei.com/ehedex/hdx.do?docid=doc1000081 661&lang=en&idPath=7919710%7C9856733%7C7923144%7 C20985028&clientWidth=1562&browseTime=1453173198466 Copyright 2014 Huawei Technologies Co., Ltd. All rights reserved. Page 63
Thank you Thank you www.huawei.com