NETWORK & SERVICE QUALITY BENCHMARKING REPORT: MOSCOW vs LONDON

Transcription

1 NETWORK & SERVICE QUALITY BENCHMARKING REPORT: MOSCOW vs LONDON

2 Introduction This document presents an overview of an independent audit of Dual Mode services performance. The purpose of this audit was to deliver a clear comparison of the services offered by Beeline, Megadon and MTS in Moscow, and Vodafone, O2, Orange and 3 in London. In order to deliver the requested assessment, a series of independent drive tests were carried out in both cities. Detailed description of the measurement methodology, scenarios and equipment is presented in the following part of this report. The parameters measured and subsequently generated KPIs (Key Performance Indicators) represent the end user perspective (QoE). The research summary covers selected network KPIs including: Voice Service Non-Accessibility, Voice Cut-off Call Ratio, Voice Service Access Time, FTP Mean User Data Rate, FTP IP-Service Access Time and Session Failure Ratio; all presented below.

3 General information Both measurements were performed in drive mode using high-end modular systems Diversity Benchmarker manufactured by SwissQual AG, equipped with Nokia C5 phones and PCTel Seegull EX scanners. SwissQual Diversity Benchmarker has been designed especially for extreme robustness for QoE and QoS benchmarking drive test in demanding environment. Data collection equipment: Voice measurement sets installed in the measurement cars, each consisting of: 1 x SwissQual Diversity CBM (FW ver 01.08) 1 x SwissQual Diversity PCM (SW ver 11.1) with PCTel SeeGull 4 x SwissQual Diversity PCM (SW ver 11.1) with SwissQual Diversity MCM with Nokia C5 Diversity Voice Call Server (SW ver 11.1) 2 Data measurement set installed in the measurement cars consisting of: 1 x SwissQual Diversity CBM (FW ver 01.08) 1 x SwissQual Diversity PCM (SW ver ) with PCTel SeeGull 3 x SwissQual Diversity PCM (SW ver ) with Sierra Wireless AirCard 503 Data Card All the post-processing was made based on SwissQual NQDI 11.1 post-processing tool and MS SQL tools. During the tests, more than 1,000 voice calls and 1,000 data connection attempts were made per operator in order to assess the quality of Beeline, Megafon, MTS in Moscow and Vodafone, O2, Orange and 3 in London networks quality. This summary covers the most sensitive for users parameters.

4 How often I cannot make a call? Voice Service Non-Accessibility represents the ratio between unsuccessful call attempts and all made attempts (both successful and unsuccessful). It is a probability that a subscriber cannot make a call. The leaders are MTS, Beeline and O2. The average level of failed call attempts is lower in Moscow than in London. KPI Beeline Megafon MTS Vodafone Orange O2 3 Count Voice Service Non-Accessibility Total [%] 1.56% 2.64% 0.75% 1.86% 2.57% 1.57% 1.64% Avg in city 1.65% 1.91%

5 How often the call is dropped? Voice Cut-of call ratio represents the ratio between dropped calls and all successfully started calls. It is a probability that a subscriber s call will be dropped. The leaders are MTS, Megafon and O2. Average result for Moscow is better than for London. Count Voice Cut-of call ratio Total [%] 1.20% 0.51% 0.11% 1.50% 2.07% 1.19% 1.57% Avg in city 0.61% 1.58%

6 How long do I have to wait to get voice connection? Voice Service Access Time is time lag between the moment of call initiation to the moment when voice service is activated. The leaders are 3, MTS and Beeline that shared 3 rd place with О2. The shortest average time of Voice Service Activation is in London. Min Voice Service Access Time Max Avg Avg in city 4.25 sec 4.19 sec

7 How fast is Internet? FTP Mean User Data Rate is a value of data throughput. It measures the actual speed of data transfer for downloading 10 MB from RBC server. The leader is MTS, Megafon and 3. The maximum speed of data transfer is better in Moscow, but London leads by the average speed of downloading. Max, Mbps FTP Mean User Data Rate Avg, Mbps Avg in city, max/avg 10.2 Mbps / 2.8 Mbps 7.0 Mbps / 3.0 Mbps

8 How fast does network response? IP-Service Access Time measures time needed to establish network connection to the server (between requests from subscriber equipment and the response). The leaders are Megafon, MTS and Vodafone. The shortest average IP-service access time is in Moscow. Min IP-Service Access Time Max Avg Avg in city 3.17 sec 4.21 sec

9 How often the session cuts? Session Failure Ratio is a probability of subscribers' internet session disruption. The best results are shown by 02, 3 and Orange. The probability of subscribers' internet session disruption is less in London. Session Failure Ratio Avg 2.48% 1.62% 1.55% 2.12% 0.90% 0.33% 0.57% Avg in city 1.88% 0.98%