CERTIFICATE P3 communications GmbH hereby certifies that ACHIEVED BEST IN TEST in the Mobile Benchmark Country 11/2018. Score 907 of 1000 in Total Score 290 of 340 in Voice Services Score 485 of 510 in Data Services Score 132 of 150 in Crowdsourced Quality Hakan Ekmen CEO Makedonski Telekom
MEASUREMENT OVERVIEW MEASUREMENT SETUP Drivetest Voice Data Device Samsung Galaxy S8 Samsung Galaxy S8 Test Cases Mobile-to-Mobile (M2M) Side1 (4G preferred: Volte) to Side2 (4G preferred: Volte) 115 sec call window 70 sec call duration 15 sec call setup timeout Multi-RAB traffic injection on both sides Data 4G preferred CA HTTP DL datastream 7s HTTP UL datastream 7s HTTP 3MB DL fixed file transfer HTTP 1MB UL fixed file transfer Web Browsing - Kepler ETSI Ref. Page 8 Live web pages (4 http / 4 https) 2 YouTube HD video ~ 45s 1 YouTube live stream ~ 45s Mobility and Route Types 100% Drivetest 57% in Cities, 9% in Towns and 34% on Roads Cities, towns and roads (small country approach) Samples ~1480 per Operator ~1290 per Operator Dates 8 measurement days 05.11.2018 13.11.2018 Crowd Data Assessment Dates Crowd Coverage and User Download Speed August-October 2018 Crowd Data Service Availability March 2018 October 2018 P3 COMMUNICATIONS GMBH tested and measured the performance of its voice and data services on smartphones in comparison to other LTE/UMTS/GSM mobile radio networks in metropolitan and rural areas of Macedonia. The audit was done as a performance benchmark performed by P3 communications between 05.11.2018 and 13.11.2018 in cities and towns as well as on connection roads. Dedicated measurements have been executed as drive tests outdoors using a Samsung Galaxy S8 cat16 Smartphone 1000 Mbit/s Download / 105 Mbit/s Upload. All data measurements have been performed in 4G preferred mode. Voice measurements have been done in 4G/4G preferred mode on both sides, while call origin has been alternated. In addition crowdsourced performance data has been collected and evaluated between March and October 2018. The following pages provide a comparative overview about the performance results observed for the different tested service types. 2
TESTING AREAS DRIVE ROUTE Tetovo Kumanovo Skopje Sve Nikole Gos var Veles S p Radovish Kichevo Krushevo Prilep Kavadarci Nego no Strumica Labunishta Veleshta Struga Ohrid Bitola Bogdanci Gevgelija Cities Towns Roads 54 % of population measured 2900 km measuring distance 3
TESTING AREAS CROWDSOURCING TESTED AREA 878 populated areas ca. 3512 km 2 size of tested area 4
CLAIMS BEST IN TEST BEST IN DATA BEST IN VOICE BEST IN CROWD- SOURCED QUALITY 5
SCORE POINTS AND BREAKDOWN ACHIEVED THE HIGHEST TOTAL SCORE AMONG COMPETITORS WITH 907 POINTS OUT OF MAXIMUM 1000. TOTAL SCORE Telekom Operator 2 Voice max. 340 290 289 Overall 340 85% 85% Data max. 510 485 446 Overall 510 95% 87% Crowdsourced Quality max. 150 132 112 Crowd 150 88% 75% Total 1000 907 847 Shown scores are rounded. Total Score 1000 Points 907 847 CROWD max. 150 132 112 DATA max. 510 485 446 VOICE max. 340 Operator Shown total scores are rounded 290 Telekom 289 Operator 2 TOTAL SCORE The graphic indicates the score points achieved by the networks under test in the modules Voice Data Services and Crowd. 6
The following table indicates the achieved percentage of the maximum score in each of the different data services. Data Service Group max. Telekom Operator 2 Web Browsing 113.3 92% 85% Overall File Download 141.7 93% 85% File Upload 141.7 97% 86% YouTube 113.3 98% 87% VOICE KPI OVERVIEW The following table indicates the achieved values of all networks under test in each of the relevant Voice Key Performance Indicators (KPIs). Voice Service Group Unit Telekom Operator 2 Qualifier [%] 99,1 98,9 Overall Call Setup Time [s] 4,5 4,3 Call Setup Time P90 [s] 6,0 5,9 AVG Speech Quality [MOS-LQO] 3,6 3,7 7
DATA KPI OVERVIEW The following table indicates the achieved values of all networks under test in each of the relevant Data Key Performance Indicators (KPIs). Data Overall KPI Name Unit Telekom Operator 2 Qualifier [%] 99,5 98,6 HTTP Live Page DL Time to first Byte [ms] 509 471 KBytes first second [KB] 698 627 HTTP Static Page DL Qualifier [%] 99,8 98,9 AVG Session Time [s] 1,0 1,5 Qualifier [%] 99,9 99,5 HTTP file DL 3MB AVG Session Time [s] 0,9 1,5 90% faster than [kbit/s] 16327 12759 10% faster than [kbit/s] 82474 51724 Qualifier [%] 99,5 99,0 HTTP file UL 1MB AVG Session Time [s] 0,6 1,0 90% faster than [kbit/s] 13889 7075 10% faster than [kbit/s] 24845 17058 Qualifier [%] 100,0 99,3 HTTP DL FDTT 7s AVG throughput [kbit/s] 65252 52014 90% faster than [kbit/s] 24265 16598 10% faster than [kbit/s] 115523 92250 Qualifier [%] 99,9 98,0 HTTP UL FDTT 7s AVG throughput [kbit/s] 47029 37205 90% faster than [kbit/s] 21430 10795 10% faster than [kbit/s] 63771 59132 Qualifier [%] 99,8 98,6 YouTube Start Time [s] 1,3 1,3 Playouts w/o interruptions [%] 100,0 99,8 AVG Resolution [p] 1078 1070 Qualifier [%] 99,7 98,3 YouTube Live Start Time [s] 2,6 2,2 Playouts w/o interruptions [%] 99,8 98,8 AVG Resolution [p] 1086 1077 8
P3 communications GmbH Hakan Ekmen, hakan.ekmen@p3-group.com, +49 151 571 33 235 Ralf Zartenar, ralf.zartenar@p3-group.com, +49 151 571 33 350 Am Kraftversorgungsturm 3 52070 Aachen Germany +49 241 9437 400 www.p3-group.com info.communications@p3-group.com