Mobile Network Testing. SmartMonitor Product overview. Walter Yoong. 10 May 2017

Transcription

1 Mobile Network Testing Product overview Walter Yoong 10 May 2017

2 Service Quality Monitoring Service Quality Monitoring QualiPoc Android Probe 2

3 Service Quality Monitoring Market trends ı More unattended drive tests, data collection and monitoring. ı Monitor and detect network service instabilities, errors or service drops in real time ı QoE based optimization ı The RAN is more dynamic (e.g. C-RAN) so also optimization must be more versatile and more real time. 3

4 Service Quality Monitoring Use Cases ı Targeted, 24/7 and unattended service quality monitoring in hotspots ı 24/7 and unattended large-scale data collection for network optimization (drive test) ı Unattended, 24/7 service level agreement (SLA) verification 4

5 Service Quality Monitoring with Key Features ı Web-based application for Windows, Linux or OS X application server ı Dashboard providing the latest results and status of the probes in real-time ı Intuitive campaign configuration and fleet operation ı Fast and easy registering of new QualiPoc Probes ı Alarming interface (SMS, , SNMP, JSON) ı Tailored user roles offer an efficient and secure system and fleet management ı can be installed at customer IT locations or customer can use the cloud version of hosted by SwissQual. 5

6 Service Quality Monitoring with Benefits ı Real-time and 24/7 problem identification through targeted service monitoring ı Reduction of operational costs for mobile network optimization thanks to remotely controlled and configured measurement probes. ı Web-based and future-proof modular product concept, enabling economical large-scale deployments ı Provide steady complete satisfaction to end user ı Prevent churns because triggering action before the end-user experience is substantially affected 6

7 Service Quality Monitoring Service Quality Monitoring QualiPoc Android Probe 7

8 Service Quality Monitoring Concept Direct communication to probes via HTTP/HTTPS NetQual NQDI NQDI Control, Monitoring, Analysis and Reporting SW Measurement File Server IP Network Mobile Network CS Network Call Server Media Server Remote probes QualiPoc Android Probe QualiPoc Android Probe QualiPoc Android Probe 8

9 Data flow between QualiPoc Probes and back end data base [MySQL] NQDI data base [MSSQL] High level test results and QualiPoc Probe status updates sent directly via open web socket to NetQual NQDI QualiPoc measurement file (*.sqz) will be moved to NQDI server and imported into NQDI data base QualiPoc Android Probe QualiPoc measurement file (*.sqz) <File upload after test finished or during a dedicated MF upload job> Measurement File Server (e.g. FTP server) 9

10 The Core Element is a web-based application for: ı Managing a fleet of QualiPoc Android Probes ı Configuring tests and campaigns ı Monitoring status of service quality in real time 10

11 ı Dashboards, providing latest results and probe status in real-time ı Intuitive campaign configuration and fleet operation ı Fast and easy registering of new QualiPoc Probes ı Tailored user roles offer an efficient and secure system and fleet management ı Since web-based, access from everywhere if Internet is available 11

12 Dashboard Real Time information on dashboard about unit status and position as well as Test results ı Interactive dashboards allow drill down and filtering options ı Overview provides summary information about unit and test Results and overall success rate. ı Test Details shows detailed information about success rate of all test types involved in current campaigns, involved units, etc. ı KPI Details shows detailed information about the Test KPIs, its distribution as well as occurred error codes 12

13 Probe Management Specific information about each connected unit ı Unit delivers subscriber number, device information and other details automatically during registration ı Unit state information and state history ı Unit grouping ı Manager can immediately assign the new registered probe to test campaigns ı Every connected unit will consume one Connection license out of the license pool if enabled 13

14 Probe registering makes registering QualiPoc Android Probes an easy task: ı Every QualiPoc Probe can register itself to ı offers a QR code that contains the registering URL ı QualiPoc Probes already provide their Device and model information Access points Licensed QualiPoc options Subscriber number ı controls the number of connected probes ı No Remote controlled option required on QualiPoc Probes anymore 14

15 Job and Campaign Management Intuitive Job and campaign configuration ı Drag & drop new tests into job ı Sequential or parallel sessions ı Action items Wait (Pause) Forcing Set Access Point Upload ı Store often used tests as favorites 15

16 User and role management ı The built-in User and role management allows system administrators to manage the set of users and assign tailored roles and access rights. ı Roles: Administrator: Full access and feature set, incl. adding new users and settings Manager: Access to unit management and job / campaign configuration, dashboard Test Manager: Access to job and campaign configuration, dashboard Viewer: Only access to dashboard 16

17 Advanced, web-based GUI ı Modern and intuitive user interface of the facilitates operation and navigation ı User interface automatically adapts its layout to the screen size, regardless of whether monitored on a large screen in the office or while on the move on a mobile 17

18 Communication concept and connection options Smart Monitor introduces a new communication concept based on pure HTTP/HTTPS QualiPoc Probes are connected via web socket. Three connection options are available: ı Normal: Connection will be kept open; unit feedback will be sent immediately. Real Time! Unit status update and test results immediately reported ı Idle: Connection will be kept open; unit feedback will be sent after job has finished. No parallel status traffic, results immediately available after test is finished ı Closed: Connection will be closed; unit feedback will be sent after job has finished. No open connection during tests, no status update unless test is finished 18

19 Communication concept and connection options Connection options: ı Normal: Connection will be kept open, unit status and test results will be sent immediately. Real Time! Unit status update and test results immediately reported Test results (KPIs, etc.) Unit status updates Secure web socket Recording QualiPoc Android Probe 19

20 Communication concept and connection options Connection options: ı Idle: Connection will be kept open; unit feedback will be sent after job has finished. No parallel status traffic, results immediately available after test is finished Test results (KPIs, etc.) Unit status updates Secure web socket Pings in order to keep web socket alive Recording QualiPoc Android Probe 20

21 Communication concept and connection options Connection options: ı Closed: Connection will be closed; unit feedback will be sent after job has finished. No open connection during tests, no status update unless test is finished Test results (KPIs, etc.) Unit status updates Secure web socket Close web socket before test starts Test is finished, open web socket again Recording QualiPoc Android Probe 21

22 Live Monitoring Live Monitoring displays RF parameters and device information from the QualiPoc Android directly to in real time 22

23 Live Monitoring ı Create your own workspace to store set of monitors ı Fast switching between different workspaces ı Workspaces are stored per account 23

24 Live Monitoring Display important device information via Live Monitoring to : ı CPU frequency and temperature ı Battery level and temperature 24

25 Alarming Interface Smart Monitor includes an alarming interface. ı Forwards alarms via multiple interfaces to network supervisors SMS SNMP (Simple Network Management Protocol) JSON (JavaScript Object Notation) Lightweight data-interchange format Text format that is completely language independent These properties make JSON an ideal data-interchange language 25

26 Alarming interface basic ı Convenient alarm configuration on ı Forwarding alarms via SMS or Configure alarm QualiPoc Android Probe System supervisor Reports alarm to Notify alarm via SMS or Monitors specified parameters MNT Meeting #8

27 Advanced Alarming supporting SNMP traps Forwarding alarms via SNMP traps ı Supported SNMP protocol versions v1 v2c V MNT Meeting #8

28 Advanced Alarming supporting SNMP traps ı Forwarding alarms via SNMP traps: Configure alarm QualiPoc Android Probe SNMP Monitoring & Management System Monitors specified parameters Report alarm to Notify system about alarm via SNMP traps MNT Meeting #8

29 Advanced Alarming supporting JSON to URL (planned) Smart Monitor with the JSON (JavaScript Object Notation) interface, will provide useful information and data from the real end user perspective to major OSS monitoring systems: ı Ericsson: Expert Analytics (part of Ericsson Agility Suite) ı Nokia: Service Quality Manager ( Plug-ins and adaptors are available for multivendor integration) ı Huawei: SmartCare 29

30 Test statistics Test statistics offer to closely monitor test KPIs over a specified time range ı Filter options Time Units Test type MNT Meeting #8

31 Service Quality Monitoring Service Quality Monitoring QualiPoc Android Probe 31

32 Service Quality Monitoring QualiPoc Android Probe ı Automated smartphone-based network service quality monitoring ı Dedicated operation mode on QualiPoc ı Full technology support: GSM, GPRS, EDGE, WCDMA, HSDPA, HSPA+, HSPA DC, LTE, CDMA, EvDO, Wi-Fi ı Multi-stage watchdog phone supervision ı Remote software update functionality ı Complete QoS test suite: Voice & video quality, data and app service tests ı Full speech testing support to Mobile and Fixed for both downlink and uplink directions 32

33 Service Quality Monitoring QualiPoc Android Probe All included what is required for 24/7 operation! ı Stable operating system and application on the smartphone ı Ability to recover automatically from errors and other faulty occasions ı Reliable power supply ı Ability to sustain power loss for a certain period of time Multi-stage software watchdog ı No additional hardware which would decrease overall stability ı No additional costs Multi-stage Software watchdog Observes the QualiPoc application process QualiPoc Android Application which performs all the tests, collects the L3 and IP data, etc... 33

34 Service Quality Monitoring QualiPoc Android Probe Shell ı Offers mechanical protection to measurement probe (smartphone) ı Hosts power distribution board and UPS ı Fan assuring temperature control ı LED indicating power situation ı 12 VDC power input ı Probe Shell is lockable ı In car mounting kit (optional) 34

35 Service Quality Monitoring Phone Mounting Wall (PMW) For in car installation of multiple probes ı Shock proven mounting system ı Hosts USB hub for power distribution ı 12 VDC power input 35

36 Service Quality Monitoring Test device Containment Module (TCM) For in car roof installation or stand alone deployment in tough environments ı Easily replaceable device for future upgrades ı Active thermal conditioning for a superior temperature control ı Stable and optimal temperature inside the module (23-24 C) ı External temperature ranges (-40 C to +45 C) ı Shock proven mounting system ı 12 VDC power input 36

37 Service Quality Monitoring QualiPoc Android Probe ı Active, systematic data collection from real end user perspective ı Rich set of service tests including voice quality (incl. VoLTE, VoWi-Fi), data, video quality (V-MOS using ITU J.343.1) and app services tests (Dropbox, Facebook, Ookla Speed Test, etc.) ı Operational reliability Linux-based Android operating system and a dedicated multi-stage watchdog (self-healing function) ensure stable and trouble-free operation ı Energy & temperature management The integrated back-up battery system (UPS) in combination with an active ventilation system ensures continuous reliable performance 37

38 Conclusion Real time monitoring ı Unattended, 24/7 service quality monitoring from end user perspective ı Dashboard shows test results and statistics in real time Easy and intuitive to operate ı Drag & drop job and campaign configuration ı Alarming interface ı Tailored roles and access rights ı Access from everywhere QualiPoc Probe - Rich set of service tests ı Active, systematic data collection ı Voice quality incl. VoLTE and VoWi-Fi, data, video quality and app service tests (Dropbox, Facebook, Ookla, etc.) ı Reliable operation due to watchdog & self recovering functions 38

39 Thank you 39