QoS Requirements for VoLTE

Transcription

1 QoS Requirements for VoLTE Dr. Parag Pruthi NIKSUN Dr. Ashutosh Dutta NIKSUN Date: June 18-20, 2012 Copyright 2010 GISFI. All Rights Reserved.

2 Voice over LTE

3 LTE - Deployment Scenario Data Center/IMS Registration/Admission Control on AAA server IP multimedia services Mobile CORE/EPC Monitoring traffic at control and user planes Monitoring tunnels and pair performance SGSN S4 S3 App Servers enum DNS Wx MME S11 AAA HSS S6a S10 S8 MME S5 S6c I/S-CSCF P-CSCF SGi PGW S11 S7 Gx Internet Rx+ PCRF S2b Monitoring Point RNC SGW SGW SGW epdg Access & backhaul S1-U S1-MME Correlating traffic to mobile device Handover and roaming 3G Access enodeb X2 X2 Uu enodeb enodeb Non-LTE Access UE UE

4 QoE Metrics QoE => Perceived Quality of Service Network Metrics Bit rate, delay, jitter, packet loss rate (PLR) Power consumption Application Metrics Call setup delay, Call setup success rate Failed calls, dropped calls, retransmission MOS (Mean Opinion Score) Determining factors Network Characteristics (Lossy link, low bandwidth, heterogeneous network) Application Characteristics (Real time, Non-real-time) User mobility (cell mobility, subnet mobility) Several standards groups ITU-T SG12, ITU X.902 (IP Telephony) IETF IPPM, DIFFSERV 3GPP 3GPP TS (IMS performance) GISFI Slide 4

5 Multilayer QoE in VoLTE Network DNS/E NUM S-CSCF HSS S-CSCF Invite OK ACK P-CSCF RTP diameter GETS- Application Server I-CSCF P-CSCF SIP DNS Monitoring Agent PCRF IMS PCRF Layer 3 control Network/ Application Feedback IMS-layer control Layer 2 control Multi-layer SON Controller Managed IP (Multi-Provider Network) (EPC) GW GETS Call Wireline Access Cable DSL Fiber Ethernet Caller (UE1) RAN GW IP CAN Wireless Access UMTS EvDO WiMAX LTE Satellite 5 RAN Wireless Access UMTS EvDO WiMAX LTE Satellite RAN RAN IP CAN Called (UE2) Wireline Access Cable DSL Fiber Ethernet 5

6 QoE Requirements QoE is driven by measurements Which layer, which application, how often Require Multi-timescale Measurements Require Multi-Layer Measurements Network layer, application layer Require Session-based Measurements E.g., SIP-based multimedia application Require DPI for Application Classification Classification and Marking Policing and Markdown Queuing and Dropping GISFI Slide 6

7 QoE Requirements Require mechanisms to provide priority services for signaling and transport of voice services in case of emergency. e.g., SIP signaling for VoIP use Resource Priority Header (RPH) e.g., Diffserv mechanisms to take care of associated media (e.g., RTP) traffic. QoS measurements should consider KPIs at several layers including Data link Layer MAC layer retransmission Network Layer - thruput, goodput, network delay, network retransmission, utilization, packet loss, jitter Transport Layer - TCP connections and RTT Application layers Set up delay, dropped calls, failed calls, retransmission of INVITEs GISFI Slide 7

8 QoE Requirements Future NGN application requires cross-layer feedback in order to provide desired QoS during handover and due to bandwidth fluctuation IEEE Interoperability with Mobility protocols SIP, Mobile IP, Mobile IPv6 Tightly coupled or loosely coupled Require correlation between signaling and media (e.g., EPC and IMS) Require Open API to dynamically control the network element in the network GISFI Slide 8

9 EPC Network Layer KPIs (Sample) I-RAT Handover, Roaming (X2, S10, S3, S4) Application Performance (SGi) Sessions (S5, S8, S1-U) AAA & Roaming Scenarios (S6a) Bearer (S11, S1-MME) SGSN enb UE S4 S3 S1-MME X2 enb X2 UE E-UTRAN S10 MME Serving Gateway (S-GW) S1-U S11 S5 S8 enb X2 UE S6a PDN- GW S2a HSS S7 (WiFI, WiMAX) UE SGi S2b PCRF Wm epdg Rx+ S6c Wn Untrusted Non-3GPP UTRAN IP-based IMS network UE Wx AAA U E Basic KPIs Advanced KPIs Performance Response time Utilization Successes/Failures Application profiling Bearer setup latency Residence time Security Unauthorized traffic Restricted apps Excessive traffic Denial of Service Tracking Authentication Slide 9

10 S1-U Load Profile Slide 10

11 Session Counts Slide 11

12 Mean Bearer Setup time Slide 12

13 S11 Response Time Slide 13

14 Real-time Enterprise Dashboard LTE (Performance)

15 Real-time Dashboard - LTE (Security)

16 LTE Analysis Slide 16

17 IMS Service Layer KPIs (Sample) Subscriber Signaling Sessions() Subscriber Data Sessions (RTP) Server Sessions (Mw) AAA & Location Info Request (Cx) Policy Control (Rx) Basic KPIs Advanced KPIs Performance Top Talkers, Top SMS Top Network IDs Registration rate Session Setup time Registration setup time Callref RTP correlation Security Unauthenticated Registrations Un-authentication Failures Server Errors Registration attempts Re-Invite, Re-RegisterRegister Per subscriber failures Slide 17

18 IMS KPI Analysis SIP Methods Slide 18

19 IMS Registration Metrics Slide 19

20 IMS KPI Top Methods Slide 20

21 IMS Top Talkers Slide 21

22 Security: Unauthenticated Registrations

23 Top NAIs Unauthenticated Registrations Top NAIs Authentication Failures Slide 23

24 Real-time Enterprise Dashboard IMS (Security)

25 Real-time Enterprise Dashboard IMS (Performance)

26 KPIs for RTP (Real Time Transport Protocol)

27 KPIs for RTP Type of KPIs KPIs Performance Mos Performance Jitter Performance packetdelay Performance packetloss Performance datavolume Remarks Average MOS score for all VoIP calls on the network Average Jitter for all VoIP calls on the network Average Packet Delay for all VoIP calls on the network Average Packet Loss for all VoIP calls on the network Total of all VoIP data traffic on the network Performance releasecausecode Release Cause Code distribution for all VoIP calls Performance cdrtable Performance faxtable Perfromance rastable List of VoIP CDRs for a given period of time List of Fax(T.38) Records for a given period of time List of RAS Records for a given period of time Performance callvolumeleaders Top N VoIP Call volume leaders

28 KPIs for RTP (cont.) Type of KPIs KPIs Remarks Performance calldistribution Total of all VoIP calls per given time period Performance networkvolume Total of all data traffic on the network Security Security Abnormally Terminated Calls Initiated vs. Rejected Calls Total of Abnormally Terminated Calls per time period Total of Initiated vs. Rejected calls per time period Security Codec Distribution List of all codecs utilized by VoIP calls Performance Total Duration Time Total aggregated Call Duration Time of VoIP Calls per given time period Performance Simultaneous Calls The number of simultaneous calls on the network Performance Total Setup Time Total aggregated Setup Time per given time period Security errordist Error Distribution for VoIP calls Performance TopApps Top N VoIP protocols on the network, i.e. SIP, H.323, MGCP/NCS, MEGACO, SCCP, T.38, etc.

29 KPIs RTP (contd.) Type of KPIs KPIs Remarks Performance mediastream List of media streams utilized by a VoIP session Performance faxstream List of media streams utilized by a Fax(T.38) session Security bounceflow Message Flow(bounce diagram contents) for a given VoIP session Security packettree List of all packets in the context of a VoIP session Performance callmos Average MOS score for a given VoIP session Performance calljitter Average Jitter for a given VoIP session Performance Performance callpacket Delay callpacket Loss Average Packet Delay for a given VoIP session Average Packet Loss for a given VoIP session

30 KPIs for IMS (IP Multimedia Subsystem)

31 KPI NAMES DESCRIPTION LOGICAL FORMULA WHY INTERESTING? INTERFAC E List of all SIP methods SIP message flows with same Call-ID Shows the list all SIP messages. Basic functionality for session view. Aggregate IMS signaling packets Sums all the methods and responses. Ratio of total count and all IMS messages Dos Attack Aggregate total attempted initial registration b/w UEs and P- CSCF Total number of registrations Sum of all SIP Registers from all UE to PCSCF System Load indication, VZW Req, Dos Attack Aggregate successful initial registration b/w UE & CSCF Count the successful registrations of UEs. Count 200 Ok in response to Register from PCSCF. Informative

32 Aggregate failed initial authenticatio n b/w UE & CSCF Count the number of failed authenticatio n of UEs. Count SIP 401 errors from PCSCF in response to Register from PCSCF. Password guessing attack Aggregate failed initial registration b/w UE & CSCF Count the number of failed registrations of UEs. Count SIP 4XX (except 401) errors from PCSCF in response to Register. Informative Mean IMS initial registration set-up time Time taken between register and 200 OK Total time of getting an response after the registration request is sent. System Performanc e indication Aggregate unauthenticat ed initial registration b/w UE & P- CSCF Identify the unauthenticat ed registrations Count Registers without nonces that get 200(2XX) responses without 401(4XX) challenges. Security risk, allows impersonati on attack, VZW req.

33 Aggregate total attempted reregistration between UE & P-CSCF Registers with previously seen Call-IDs. Counts the total number of reregistered IDs. System Load Indication Aggregate successful reregistration between UE & P-CSCF Registers with previously seen Call-IDs. Counts the total number of 200 Ok s to Informative Aggregate Failed reregistration between UE & P-CSCF SIP 4xx errors in response to registration request. Count SIP 4XX errors Password guessing attack Mean IMS reregistration setup time. Time to set-up the registration Time between register and 200 OK System performance indication

34 Aggregate Failed re-authentication between UE & P- CSCF Calculate the failed number of reauthentication. Count SIP 401 errors in response to Register Total unauthenticated REGs Aggregate unauthenticated re-registration between UE & P- CSCF Total number of unauthenticated registrations. Count re-register msgs without nonces that get 200 without 401 challenges Security risk, allows impersonation attack Aggregate successful deregistration between UE & P- CSCF Successful deregistrations. Count Register with expiry==0 or contact: expiry==0 System load indication Aggregate Failed de-registration between UE &PCSCF All the failed deregistration. Count SIP 4XX errors in response to above register. Informative

35 Aggregate total attempted deregistration b/w UE & PCSCF Total of attempted deregistration SIP Password guessing attack Mean IMS deregistration time Mean of deregistration time Mean of the time. System performance indication Aggregate failed authentication for de-registration Total number of failed authentication de-registrations Count SIP 401 errors in response to register Total unauthenticated REGs Aggregate unauthenticated de-registration Total number of unauthenticated de-registration Count de register msgs with 200 and without 401 challenges. Security risk, allows impersonation Attempted session establishments How many attempts have been made to establish the session. #initial Invite sessions with #INV==1 System load indication, VZW req.

36 Successful session establishments Tracking all successful sessions we have. Count #180 ringing, not #200 OK, when #INV==1 System load indication Answered session establishment Tracking all successful answered sessions we have. Count #2XX ringing, should be 200 but 2XX is fine when #INV==1 System load indication Failed session establishments All the failed session establishments. Count 4XX messages System performance indication Mean time for successful session establishment Time taken to have a success in establishment. Time b/w INVITE and 180 response. System performance indication Attempted session re-establishment. Number of attempts to have re-established session #INVITE where a 180 has already been seen, or #INV > 1 System tuning aid

37 Aggregate session deestablishments Total deestablishments. Count BYEs. Security risk, allows impersonation attack, VZW req. Number of attempted subscription procedures Number of attempted procedures requests. PCSCF receives a SIP subscribe System load indication, VZW Req. Number of successful subscription procedures Number of successful procedures for subscription. PCSCF sends a 200 OK System performance indication Number of failed subscription procedures Number of failed subscription procedures PCSCF send a 4XX System performance indication Number of unauthenticated subscribers Total number of unauthenticated subscribers Number of subscribers without 401 challenges. Security risk, allows impersonation attack, VZW req.

38 Number of emitted notify procedures Total count of SIP notify messages. PCSCF sends a SIP Notify System load indication, VZW req. Number of successful notify procedures Total count of SIP notify messages with OK response. PCSCF receives a SIP 200 OK System load indication. Number of failed notify procedures Total count of SIP notify messages. PCSCF receives a SIP 4XX System performance indication. Number of unauthenticated Notify s Total count of SIP notify messages. Number of Notify without a 401 Challenge Security risk, allows impersonation attack, VZW req. Number of spoofed notify procedures Total count of Spoofed notify messages. Count notifys from src!=pcscf System load indication, VZW req.

39 Attempted immediate Messaging procedures Procedures attempted to have immediate messaging. PCSCF receives a SIP message System load indication Successful immediate Messaging procedures Successful procedures attempted to have immediate messaging. PCSCF sends a SIP 200 OK message System load indication Failed immediate Messaging procedures Failed procedures attempted to have immediate messaging. PCSCF sends a SIP 4XX message in response System load indication Number of unauthenticated messages Number of all unauthenticated messages. Messages without 401 challenges Security risk, allows impersonation attack NAIs of top 5 originators of IMS signaling traffic Display associated packets, bytes, exclude CSCF as originator. From: and #bytes System load indication, Dos attack

40 NAIs of top 5 receivers of IMS signaling traffic Display associated packets, bytes, exclude CSCF as receiver. To: and #bytes System load indication NAIs of top 5 senders of Instant messages Display associated packets, bytes, exclude CSCF as originator. #bytes System load indication, Dos attack NAIs of top 5 receivers of 4XX errors Display associated packets, bytes, exclude CSCF as receiver. #bytes System load indication Top 5 visited n/w IDs in IMS signaling traffic Display associated packets and bytes #bytes System load indication Top 5 access n/w Infos in IMS signaling traffic Display associated packets and bytes #bytes System load indication

41 Top 5 sender domains in IMS signaling traffic Display associated packets and bytes #bytes System load indication Receiver domains in IMS signaling traffic Display associated packets and bytes #bytes System load indication NAI of top 5 originators of register request Display associated packets,bytes exclude CSCF as originator(pcscf callee) #bytes System load indication NAI of top 5 originators of INVITE request Display associated packets,bytes exclude CSCF as originator #bytes System load indication NAI of top 5 originators of INSTANT message request Display associated packets,bytes exclude CSCF as originator(dup) #bytes System load indication

42 NAI of top 5 originators of subscribe requests Display associated packets,bytes exclude CSCF as originator #bytes System load indication IP Addresses of top 5 originators of register requests Display associated packets, bytes exclude PCSCF as originator. #bytes System load indication IP Addresses of top 5 originators of INVITE requests Display associated packets, bytes exclude PCSCF as originator. #bytes System load indication IP Addresses of top 5 originators of INSTANT message requests Display associated packets, bytes exclude PCSCF as originator. #bytes System load indication IP Addresses of top 5 originators of subscribe requests Display associated packets, bytes exclude PCSCF as originator. #bytes System load indication Top methods & response types sent. Drill down to send UE. Calculate the number of UEs Rate and total counts for UE Informative

43 Network Layer KPIs FOR LTE (EPC)

44 KPI Names Description Logical Formulae KPI object Why interesting? Interfa ce Attempted EPS attach procedures Provides the number of attempted EPS attach procedure within the MME. Sum of all attempts at attach EPS. Valid for PS Receipt of ATTACH REQUEST message with ATTACH TYPE information element indicating EPS attach from the MS. Successful EPS attach procedures Number of successfully performed EPS attach within MME. Sum of all successful attaches. Valid for PS Transmission of a "ATTACH ACCEPT" message to the MS but retransmission doesn t increase the counter. Failed EPS attach procedures Number of failed EPS attach procedures. It is split into sub counters per the reject cause. Sum of all failed attach procedures. Valid for PS Transmission by the SGSN of the ATTACH REJECT message to the MS, in response to a "ATTACH REQUEST"

45 KPI Names Description Logical Formulae KPI object Why interesting? Interf ace Attempted EPS detach procedure Number of attempted EPS detach procedures initiated by UE within the MME. Receipt of DETACH REQUEST message with detach type information element from UE Valid for PS Gives the total number of attempted detaches. Successful EPS detach procedure Number of successful EPS detach procedures initiated by UE within the MME. Transmission of DETACH ACCEPT from MME Valid for PS Gives the total number successfully of attempted detaches. Attempted EPS detach procedure by MME Number of attempted detach procedures by MME. Transmission of DETACH REQUEST message by UE from the MME. Valid for PS All the attempts of detach to calculate success

46 KPI Names Description Logical Formulae KPI object Why interesting? Interf ace Successful EPS detach procedure by MME Number of successful detach procedures by MME. Receipt of DETACH ACCEPT message by UE from the MME. Valid for PS Calculate success rate Attempted EPS detach procedure by HSS Number of attempted detach procedures by HSS. Receipt of CANCEL LOCATION message by MME from the HSS with cancel type information element indicating delete user. Valid for PS All the attempts of detach by HSS and uses RADIUS. Successful EPS detach procedure by HSS Number of successful detach procedures by HSS. Receipt of CANCEL LOCATION ACK message from MME by HSS. Valid for PS All the successful attempts to detach by MME.

47 KPI Names Description Logical Formulae KPI object Why interesting? Interf ace Attempted tracking area update procedure with SGW change Number of attempted tracking area update procedure with SGW change initiated with MME. Receipt of TRACKING AREA UPDATE REQUEST message from the MS, with last registered TAI information element indicating to the MME that it wishes to be served by new SGW. Valid for PS Calculate AREA UPDATE attempts. Successful tracking area update procedure with SGW change Successful number of attempted tracking area update procedure with SGW change initiated with MME. Transmission of TRACKING AREA UPDATE ACCEPT message from the MS, with last registered TAI information element indicating to the MME that it wishes to be served by new SGW Valid for PS Success rate of Area updates.

48 KPI Names Description Logical Formulae KPI object Failed tracking area update procedure with SGW change Number of failed tracking area update procedure with SGW change initiated with MME. Transmission of TRACKING AREA UPDATE REJECT message from the MS, with last registered TAI information element indicating to the MME that it wishes to be served by new SGW. Causes are also defined in the message. Valid for PS Why interesting? Causes of failure. Interf ace Attempted tracking area update procedure without SGW change Number of attempted tracking area update procedure without SGW change initiated with MME. Receipt of TRACKING AREA UPDATE REQUEST message from the MS, with last registered TAI information element indicating to the MME that it wishes to be served by same SGW. Valid for PS Calculate AREA UPDATE attempts. Without SGW change.

49 KPI Names Description Logical Formulae KPI object Successful tracking area update procedure without SGW change Failed tracking area update procedure without SGW change Successful number of attempted tracking area update procedure without SGW change initiated with MME. Number of failed tracking area update procedure without SGW change initiated with MME. Transmission of TRACKING AREA UPDATE ACCEPT message from the MS, with last registered TAI information element indicating to the MME that it wishes to be served by same SGW Transmission of TRACKING AREA UPDATE REJECT message from the MS, with last registered TAI information element indicating to the MME that it wishes to be served by same SGW. Causes are also defined in the message. Valid for PS Valid for PS Why interesti ng? Success rate of Area updates. Causes of failure in case of same SGW. Interf ace

50 KPI Names Description Logical Formulae KPI object Why interesti ng? Interf ace Attempted EPS paging procedures Number of attempted PS paging procedures initiated at the MME. Incremented when an EPS paging procedure is started i.e. at the transmission of first Paging message from MME to the enodeb, which are counted when paging area is smaller than or equal to one TA. Valid for PS. Initial as well as repeated paging are counted Successful EPS paging procedures Number of successful PS paging procedures initiated at the MME. Receipt of SERVICE REQUEST message with Service Type = Paging Response from the UE. Valid for PS Initial and repeated are both counted. Failed EPS paging procedures Number of failed PS paging procedures initiated at the MME. Increments when an EPS PS paging procedure times out, which are counted when paging area is smaller than or equal to one TA. Valid for PS Initial and repeated are both counted.

51 KPI Names Description Logical Formulae KPI object Number of dedicated EPS bearers in active mode(mean) Mean number of dedicated EPS bearers. Sampling at a pre-defined interval, sum of dedicated EPS bearer established by MME in active mode and then taking the arithmetic mean. Valid for PS Why interesting? The total active mode bearers would give the load. Interfa ce Number of dedicated EPS bearers in active mode(maxim um) Maximum number of dedicated EPS bearers. Sampling at a pre-defined interval, sum of dedicated EPS bearer established by MME in active mode and then taking the maximum. Valid for PS The total active mode bearers would give the maximum load.

52 KPI Names Description Logical Formulae KPI object Dedicated bearer set-up time by MME(Mean) Valid time per dedicated bearer set-up procedure by MME. Obtained by accumulating the time intervals for every successful dedicated bearer setup by MME B/W ACTIVATE DEDICATED EPS BEARER CONTEXT REQUEST and corresponding ACTIVATE DEDICATED EPS BEARER CONTEXT ACCEPT message receipt by the MME. This time when divide by the total number of successful dedicated bearer gives the mean. Valid for PS Why interestin g? This would let us calculate the mean of set-up time. Interfa ce Attempted dedicated bearer activation procedure by MME Number of attempted dedicated bearer activation procedure by MME. Transmission of ACTIVATE DEDICATED EPS BEARER CONTEXT REQUEST message by MME. Valid FOR PS Total number of attempts.

53 KPI Names Description Logical Formulae KPI object Why interesting? Successful dedicated bearer activation procedure by MME Number of successful dedicated bearer activation procedure by MME. Receipt of ACTIVATE DEDICATED EPS BEARER CONTEXT ACCEPT message by MME. Valid FOR PS Total number of successful attempts. Interfa ce Failed dedicated bearer activation procedure by MME Number of failed dedicated bearer activation procedure by MME. Transmission of ACTIVATE DEDICATED EPS BEARER CONTEXT REJECT message by MME from UE with ESM cause indicating the cause of failure.. Valid FOR PS Failure detection. Attempted dedicated bearer de activation procedure by MME Number of attempted dedicated bearer deactivation procedure by MME. Transmission of DEACTIVATE EPS BEARER CONTEXT REQUEST message by MME. Valid FOR PS Total number of attempts to de activate

54 KPI Names Description Logical Formulae KPI obje ct Successful dedicated bearer de activation procedure by MME Number of successful dedicated bearer de activation procedure by MME. Receipt of DEACTIVATE EPS BEARER CONTEXT ACCEPT message by MME. Valid FOR PS Why interesting? Total number of successful attempts to deactivate. Interf ace Attempted EPS bearer modification procedure by MME Number of attempted bearer modification procedure by MME. Transmission of MODIFY EPS BEARER CONTEXT REQUEST message by MME. Valid FOR PS Total number of attempts to modify Successful EPS bearer modification procedure by MME Number of successful EPS bearer modification procedure by MME. Receipt of MODIFY EPS BEARER CONTEXT ACCEPT message by MME. Valid FOR PS Total number of successful attempts to MODIFY.

55 KPI Names Description Logical Formulae KPI obje ct Failed EPS bearer modification procedures by MME Number of failed EPS bearer modification procedure by MME. Receipt of MODIFY EPS BEARER CONTEXT REJECT message by MME from UE. With ESM Cause. Valid for PS. Why interesti ng? Used to calculate the success rate. Interf ace Attempted number of PDNGW initiated dedicated bearer creation Number of attempted PDN-GW containing multiple bearer IDs, each cumulated to the counter. Total Number of PDNGW created. Valid for PS Success rate calculatio n. Successful number of PDNGW initiated dedicated bearer creation Number of successful PDN-GW containing multiple bearer IDs, each cumulated to the counter. Total Number of PDNGW created. Valid for PS Success rate calculatio n.

56 KPI Names Description Logical Formulae KPI objec t Failed number of PDNGW initiated dedicated bearer creation Failed PDN-GW containing multiple bearer IDs, each cumulated to the counter. Total Number of PDNGW created. Valid for PS Why interestin g? Failure rate and cause of failure. Inte rfac e Attempted number of PDNGW initiated dedicated bearer deletion. Number of attempted PDN- GW initiated Dedicated Bearer Deletion. Transmission of Delete Bearer REQUEST message may contain multiple bearer ID, each bearer shall be cumulated to the counter. Valid for PS Attempts of number of deletion. Successful number of PDNGW Dedicated bearer deletion Number of successfully PDN- GW initiated Dedicated bearer deletion. Receipt of Delete Bearer Response message by PDNGW where cause and receives a n ACCEPTNCE RESPONSE Valid for PS Success rate calculation.

57 KPI Names Description Logical Formulae KPI objec t Failed number of PDNGW initiated dedicated bearer deletion Attempted number of PDNGW initiated modification with QoS update. Failed PDN-GW initiated dedicated bearer deletion. Split into sub counters per reject cause. Number of attempted PDN- GW initiated Dedicated Bearer modification with QoS update Receipt of Deletion Bearer response MESSAGE where cause is indicated. Transmission of Update Bearer Request message from PDNGW with Bearer Level QoS containing all bearer IDs. Valid for PS Valid for PS Why interestin g? Failure rate and cause of failure. Attempt s of number of QoS updation. Inte rfac e Successful number of PDNGW Dedicated bearer modification with QoS Successfully PDN-GW initiated Dedicated bearer modification with QoS update. Response to the request sent. Valid for PS Success rate calculati on.

58 KPI Names Description Logical Formulae KPI objec t Failed PDNGW initiated dedicated bearer with QoS update Attempted number of PDN-GW initiated Dedicated Bearer Modification without QoS update. Failed PDN-GW initiated dedicated bearer modification with QoS. Split into sub counters per reject cause. Number of attempted PDN-GW initiated Dedicated Bearer Modification without QoS update. Receipt of Update Bearer response MESSAGE where cause is indicated. Transmission of "Update Bearer REQUEST" message From PDN-GW without Bearer Level QoS IE, this message may contains multiple Bearer IDs Valid for PS Valid for PS Why interestin g? Failure rate and cause of failure. Attempt s of number of updation without QoS.. Inte rfac e

59 KPI Names Description Logical Formulae KPI object Successful number of PDN-GW initiated Dedicated Bearer Modification without QoS update. Number of successfully performed PDN-GW initiated Dedicated Bearer Modification without QoS update. Response to the request sent. Valid for PS Why interes ting? Succes s rate calcula tion. Inte rfac e Failed number of PDN-GW initiated Dedicated Bearer Modification without QoS update Number of failed PDN-GW initiated Dedicated Bearer Modification without QoS update. The measurement is split into sub counters per the reject cause Receipt of Update Bearer Response message by PDN-GW without Bearer Level QoS IE in the Update Bearer Request message which contains the same EPS Bearer ID and where Cause IE identifies a failed bearer handling with Rejection Response Valid for PS Failure rate and cause.

60 Feedback-assisted Dynamic Network Provisioning

61 Motivation and application scenario Use of monitoring agent to provide feedback about the network condition and dynamically control the router and assign priority to application traffic under network congestion EF BE NetDetector controller

62 System architecture of testbed

63 Automatic configuration of router EDI: enhanced device interface Provides a comprehensive management interface for various Cisco devices with a standard programmatic interface Two diffserv queues: Expedited forwarding (EF) match DSCP 46 assured minimum bandwidth - Best effort match DSCP 0 set maximum bandwidth usage Commands can be read in the form of CLI and are encapsulated in XML format when issuing edit-config operation of NETCONF

64 Query NetDetector and mark traffic Controller polls NetDetector periodically (~ 20 sec) Alternatively, Netdetector can send alarms Two kinds of query in form of NIKSUN URI API Check application type - /ngen/srvc/dashboarddata?recorder=<recorder>&iface=<iface>&starttime=- 2%20min&endTime=now&layer=Application&dataType=application&customDT=dataFields - trigger Marking traffic to EF class once application appears Get application bit rate - /ngen/srvc/dashboarddata?recorder=<recorder>&iface=<iface>&starttime=- 2%20min&endTime=now&layer=Application&dataType=time,bitRate&customDT=dataField s&window=10 - Trigger router configuration when cross traffic exceeds upper threshold Traffic marking is done by issuing iptables command at application source host Before marking After marking

65 Packet Classification Before marking After marking 65

66 Deliver streaming media and generate cross traffic VLC media player works as both streaming media server and client Server: RTP unicast is delivered to destination host address using port 1234 (MPEG2) Client: receive the RTP stream and save it as MPEG2 file in local host Iperf is used to generate cross traffic Client: sends UDP packets at 10Mb/s Server: receives the UDP packets and provides statistics on bandwidth, loss rate, and time jitter

67 Experiment results (1) Snapshots of video During Congestion Before congestion After Dynam Control

68 Experiment results (2) Change of quality of video & audio over time No cross traffic cross traffic Priority Queue (E/F) MOS No cross traffic Priority Queue (E/F) Packet loss

69 Experiment results (3) Change of traffic received at destination host Black: streaming media traffic Red: cross traffic bytes time Change of bandwidth and time jitter for cross traffic Response time: ~ 40s

70 Experiment results (4) Effect of polling time interval 20s interval: ~ 40s response time 10s interval: ~ 30s response time

71 Future work Integrating the controlling program into NetDetector Reducing the response time Depends on polling interval and time spent in configuring the router Using interruption/alarms rather than polling can further reduce response time Being more adaptive to various scenarios Many prerequisite information such as IP address of streaming media server and client is assumed Change of the configuration of the router should not block other normal traffic in practical situation, AF class is necessary to deal with these traffic (control traffic)

72 QoE Metrics Require Sessionbased Measurements GISFI Slide 72

73 QoE metrics Driven by measurements What To Measure? Which Layer? Which Application? Which User? Hop-by-hop or End-to-end? Etc? GISFI Slide 73

74 QoE Metrics Require Multitimescale Measurements GISFI Slide 74

75 QoE Metrics What is Frequency of Measurement? Duration of Flow? Minutes? Seconds? Sub-seconds? Per-packet? GISFI Slide 75

76 QoE Metrics Time Effect GISFI Slide 76

77 QoE Metrics Require Multi- Layer Measurements GISFI Slide 77

78 QoE Metrics Network/Transport Layer IP Layer UDP Layer GISFI Slide 78

79 QoE Metrics Application Specific Application HTTP Application SSH GISFI Slide 79

80 QoE Metrics User centric User 1 User 2 GISFI Slide 80

81 QoE Metrics - Application All Traffic Except Facebook Facebook Only GISFI Slide 81

82 QoE Metrics Require DPI for Application Classification GISFI Slide 82

83 QoE Metrics Require DPI for Application Classification Classification and Marking Policing and Markdown Queuing and Dropping GISFI Slide 83

84 Priority QoS Treatment (Diffserv approach) in the Core IP Transport DSCP classification and marking at the edge, and class-based priority queuing and assured bandwidth scheduling at the edge and core routers EF Treatment: For Emergency SIP signaling and SIP Register transport (Strict-priority forwarding for bounded bandwidth) AF Treatment: For Emergency VoIP and Video/IP RTP media (Weighted shared bandwidth scheduling of remaining bandwidth among AF classes) BE Treatment: Best-effort traffic forwarding only when bandwidth not in use by higher priority traffic; Drop otherwise 84

85 Experiencing Quality of Services under congestion Audio Quality Video Quality 7 Mbps Cross Traffic 8 Mbps Cross Traffic 9 Mbps Cross Traffic Increase Traffic Congestion 9.5 Mbps Cross Traffic 85 85

86 Applying Diffserv-based QoS to VoIP VoIP Call (10 Mb/s One-way Cross Traffic) Priority VoIP 10 Mb/s cross traffic (packet size 1440 bytes) Non Priority VoIP 10 Mb/s cross traffic (packet size 1440 bytes) Non Priority VoIP 10 Mb/s cross traffic (packet size 400 bytes) 86

87 Measurements - IMS Top N Reports Clients based on SIP Registrations/Re-Registrations/De-Registrations Number of INVITE/NOTIFY/ SUBSCRIBE messages Failed/Successful authentications at P-CSCF/S-CSCF/I-CSCF depending on Authentication type (SIP Digest, IMS AKA) Message type (INVITE, NOTIFY, BYE) Malformed messages (SIP, RTP, H.248) identified using protocol grammar, rules Unauthenticated/Un-authorized messages Spoofed messages Session minutes (service usage) Slide 87

88 Measurements IMS (Contd.) Top N Reports Servers based on Excessive Registrations/subscriptions from a given client/proxy Setup requests (e.g., SIP INVITE) Unauthenticated/spoofed messages (e.g, SIP BYE/NOTIFY) Number of data sessions Incoming message/packet rates Number of authentication challenges/failure messages Malformed signaling/media messages Key exchanges during IMS AKA authentication Ability to drill down into data sessions - e.g., for given P-CSCF, find all the messages from client X between time T1 to T2. Slide 88

89 Measurements - LTE Insight into signaling and user data volumes Data volume distribution by Top SGW Top MME Top enodeb Top IMSI Volume distribution available by Data Sessions Packets Bytes Setup time Session duration.. etc

90 QoE Metrics QoS due to Mobility Minimize the interruption in QoS during handover Interoperability with Mobility protocols GISFI Slide 90

91 QoE Metrics Interoperability with Mobility protocols GISFI Slide 91

92 What affects QoE for Rural Users Network Characteristics Ad hoc type networks scattered group of users Lossy links, Fluctuating Traffic demand Delay tolerant networks (DTN) - not suitable for interactive traffic Low bandwidth > Network congestion Network heterogeneity (e.g., WiMAX and WiFi) Frequent user mobility (e.g., cell mobility, subnet mobility) Application characteristics Current Types of Application Cellular voice, File transfer (e.g., non-real-time), SMS Future NGN Application requires QoS support from lower layers Real-time streaming (e.g., IPTV) Interactive (e.g., VoIP) Delay sensitive Distance learning, Mobile banking Group-based conferencing (e.g., Multicast) (Priority) Services need QoS reservation GISFI Slide 92

93 Next Steps Baseline Document (June ) Define a set of requirements that is application specific and applicable to Indian rural environment Define a set of methodologies to define end-toend QoS parameters Multi-layer QOS Network, Application Layer Multi-time-scale measurements Granularity of measurement Define a set of APIs to control the network based on measurement GISFI Slide 93

94 KPIs FOR LTE

95 95