Network Monitoring & Detection. Fast Data: Real Time. Customer Service Department. NTT Communications Corp.

Transcription

1 Fast Data: Real Time Network Monitoring & Detection NTT Communications Corp. Customer Service Department

2 NTT Communications, INC Long distance & International Communication, ICT Solutions Technical Leadership, MPLS, OCN, Seamless Cloud Service Established 1999/07 Capital billion yen Employees 6,850 (NTT Communications) 17,850 (including the group companies) 2

3 11.3 million customers Cloud-Computing Platform Data Networks Voice Communications Applications & Content Our services - Cloud-computing Services - Data center services - Enterprise solution services - Security services - Internet service provider - Global tier-1 IP network - Data communication network services - Telephone services - Video communication services - Online application and content services 3

4 Business Background User driven change Server, PC Mobile, Tablet Traditional Web pages SNS, Streaming High Volume High Velocity Stability Elasticity Market change Globalization, International Roaming Cloud M2M Real Time Monitoring Failure Detection & Proactive Action 4

5 Fast Data & Big Data in network layer 11.3 million customers Operation Marketing and Sales Fast Data (Real Time Monitoring) Big Data (Historical Analysis) Failure Detection Session Management Real Time Statistics DWH 5

6 Fast Data challenge Target: QoS for L2 Network, MVNO, International Roaming Requirement Network Failure Detection : 1.4M traffic / sec Monitoring and Management Network : 105K traffic / sec (MVNO and International Roaming case) Traditional approach cannot meet such performance requirement Functional Nonfunctional Reduce Risk - Continuous processing - Flexibility for KPI change - In-memory scalability - In-memory reliability - Pre-tuned - Reduce Time-To-Market Oracle Event Processing (OEP) Oracle Coherence Oracle Exalogic 6

7 Architecture L2 Service Network Mobile Monitoring Server Network Device Network Device Network Management Server L3 Service Network Monitoring Server Network Device Cloud Service DWH Customer DB Equipment DB OSB ODI * OSB : Oracle Service Bus * ODI : Oracle Data Integrator OEP Coherence on Exalogic Exadata BI Store Utilize 7

8 Real Time Monitoring Dashboard Real Time Statistics Fault Failure Detection 8

9 Phase1 - done Project Status Detect experiential failure pattern and invoke the typical action (to minimize the problematic duration and to reduce the human workload) 2012/ /04 (including PoC) Can process 84M traffic per minute In production Phase2 - done Monitoring detail information for sessions and statistics Phase3,4 - implementing More intelligent predictive action Detection and prediction huge fault 9

10 Business impact (in phase 1) Issues before this project Achieved Result L2 Network The failure is causing the out of service. Need to avoid the failure for better QoS and reducing the operators workload. Can detect typical, complex network problems automatically, without device dependencies. L2 loop detection for example. See the next slide for the detail. Mobile Network Many operators(about 1,000) are working for mobile NW monitoring. That causes huge workload cost in daily operation. Can reduce the human workload Operators can easily see the situation of each customers in real time manner. Large cost savings annually! 10

11 Example: L2 Loop Detection The network frame for Wide Area Ethernet(WAE) contains 2 types of MAC address info; outer MAC(switcher s MAC) and inner MAC(original source MAC). When routing loop occurs, the packet collector will get several frames having same inner MAC but different outer MAC within the small time window. Loop occurred for some reason EoE switch EoE switch Detection by CQL MAC info A Inner-MAC A Outer MAC Y Inner-MAC A Outer MAC Z OEP/Coherence Packet Analytics on Exalogic 11

12 What s next Plan Security enhancement Scope expansion Manage the Quality of VoIP, VOD and TCP YouTube performance monitoring Cloud Computing Trend Analysis & Predictive Action Analyzing the historical data (leveraging Exadata and Oracle BI) Integration Databases CRM Database, Packet Database Trap/Syslog, Statistics Database, SNS Database Prediction based on the above data analysis 12