Standardizing ontologies for the IP traffic measurement Angel Ferreiro (olivo@tid.es) Telefonica I+D Future Network Technologies Workshop 10-11 March 2010 -ETSI, Sophia Antipolis,France
Rationale Several infrastructures were deployed for IP traffic monitoring (FP6 projects) that provide us with useful data. However their exploitation was found to require deep knowledge of their information models. It was difficult to develop operative mechanisms based on those shared repositories and tools since similar concepts were not treated uniformly. The objective of developing a semantic tool to access those IP traffic measures required a middle layer to cover their differences (parameters, relations or dependencies, units, etc.). And the situation would continue till an ontology is agreed for all of them and future traffic monitoring systems. TELEFÓNICA I+D 2
The benefits of setting an ontology up An ontology provides a vocabulary of classes and relations to describe a domain, stressing knowledge sharing and knowledge representation. The advantages of using ontologies are manifold: The ontology can be downloaded from the web and read by anyone freely The information is modeled in a more flexible way than using tables Their semantic definition of information enables a classification of knowledge (e.g. a tool that performs active measurement is an active tool) and inference (e.g. if a measurement is over a threshold then the network is overloaded) At the same time it is possible to query this knowledge (e.g. obtain all measurements with a given destination address). TELEFÓNICA I+D 3
Need for standardization There is no standard to share network measurements between several parties. However, some standards are devoted to obtain measurements (RMON) and format measurements (IPFIX, OGF-NMWG). Our proposal is to use ontologies for such data sharing. Information can be processed at a semantic level. Existing semantic web technologies can be applied in this context, such as SPARQL queries. Data is directly formatted in XML with a well-known schema General concepts can be taken from well-known ontologies such as W3C Time, Units, FOAF, etc. Ontologies need to be agreed to be useful (become used) There is a communication gap between ontologies and users of information and communication systems, where such ontologies are used, also on user interfaces. It is important to standardize them! TELEFÓNICA I+D 4
The scope of MOI Industrial Specification Group Setting up the IP traffic measurement ontology is regarded as a keystone to implement interoperable systems for traffic monitoring and beyond, for QoS/QoE management and SLA definition. The information model should be flexible and integrate all precedent ones: Parameters already defined are being mapped to the ontology classes. Metadata definitions allow for a well structured ontology. It is set in agreement with OGF and DatCat models Data definitions are being defined to map most RFCs and QoS recommendations already issued from other standardization bodies Their relationships are being defined so that complex KPI, QPI and BPI (Business performance indicator) can be further established. QoS-QoE correlation mechanisms IP network monitoring systems Quality control systems Parameters of Applications quality IP measurements ontologies TELEFÓNICA I+D 5
And so MOI ISG was founded in September 2009 Co-founders ETSI members are CNIT (Consorzio Nazionale Interuniversitarioperle Telecomunicazioni). Telefónica Universidad Autónoma de Madrid Universidad Pública de Navarra Waterford Institute of Technology ETSI creates new Industry Specification Group on IP traffic measurement TELEFÓNICA I+D 6
Objectives of MOI ISG Establishing a complete ontology for IP traffic monitoring including relationships with privacy protection, QoS and QoE Help standardizing protocols to request KPI with semantic systems. Contribute to define standards for traffic measurement and monitoring devices as far as their interfaces and data storing (exchange) concern. Cooperate with other standardization bodies and Future Internet working groups Future Internet paradigms and challenges that will benefit of MOI: Semantic treatment of information: Internet as a big pool of data and services. Sevice-aware network management enabled by powerful inter-domain traffic monitoring systems Network-centric solutions for network and information resources orchestration with QoS. User-centric approaches with QoE and privacy protection Distributed inter-operator facilities to supervise QoS and SLA. Support for network-centric applications to security services TELEFÓNICA I+D 7
Reference Framework of of MOI ISG Boosted by three European projects: TRAMMS (Traffic Measurements and Models in Multi-Service Networks) CELTIC project with two correlated objectives: o o Developing hardware and software tools for IP traffic measurement Analysing access traffic and developing models for analyzing user behaviour. PRISM (PRIvacy-aware Secure Monitoring) FP7 project that proposes to develop a two-tier privacy-compliant integrated monitoring architecture. MOMENT (Monitoring and Measurement in the Next generation Technologies) FP7 project whose main goal is designing and developing a universal interface to different traffic monitoring tools and data bases. Semantic approach to access the measuring systems. o A demo of the mediator can be achieved by clicking this link. TELEFÓNICA I+D 8
Work plan Rapid development of the ISG work items so that the ETSI OCG (Operational Co-ordination Group) can evaluate whether its topic is relevant for standardization. MOI is working in three items that are scheduled to be issued before June 2010: MOI-0001: Report on information models for IP traffic measurement MOI-0002: Requirements for IP traffic measurement ontologies development MOI-0003: IP traffic measurement ontologies architecture Potential of innovation? R&I Pre-Standardization Real Industry need? Needs Standards Making Test, Certification Requirements Regulation Archit ecture +Syst em Marketing Proto cols Inter- Opera bility Pre-Standardization Standardization TELEFÓNICA I+D 9
Current activities MOI-0001 is finished The possibilities of seamless spreading the defined ontology through adjacent fields in the development of Future Internet and next generation networks management as well as of bridging the ontology proposed by MOI to other standardization groups has been analyzed. MOI-0002 is ongoing Main topics of this WI require analyzing use cases for which IP traffic measurements are used. The specification of IP traffic measurement data ontology includes the methodology to form the required ontology as well as its relationship with other sources of semantic information models. MOI-0003 needs MOI-0002 inputs but a complete scheme of the components required to set the ontology is already set up: A metadata ontology definition. A measurement data ontology definition A data anonymization ontology definition TELEFÓNICA I+D 10
Further steps Aiming at cooperative actions with other groups The ISG is open to new comers Aside from the ETSI members, four external partners cooperate within MOI. All MOI partners are active in MANA group (FIA) and workshops around TMA. o o Two workshops were organized by several MOI partners MOI partners also contribute to Future Internet Cluster Meetings and disseminate their work through the ETSI portal and conferences. Aiming at supporting QoS and QoE standardization activities To complete interface specifications and data exchange formats To establish a well structured framework for future traffic monitoring systems upon which QoS applications rely. To define coherent mechanisms of privacy protection in TMA. TELEFÓNICA I+D 11
Further steps Aiming at cooperative actions with other groups The ISG is open to new comers Aside from the ETSI members, four external partners cooperate within MOI. All MOI partners are active in MANA group (FIA) and workshops around TMA. o o Two workshops were organized by several MOI partners MOI partners also contribute to Future Internet Cluster Meetings and disseminate their work through the ETSI portal and conferences. Aiming at supporting QoS and QoE standardization activities To complete interface specifications and data exchange formats To establish a well structured framework for future traffic monitoring systems upon which QoS applications rely. To define coherent mechanisms of privacy protection in TMA. TELEFÓNICA I+D 12
Qos and QoE is a puzzle of many pieces The traffic measurement ontology will enable a perfect fitting QoS classes for types of applications Service performance analysis by traffic inspection Codecs and STB oriented to QoE IP traffic measurement interoperable tools Anonymization tools for traffic inspection with privacy respect SLA and regulatory rules on QoE definitions Traffic modeling and detection of anomalies QoS parameters standardized on a robust ontology Correlation between QoE and QoS TELEFÓNICA I+D 13
2008 Telefónica Investigación y Desarrollo, S.A. Unipersonal Thank you for your attention