Enriching knowledge graphs with text processing techniques

Size: px
Start display at page:

Download "Enriching knowledge graphs with text processing techniques"

Transcription

1 Enriching knowledge graphs with text processing techniques ERCIM News 111: J.-M. Le Goff, CERN A. Rattinger CERN & Graz University of Technology I-Know, Graz, Austria 12 October

2 Agenda Our approach: Building knowledge graph and graph data model Identifying Concepts and relationships in full text Enriching knowledge graph Text mining for graph extensions (preliminary) Use case: patents and publications analytics iknow2017 2

3 Heterogeneous data sources Text Data model 3

4 Why building a knowledge graph out of datasets? Datasets contain valuable information for visual analytics Businesses, applications, domains, etc. Datasets are difficult to use directly for visual analytics They contain complex structures with various data types They come with different data representations Structured, semi-structured and unstructured Only subsets are of interest for a particular analysis Need domain specific information to understand analytics output Build data network with elements of interest in datasets Vertices: data instances with labelled data types Relationships: interconnectivity iknow2017 4

5 Data network stored as a graph Graphs are natural representations of large and interconnected networks Complexity Interconnectivity Scalability Multi dimensionality Data model is embedded in the graph itself Node and relationship labels Compact graph structure Graph query language No need for schema evolution Graphs of connected elements constitute multi-dimensional networks Data model: labels and relationships Labels Graph dimensions Relationships Interconnectivity between Labels Data Network = Knowledge graph 5

6 Knowledge graph Data model Graph of data instances and relationships Graph data model: Schema Data model embedded in knowledge graph 6

7 Data source 1 Knowledge Graph Data source n Processing Populating Organising Labelling Visual analytics Data sources Visual analytics is performed on the network using its schema 7

8 Labelling Labelling Vertices Semi-structured data: Metadata Structural information Tags labels Structured data: Relational Databases tables, fields labels Text processing to create new labels, new vertices Labelling Relationships Semi-structured data: Relationships from nested tags (Has, ispartof, etc.) Structured data: Relational Databases No labels in E-R Models Vertex Labels + text information to label relationships Ex: IsA, send, receive, live, own, etc. 12/10/2017 iknow2017 8

9 Ex: Publications/Patents Metadata Published Items Publications: (Scopus, WoK, etc.) Organisation address (in data) Keyword (in data) Category (in data) Journal Category Patents: (PatStat, etc.) Organisation Address (in data) Category (in data) Patent class 12/10/2017 iknow2017 9

10 Data Model from Metadata tags Cat: Scat PubItem: Pub KW Org: Addre ss Cat: PatClas PubItem: Pat Document metadata Kw: Keyword, PubItem: Published Item OrgAdd: Organisation Address Data Model: Graph of labels 10

11 Publications/Patents Metadata Published Items Publications: Organisation address Text processing Organisation (from other data sources: Company, Institute) City Country Keyword (in data) Category (in data) Journal Category Patents: Organisation Address Text processing Organisation (from other data sources: Company, Institute) City Country Category (in data) Patent class 12/10/2017 iknow

12 Exploiting text information Cat: Scat PubItem: Pub: WoK KW isa Org: Comp Cny islocated Cty islocated Org Address isa Org: Inst Cat: PatClas PubItem: Pat Document metadata Data Model: Graph of labels Kw: Keyword, Org: Organisation, Inst: Institute, Comp: Company, Cny: Country Cty: City, OrgAdd: Organisation Address 12

13 Data sources: - patent & publications metadata - Patent full text (USPTO) Preliminary work 13

14 Publications/Patents analytics Use case: Who are the key organisations active in a particular technology? Motivations Technology monitoring, How an emerging technology is evolving (Research Industry) foresight studies, looking for partners, join collaborations Company, institution landscape iknow

15 Publications/Patents analytics (2) Use case: What is the organisation landscape of a technology? Technique: Search for pub/pat matching technology terms Titles and/or abstracts Issues Quality of the technology terms to identify a technology Search terms may not correspond to a single technology Some pertinent publications and patents may not contain the technology terms Use text processing to address these issues iknow

16 Add search output to knowledge graph Cat: Scat PubItem: Pub: WoK KW isa Org: Comp Cny islocated Cty islocated Org Address Search isa Org: Inst Cat: PatClas PubItem: Pat Search output: A subset of publications and patents matching technology terms 16

17 Illustrating the approach Through Silicon Via Wikipedia Search terms on titles of pub/pat: Through Silicon Via Exact matching High quality output TSV More but with lower quality output iknow

18 Technology: Through Silicon Via (TSV) iknow

19 Keywords: Through Silicon Via (title) iknow

20 Keywords: TSV (title) TSV also means: Taura Syndrome Virus iknow

21 Methodology Preliminary work 21

22 Approach Index Patents Patent specific preprocessing Create document embedding / Feature vectors (Doc2Vec) Dimensionality reduction / Manifold learning (t-sne, LargeVis) Visualization (Datashader Large scale visualization) iknow

23 Index Patents / Preprocessing Current Dataset: USPTO Patents from Candidate Generation: Patents are indexed for fuzzy search (lucene) Preprocessing Clean HTML syntax Remove references, stopwords iknow

24 Document Embedding Numeric representation of text documents Gensim Implementation - Based on word2vec-cbow Concept: Le, Q., & Mikolov, T. (2014). Distributed representations of sentences and documents. iknow

25 Dimensionality Reduction Our dataset contains 2 million points with 300 Dimensions Many costly techniques (MDS, t-sne) iknow

26 Large Scale Visualization Datashader Rasterization pipeline Handles large amounts of data Patent Class Labels A: Human necessities B: Performing operations; transporting C: Chemistry; Metallurgy D: Textiles; Paper E: Fixed Constructions F: Mechanical engineering; lighting; G: Physics H: Electricity Colours correspond to distinct labels (2,022,349 Patents) iknow

27 Full text processing Patent full text: Title + Abstract + Description USPTO full text patent Objective 1: Look for pertinent patents that do not contain Through Silicon Via 2: Look for different meanings of TSV iknow

28 International Patent Classification (IPC) Sections from A ( Human Necessities ) to H ( Electricity ) Classes (A01 "Agriculture; forestry; animal husbandry; trapping; fishing") Subclasses, Group Number, Subgroup Example: H01L 23/00 (Details of semiconductor or other solid state devices) iknow

29 Patent Class G (Physics) Overview 378,692 Patents iknow

30 Patent Search (TSV or Through Silicon Via) Most prominent patent classes (1696 results) Document Embedding iknow

31 Comparison of Through Silicon Via vs TSV Relevant data differs for relevant search results Through Silicon Via (954 Results) TSV (982 Results) iknow

32 Through Silicon Via vs TSV Relevant documents to the search for different terms Through Silicon Via (954 Results) TSV (982 Results) iknow

33 Derive new relationships Cat: Scat PubItem: Pub: WoK KW isa Org: Comp Cny islocated Cty islocated Org Address Search isa Org: Inst Cat: PatClas PubItem: Pat iknow

34 Search extended to publications Publications: Titles + Abstracts Publications offer a different viewpoint Publications are classified according to the n-closest patent classes G6F: Electric Digital Data Processing (Through Silicon Via (Antenna)) A61K: Medical or Veterinary Science (Taura-Syndrom-Virus, tachycardia beat, Tellerspülvermögens) iknow

35 Conclusion Networks populated with metadata need to be enriched to properly support Visual Analytics Enrichment can come from additional data sources or from text processing on the documents referenced in the metadata Preliminary text processing results on patents (title, abstract and description) indicate that it is possible to: Enrich a patent set w.r.t. a search result Regroup patents via patent categories showing different meaning of search terms Link some of the publications with nearby patents iknow

36 Thank you for your attention!

Big Data analytics and Visualization

Big Data analytics and Visualization Big Data analytics and Visualization MTA Cloud symposium A. Agocs, D. Dardanis, R. Forster, J.-M. Le Goff, X. Ouvrard CERN MTA Head quarters, Budapest, 17 February 2017 1 Background information Collaboration

More information

Maximizing the Value of STM Content through Semantic Enrichment. Frank Stumpf December 1, 2009

Maximizing the Value of STM Content through Semantic Enrichment. Frank Stumpf December 1, 2009 Maximizing the Value of STM Content through Semantic Enrichment Frank Stumpf December 1, 2009 What is Semantics and Semantic Processing? Content Knowledge Framework Technology Framework Search Text Images

More information

WIPO S ACTIVITIES IN PATENT TRANSLATION AND TERMINOLOGY

WIPO S ACTIVITIES IN PATENT TRANSLATION AND TERMINOLOGY WIPO S ACTIVITIES IN PATENT TRANSLATION AND TERMINOLOGY Machine Translation example Machine Translation: The present invention relates to a fastening of a veliplanchist (4) comprising a hook (30) and a

More information

Fact Sheet How to search for patent information

Fact Sheet How to search for patent information www.iprhelpdesk.eu European IPR Helpdesk Fact Sheet How to search for patent information This fact sheet has been developed in cooperation with January 2018 1 1. What information is presented in a patent

More information

Hebei University of Technology A Text-Mining-based Patent Analysis in Product Innovative Process

Hebei University of Technology A Text-Mining-based Patent Analysis in Product Innovative Process A Text-Mining-based Patent Analysis in Product Innovative Process Liang Yanhong, Tan Runhua Abstract Hebei University of Technology Patent documents contain important technical knowledge and research results.

More information

Creating a Recommender System. An Elasticsearch & Apache Spark approach

Creating a Recommender System. An Elasticsearch & Apache Spark approach Creating a Recommender System An Elasticsearch & Apache Spark approach My Profile SKILLS Álvaro Santos Andrés Big Data & Analytics Solution Architect in Ericsson with more than 12 years of experience focused

More information

A B2B Search Engine. Abstract. Motivation. Challenges. Technical Report

A B2B Search Engine. Abstract. Motivation. Challenges. Technical Report Technical Report A B2B Search Engine Abstract In this report, we describe a business-to-business search engine that allows searching for potential customers with highly-specific queries. Currently over

More information

This tutorial has been prepared for computer science graduates to help them understand the basic-to-advanced concepts related to data mining.

This tutorial has been prepared for computer science graduates to help them understand the basic-to-advanced concepts related to data mining. About the Tutorial Data Mining is defined as the procedure of extracting information from huge sets of data. In other words, we can say that data mining is mining knowledge from data. The tutorial starts

More information

Visualization and text mining of patent and non-patent data

Visualization and text mining of patent and non-patent data of patent and non-patent data Anton Heijs Information Solutions Delft, The Netherlands http://www.treparel.com/ ICIC conference, Nice, France, 2008 Outline Introduction Applications on patent and non-patent

More information

A Survey Of Different Text Mining Techniques Varsha C. Pande 1 and Dr. A.S. Khandelwal 2

A Survey Of Different Text Mining Techniques Varsha C. Pande 1 and Dr. A.S. Khandelwal 2 A Survey Of Different Text Mining Techniques Varsha C. Pande 1 and Dr. A.S. Khandelwal 2 1 Department of Electronics & Comp. Sc, RTMNU, Nagpur, India 2 Department of Computer Science, Hislop College, Nagpur,

More information

Overview of Web Mining Techniques and its Application towards Web

Overview of Web Mining Techniques and its Application towards Web Overview of Web Mining Techniques and its Application towards Web *Prof.Pooja Mehta Abstract The World Wide Web (WWW) acts as an interactive and popular way to transfer information. Due to the enormous

More information

Table Of Contents: xix Foreword to Second Edition

Table Of Contents: xix Foreword to Second Edition Data Mining : Concepts and Techniques Table Of Contents: Foreword xix Foreword to Second Edition xxi Preface xxiii Acknowledgments xxxi About the Authors xxxv Chapter 1 Introduction 1 (38) 1.1 Why Data

More information

Chapter 27 Introduction to Information Retrieval and Web Search

Chapter 27 Introduction to Information Retrieval and Web Search Chapter 27 Introduction to Information Retrieval and Web Search Copyright 2011 Pearson Education, Inc. Publishing as Pearson Addison-Wesley Chapter 27 Outline Information Retrieval (IR) Concepts Retrieval

More information

Natural Language Processing with PoolParty

Natural Language Processing with PoolParty Natural Language Processing with PoolParty Table of Content Introduction to PoolParty 2 Resolving Language Problems 4 Key Features 5 Entity Extraction and Term Extraction 5 Shadow Concepts 6 Word Sense

More information

Databases and Information Retrieval Integration TIETS42. Kostas Stefanidis Autumn 2016

Databases and Information Retrieval Integration TIETS42. Kostas Stefanidis Autumn 2016 + Databases and Information Retrieval Integration TIETS42 Autumn 2016 Kostas Stefanidis kostas.stefanidis@uta.fi http://www.uta.fi/sis/tie/dbir/index.html http://people.uta.fi/~kostas.stefanidis/dbir16/dbir16-main.html

More information

Semantic Web Technology Evaluation Ontology (SWETO): A test bed for evaluating tools and benchmarking semantic applications

Semantic Web Technology Evaluation Ontology (SWETO): A test bed for evaluating tools and benchmarking semantic applications Semantic Web Technology Evaluation Ontology (SWETO): A test bed for evaluating tools and benchmarking semantic applications WWW2004 (New York, May 22, 2004) Semantic Web Track, Developers Day Boanerges

More information

Contents. Foreword to Second Edition. Acknowledgments About the Authors

Contents. Foreword to Second Edition. Acknowledgments About the Authors Contents Foreword xix Foreword to Second Edition xxi Preface xxiii Acknowledgments About the Authors xxxi xxxv Chapter 1 Introduction 1 1.1 Why Data Mining? 1 1.1.1 Moving toward the Information Age 1

More information

Visual Analysis of Classification Scheme

Visual Analysis of Classification Scheme Visual Analysis of Classification Scheme Veslava Osińska Institute of Information Science and Book Studies Nicolaus Copernicus University Toruń, Poland 1/26 Information Visualization (INFOVIS) Visualization

More information

Applying Auto-Data Classification Techniques for Large Data Sets

Applying Auto-Data Classification Techniques for Large Data Sets SESSION ID: PDAC-W02 Applying Auto-Data Classification Techniques for Large Data Sets Anchit Arora Program Manager InfoSec, Cisco The proliferation of data and increase in complexity 1995 2006 2014 2020

More information

Semantic Web Technology Evaluation Ontology (SWETO): A Test Bed for Evaluating Tools and Benchmarking Applications

Semantic Web Technology Evaluation Ontology (SWETO): A Test Bed for Evaluating Tools and Benchmarking Applications Wright State University CORE Scholar Kno.e.sis Publications The Ohio Center of Excellence in Knowledge- Enabled Computing (Kno.e.sis) 5-22-2004 Semantic Web Technology Evaluation Ontology (SWETO): A Test

More information

Efficient, Scalable, and Provenance-Aware Management of Linked Data

Efficient, Scalable, and Provenance-Aware Management of Linked Data Efficient, Scalable, and Provenance-Aware Management of Linked Data Marcin Wylot 1 Motivation and objectives of the research The proliferation of heterogeneous Linked Data on the Web requires data management

More information

Organizing Economic Information

Organizing Economic Information Organizing Economic Information An Overview of Application and Reuse Scenarios of an Economics Knowledge Organization System Tobias Rebholz, Andreas Oskar Kempf, Joachim Neubert ZBW Leibniz Information

More information

MESH. Multimedia Semantic Syndication for Enhanced News Services. Project Overview

MESH. Multimedia Semantic Syndication for Enhanced News Services. Project Overview MESH Multimedia Semantic Syndication for Enhanced News Services Project Overview Presentation Structure 2 Project Summary Project Motivation Problem Description Work Description Expected Result The MESH

More information

Foundations of SPARQL Query Optimization

Foundations of SPARQL Query Optimization Foundations of SPARQL Query Optimization Michael Schmidt, Michael Meier, Georg Lausen Albert-Ludwigs-Universität Freiburg Database and Information Systems Group 13 th International Conference on Database

More information

1. Inroduction to Data Mininig

1. Inroduction to Data Mininig 1. Inroduction to Data Mininig 1.1 Introduction Universe of Data Information Technology has grown in various directions in the recent years. One natural evolutionary path has been the development of the

More information

Presented by: Dimitri Galmanovich. Petros Venetis, Alon Halevy, Jayant Madhavan, Marius Paşca, Warren Shen, Gengxin Miao, Chung Wu

Presented by: Dimitri Galmanovich. Petros Venetis, Alon Halevy, Jayant Madhavan, Marius Paşca, Warren Shen, Gengxin Miao, Chung Wu Presented by: Dimitri Galmanovich Petros Venetis, Alon Halevy, Jayant Madhavan, Marius Paşca, Warren Shen, Gengxin Miao, Chung Wu 1 When looking for Unstructured data 2 Millions of such queries every day

More information

Preprocessing of Stream Data using Attribute Selection based on Survival of the Fittest

Preprocessing of Stream Data using Attribute Selection based on Survival of the Fittest Preprocessing of Stream Data using Attribute Selection based on Survival of the Fittest Bhakti V. Gavali 1, Prof. Vivekanand Reddy 2 1 Department of Computer Science and Engineering, Visvesvaraya Technological

More information

Query Phrase Expansion using Wikipedia for Patent Class Search

Query Phrase Expansion using Wikipedia for Patent Class Search Query Phrase Expansion using Wikipedia for Patent Class Search 1 Bashar Al-Shboul, Sung-Hyon Myaeng Korea Advanced Institute of Science and Technology (KAIST) December 19 th, 2011 AIRS 11, Dubai, UAE OUTLINE

More information

Using ESML in a Semantic Web Approach for Improved Earth Science Data Usability

Using ESML in a Semantic Web Approach for Improved Earth Science Data Usability Using in a Semantic Web Approach for Improved Earth Science Data Usability Rahul Ramachandran, Helen Conover, Sunil Movva and Sara Graves Information Technology and Systems Center University of Alabama

More information

Efficient Processing of Multiple DTW Queries in Time Series Databases

Efficient Processing of Multiple DTW Queries in Time Series Databases Efficient Processing of Multiple DTW Queries in Time Series Databases Hardy Kremer 1 Stephan Günnemann 1 Anca-Maria Ivanescu 1 Ira Assent 2 Thomas Seidl 1 1 RWTH Aachen University, Germany 2 Aarhus University,

More information

Parallel Approach for Implementing Data Mining Algorithms

Parallel Approach for Implementing Data Mining Algorithms TITLE OF THE THESIS Parallel Approach for Implementing Data Mining Algorithms A RESEARCH PROPOSAL SUBMITTED TO THE SHRI RAMDEOBABA COLLEGE OF ENGINEERING AND MANAGEMENT, FOR THE DEGREE OF DOCTOR OF PHILOSOPHY

More information

Katrin Weller & Isabella Peters

Katrin Weller & Isabella Peters Tag Gardening Activities for Folksonomy Maintenance and Enrichment Katrin Weller & Isabella Peters Heinrich-Heine-University Düsseldorf Institute for Language and Information Dept. of Information Science

More information

AltiumLive 2017: Novel Thermal Analysis Tool for Altium Designer

AltiumLive 2017: Novel Thermal Analysis Tool for Altium Designer AltiumLive 2017: Novel Thermal Analysis Tool for Altium Designer Bernd Schröder Fraunhofer IZM, Berlin Munich October 24-25, 2017 Agenda 1 Fraunhofer Institute for Reliability and Microintegration IZM

More information

USER MANUAL R e d e f i n i n g u s e r e x p e r i e n c e

USER MANUAL R e d e f i n i n g u s e r e x p e r i e n c e USER MANUAL R e d e f i n i n g u s e r e x p e r i e n c e Index 1. Login 2. Patent Searching: Field Search Command Search Operators and truncation options Bulk Search Classification Search Granted patents

More information

A Novel Approach of Data Warehouse OLTP and OLAP Technology for Supporting Management prospective

A Novel Approach of Data Warehouse OLTP and OLAP Technology for Supporting Management prospective A Novel Approach of Data Warehouse OLTP and OLAP Technology for Supporting Management prospective B.Manivannan Research Scholar, Dept. Computer Science, Dravidian University, Kuppam, Andhra Pradesh, India

More information

Building Geospatial Mashups to Visualize Information for Crisis Management. Shubham Gupta and Craig A. Knoblock University of Southern California

Building Geospatial Mashups to Visualize Information for Crisis Management. Shubham Gupta and Craig A. Knoblock University of Southern California Building Geospatial Mashups to Visualize Information for Crisis Management Shubham Gupta and Craig A. Knoblock University of Southern California 1 WHAT IS A GEOSPATIAL MASHUP? Integrated View of data combined

More information

HPE ControlPoint. Bill Manago, CRM IG Lead Solutions Consultant HPE Software

HPE ControlPoint. Bill Manago, CRM IG Lead Solutions Consultant HPE Software HPE ControlPoint Bill Manago, CRM IG Lead Solutions Consultant HPE Software Today s BIG Unstructured Data Challenges How do I reduce cost associated with IT and information processes? Information footprint

More information

Table of Contents 1 Introduction A Declarative Approach to Entity Resolution... 17

Table of Contents 1 Introduction A Declarative Approach to Entity Resolution... 17 Table of Contents 1 Introduction...1 1.1 Common Problem...1 1.2 Data Integration and Data Management...3 1.2.1 Information Quality Overview...3 1.2.2 Customer Data Integration...4 1.2.3 Data Management...8

More information

Variety-Aware OLAP of Document-Oriented Databases

Variety-Aware OLAP of Document-Oriented Databases Variety-Aware OLAP of Document-Oriented Databases Enrico Gallinucci, Matteo Golfarelli, Stefano Rizzi DISI University of Bologna, Italy Introduction In recent years, schemalessdbmss have progressively

More information

9. Conclusions. 9.1 Definition KDD

9. Conclusions. 9.1 Definition KDD 9. Conclusions Contents of this Chapter 9.1 Course review 9.2 State-of-the-art in KDD 9.3 KDD challenges SFU, CMPT 740, 03-3, Martin Ester 419 9.1 Definition KDD [Fayyad, Piatetsky-Shapiro & Smyth 96]

More information

Knowledge Engineering with Semantic Web Technologies

Knowledge Engineering with Semantic Web Technologies This file is licensed under the Creative Commons Attribution-NonCommercial 3.0 (CC BY-NC 3.0) Knowledge Engineering with Semantic Web Technologies Lecture 5: Ontological Engineering 5.3 Ontology Learning

More information

Knowledge Discovery. Javier Béjar URL - Spring 2019 CS - MIA

Knowledge Discovery. Javier Béjar URL - Spring 2019 CS - MIA Knowledge Discovery Javier Béjar URL - Spring 2019 CS - MIA Knowledge Discovery (KDD) Knowledge Discovery in Databases (KDD) Practical application of the methodologies from machine learning/statistics

More information

Enrichment of Sensor Descriptions and Measurements Using Semantic Technologies. Student: Alexandra Moraru Mentor: Prof. Dr.

Enrichment of Sensor Descriptions and Measurements Using Semantic Technologies. Student: Alexandra Moraru Mentor: Prof. Dr. Enrichment of Sensor Descriptions and Measurements Using Semantic Technologies Student: Alexandra Moraru Mentor: Prof. Dr. Dunja Mladenić Environmental Monitoring automation Traffic Monitoring integration

More information

Representation/Indexing (fig 1.2) IR models - overview (fig 2.1) IR models - vector space. Weighting TF*IDF. U s e r. T a s k s

Representation/Indexing (fig 1.2) IR models - overview (fig 2.1) IR models - vector space. Weighting TF*IDF. U s e r. T a s k s Summary agenda Summary: EITN01 Web Intelligence and Information Retrieval Anders Ardö EIT Electrical and Information Technology, Lund University March 13, 2013 A Ardö, EIT Summary: EITN01 Web Intelligence

More information

1 Copyright 2011, Oracle and/or its affiliates. All rights reserved.

1 Copyright 2011, Oracle and/or its affiliates. All rights reserved. 1 Copyright 2011, Oracle and/or its affiliates. All rights reserved. Integrating Complex Financial Workflows in Oracle Database Xavier Lopez Seamus Hayes Oracle PolarLake, LTD 2 Copyright 2011, Oracle

More information

Semantic Technologies for Nuclear Knowledge Modelling and Applications

Semantic Technologies for Nuclear Knowledge Modelling and Applications Semantic Technologies for Nuclear Knowledge Modelling and Applications D. Beraha 3 rd International Conference on Nuclear Knowledge Management 7.-11.11.2016, Vienna, Austria Why Semantics? Machines understanding

More information

A SURVEY- WEB MINING TOOLS AND TECHNIQUE

A SURVEY- WEB MINING TOOLS AND TECHNIQUE International Journal of Latest Trends in Engineering and Technology Vol.(7)Issue(4), pp.212-217 DOI: http://dx.doi.org/10.21172/1.74.028 e-issn:2278-621x A SURVEY- WEB MINING TOOLS AND TECHNIQUE Prof.

More information

MetaData for Database Mining

MetaData for Database Mining MetaData for Database Mining John Cleary, Geoffrey Holmes, Sally Jo Cunningham, and Ian H. Witten Department of Computer Science University of Waikato Hamilton, New Zealand. Abstract: At present, a machine

More information

Challenges and Opportunities with Big Data. By: Rohit Ranjan

Challenges and Opportunities with Big Data. By: Rohit Ranjan Challenges and Opportunities with Big Data By: Rohit Ranjan Introduction What is Big Data? Big data is data sets that are so voluminous and complex that traditional data processing application software

More information

PESIT- Bangalore South Campus Hosur Road (1km Before Electronic city) Bangalore

PESIT- Bangalore South Campus Hosur Road (1km Before Electronic city) Bangalore Data Warehousing Data Mining (17MCA442) 1. GENERAL INFORMATION: PESIT- Bangalore South Campus Hosur Road (1km Before Electronic city) Bangalore 560 100 Department of MCA COURSE INFORMATION SHEET Academic

More information

Guide Users along Information Pathways and Surf through the Data

Guide Users along Information Pathways and Surf through the Data Guide Users along Information Pathways and Surf through the Data Stephen Overton, Overton Technologies, LLC, Raleigh, NC ABSTRACT Business information can be consumed many ways using the SAS Enterprise

More information

Toward a Knowledge-Based Solution for Information Discovery in Complex and Dynamic Domains

Toward a Knowledge-Based Solution for Information Discovery in Complex and Dynamic Domains Toward a Knowledge-Based Solution for Information Discovery in Complex and Dynamic Domains Eloise Currie and Mary Parmelee SAS Institute, Cary NC About SAS: The Power to Know SAS: The Market Leader in

More information

Web Mining Evolution & Comparative Study with Data Mining

Web Mining Evolution & Comparative Study with Data Mining Web Mining Evolution & Comparative Study with Data Mining Anu, Assistant Professor (Resource Person) University Institute of Engineering and Technology Mahrishi Dayanand University Rohtak-124001, India

More information

Knowledge Discovery and Data Mining

Knowledge Discovery and Data Mining Knowledge Discovery and Data Mining Unit # 2 Sajjad Haider Spring 2010 1 Structured vs. Non-Structured Data Most business databases contain structured data consisting of well-defined fields with numeric

More information

Recognition of Animal Skin Texture Attributes in the Wild. Amey Dharwadker (aap2174) Kai Zhang (kz2213)

Recognition of Animal Skin Texture Attributes in the Wild. Amey Dharwadker (aap2174) Kai Zhang (kz2213) Recognition of Animal Skin Texture Attributes in the Wild Amey Dharwadker (aap2174) Kai Zhang (kz2213) Motivation Patterns and textures are have an important role in object description and understanding

More information

Accessing Web Archives

Accessing Web Archives Accessing Web Archives Web Science Course 2017 Helge Holzmann 05/16/2017 Helge Holzmann (holzmann@l3s.de) Not today s topic http://blog.archive.org/2016/09/19/the-internet-archive-turns-20/ 05/16/2017

More information

Patent Classification Codes Made Easy

Patent Classification Codes Made Easy Derwent Innovation Blueprint for Success Research Patents in a Specific Technology Domain Can I find all patents for a specific technology? How do I make that sure my keyword searches find all the patents

More information

Assessing Metadata Utilization: An Analysis of MARC Content Designation Use

Assessing Metadata Utilization: An Analysis of MARC Content Designation Use Assessing Metadata Utilization: An Analysis of MARC Content Designation Use William E. Moen , Penelope Benardino School of Library and Information Sciences, Texas Center

More information

IC-SDV 2018 Automatic Text categorization in the International Patent Classification

IC-SDV 2018 Automatic Text categorization in the International Patent Classification IC-SDV 2018 Automatic Text categorization in the International Patent Classification IPCCAT-Neural Patrick FIÉVET & Jacques GUYOT Nice April 23, 2018 2 IPCCAT-neural : automatic text categorization in

More information

Using patent classification for searching, in particular the International Patent Classification (IPC)

Using patent classification for searching, in particular the International Patent Classification (IPC) Using patent classification for searching, in particular the International Patent Classification (IPC) Andrew Czajkowski Head, Innovation and Technology Support Section Cebu & Manila March 7 to 11 2011

More information

Time: 3 hours. Full Marks: 70. The figures in the margin indicate full marks. Answers from all the Groups as directed. Group A.

Time: 3 hours. Full Marks: 70. The figures in the margin indicate full marks. Answers from all the Groups as directed. Group A. COPYRIGHT RESERVED End Sem (V) MCA (XXVIII) 2017 Time: 3 hours Full Marks: 70 Candidates are required to give their answers in their own words as far as practicable. The figures in the margin indicate

More information

SEXTANT 1. Purpose of the Application

SEXTANT 1. Purpose of the Application SEXTANT 1. Purpose of the Application Sextant has been used in the domains of Earth Observation and Environment by presenting its browsing and visualization capabilities using a number of link geospatial

More information

WEB SEARCH, FILTERING, AND TEXT MINING: TECHNOLOGY FOR A NEW ERA OF INFORMATION ACCESS

WEB SEARCH, FILTERING, AND TEXT MINING: TECHNOLOGY FOR A NEW ERA OF INFORMATION ACCESS 1 WEB SEARCH, FILTERING, AND TEXT MINING: TECHNOLOGY FOR A NEW ERA OF INFORMATION ACCESS BRUCE CROFT NSF Center for Intelligent Information Retrieval, Computer Science Department, University of Massachusetts,

More information

Record Linkage using Probabilistic Methods and Data Mining Techniques

Record Linkage using Probabilistic Methods and Data Mining Techniques Doi:10.5901/mjss.2017.v8n3p203 Abstract Record Linkage using Probabilistic Methods and Data Mining Techniques Ogerta Elezaj Faculty of Economy, University of Tirana Gloria Tuxhari Faculty of Economy, University

More information

Distance-based Outlier Detection: Consolidation and Renewed Bearing

Distance-based Outlier Detection: Consolidation and Renewed Bearing Distance-based Outlier Detection: Consolidation and Renewed Bearing Gustavo. H. Orair, Carlos H. C. Teixeira, Wagner Meira Jr., Ye Wang, Srinivasan Parthasarathy September 15, 2010 Table of contents Introduction

More information

STRATEGIC INFORMATION SYSTEMS IV STV401T / B BTIP05 / BTIX05 - BTECH DEPARTMENT OF INFORMATICS. By: Dr. Tendani J. Lavhengwa

STRATEGIC INFORMATION SYSTEMS IV STV401T / B BTIP05 / BTIX05 - BTECH DEPARTMENT OF INFORMATICS. By: Dr. Tendani J. Lavhengwa STRATEGIC INFORMATION SYSTEMS IV STV401T / B BTIP05 / BTIX05 - BTECH DEPARTMENT OF INFORMATICS LECTURE: 05 (A) DATA WAREHOUSING (DW) By: Dr. Tendani J. Lavhengwa lavhengwatj@tut.ac.za 1 My personal quote:

More information

INTERNATIONAL JOURNAL OF PURE AND APPLIED RESEARCH IN ENGINEERING AND TECHNOLOGY

INTERNATIONAL JOURNAL OF PURE AND APPLIED RESEARCH IN ENGINEERING AND TECHNOLOGY INTERNATIONAL JOURNAL OF PURE AND APPLIED RESEARCH IN ENGINEERING AND TECHNOLOGY A PATH FOR HORIZING YOUR INNOVATIVE WORK A SURVEY ON WEB CONTENT MINING DEVEN KENE 1, DR. PRADEEP K. BUTEY 2 1 Research

More information

Agricultural bibliographic data sharing & interoperability in China

Agricultural bibliographic data sharing & interoperability in China Agricultural bibliographic data sharing & interoperability in China Prof. Xuefu Zhang,Xian Guojian and Sun Wei Agricultural Information Institute of CAAS Asia Pacific Advanced Network Meeting, 29 Aug.,

More information

Scuola di dottorato in Scienze molecolari Information literacy in chemistry 2015 SCOPUS

Scuola di dottorato in Scienze molecolari Information literacy in chemistry 2015 SCOPUS SCOPUS ORIGINAL RESEARCH INFORMATION IN SCIENCE is published (stored) in PRIMARY LITERATURE it refers to the first place a scientist will communicate to the general audience in a publicly accessible document

More information

USPTO INVENTOR DISAMBIGUATION

USPTO INVENTOR DISAMBIGUATION Team Member: Yang GuanCan Zhang Jing Cheng Liang Zhang HaiChao Lv LuCheng Wang DaoRen USPTO INVENTOR DISAMBIGUATION Institute of Scientific and Technical Information of China SEP 20, 2015 Content 1. Data

More information

TEXT PREPROCESSING FOR TEXT MINING USING SIDE INFORMATION

TEXT PREPROCESSING FOR TEXT MINING USING SIDE INFORMATION TEXT PREPROCESSING FOR TEXT MINING USING SIDE INFORMATION Ms. Nikita P.Katariya 1, Prof. M. S. Chaudhari 2 1 Dept. of Computer Science & Engg, P.B.C.E., Nagpur, India, nikitakatariya@yahoo.com 2 Dept.

More information

An overview of Graph Categories and Graph Primitives

An overview of Graph Categories and Graph Primitives An overview of Graph Categories and Graph Primitives Dino Ienco (dino.ienco@irstea.fr) https://sites.google.com/site/dinoienco/ Topics I m interested in: Graph Database and Graph Data Mining Social Network

More information

Peer-to-Peer Systems. Chapter General Characteristics

Peer-to-Peer Systems. Chapter General Characteristics Chapter 2 Peer-to-Peer Systems Abstract In this chapter, a basic overview is given of P2P systems, architectures, and search strategies in P2P systems. More specific concepts that are outlined include

More information

Making research data repositories visible and discoverable. Robert Ulrich Karlsruhe Institute of Technology

Making research data repositories visible and discoverable. Robert Ulrich Karlsruhe Institute of Technology Making research data repositories visible and discoverable Robert Ulrich Karlsruhe Institute of Technology Outline Background Mission Schema, Icons, Quality and Workflow Interface Growth Cooperations Experiences

More information

SC32 WG2 Metadata Standards Tutorial

SC32 WG2 Metadata Standards Tutorial SC32 WG2 Metadata Standards Tutorial Metadata Registries and Big Data WG2 N1945 June 9, 2014 Beijing, China WG2 Viewpoint Big Data magnifies the existing challenges and issues of managing and interpreting

More information

2015 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media,

2015 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, 2015 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising

More information

SLIPO. Scalable Linking and Integration of Big POI data. Giorgos Giannopoulos IMIS/Athena RC

SLIPO. Scalable Linking and Integration of Big POI data. Giorgos Giannopoulos IMIS/Athena RC SLIPO Scalable Linking and Integration of Big POI data I n f o r m a ti o n a n d N e t w o r ki n g D a y s o n H o ri z o n 2 0 2 0 B i g Da ta Public-Priva te Partnership To p i c : I C T 14 B i g D

More information

Informatica Enterprise Information Catalog

Informatica Enterprise Information Catalog Data Sheet Informatica Enterprise Information Catalog Benefits Automatically catalog and classify all types of data across the enterprise using an AI-powered catalog Identify domains and entities with

More information

A Survey On Different Text Clustering Techniques For Patent Analysis

A Survey On Different Text Clustering Techniques For Patent Analysis A Survey On Different Text Clustering Techniques For Patent Analysis Abhilash Sharma Assistant Professor, CSE Department RIMT IET, Mandi Gobindgarh, Punjab, INDIA ABSTRACT Patent analysis is a management

More information

International Journal of Data Mining & Knowledge Management Process (IJDKP) Vol.7, No.3, May Dr.Zakea Il-Agure and Mr.Hicham Noureddine Itani

International Journal of Data Mining & Knowledge Management Process (IJDKP) Vol.7, No.3, May Dr.Zakea Il-Agure and Mr.Hicham Noureddine Itani LINK MINING PROCESS Dr.Zakea Il-Agure and Mr.Hicham Noureddine Itani Higher Colleges of Technology, United Arab Emirates ABSTRACT Many data mining and knowledge discovery methodologies and process models

More information

Empowering People with Knowledge the Next Frontier for Web Search. Wei-Ying Ma Assistant Managing Director Microsoft Research Asia

Empowering People with Knowledge the Next Frontier for Web Search. Wei-Ying Ma Assistant Managing Director Microsoft Research Asia Empowering People with Knowledge the Next Frontier for Web Search Wei-Ying Ma Assistant Managing Director Microsoft Research Asia Important Trends for Web Search Organizing all information Addressing user

More information

An Improved Apriori Algorithm for Association Rules

An Improved Apriori Algorithm for Association Rules Research article An Improved Apriori Algorithm for Association Rules Hassan M. Najadat 1, Mohammed Al-Maolegi 2, Bassam Arkok 3 Computer Science, Jordan University of Science and Technology, Irbid, Jordan

More information

Jaql. Kevin Beyer, Vuk Ercegovac, Eugene Shekita, Jun Rao, Ning Li, Sandeep Tata. IBM Almaden Research Center

Jaql. Kevin Beyer, Vuk Ercegovac, Eugene Shekita, Jun Rao, Ning Li, Sandeep Tata. IBM Almaden Research Center Jaql Running Pipes in the Clouds Kevin Beyer, Vuk Ercegovac, Eugene Shekita, Jun Rao, Ning Li, Sandeep Tata IBM Almaden Research Center http://code.google.com/p/jaql/ 2009 IBM Corporation Motivating Scenarios

More information

IBM Security Guardium Analyzer

IBM Security Guardium Analyzer IBM Guardium Analyzer Highlights Assess security & compliance risk associated with GDPR data Find GDPR data across onpremises and cloud databases Scan for database vulnerabilities Leverage next-generation

More information

Database and Knowledge-Base Systems: Data Mining. Martin Ester

Database and Knowledge-Base Systems: Data Mining. Martin Ester Database and Knowledge-Base Systems: Data Mining Martin Ester Simon Fraser University School of Computing Science Graduate Course Spring 2006 CMPT 843, SFU, Martin Ester, 1-06 1 Introduction [Fayyad, Piatetsky-Shapiro

More information

Text Mining. Representation of Text Documents

Text Mining. Representation of Text Documents Data Mining is typically concerned with the detection of patterns in numeric data, but very often important (e.g., critical to business) information is stored in the form of text. Unlike numeric data,

More information

RESEARCH ANALYTICS From Web of Science to InCites. September 20 th, 2010 Marta Plebani

RESEARCH ANALYTICS From Web of Science to InCites. September 20 th, 2010 Marta Plebani RESEARCH ANALYTICS From Web of Science to InCites September 20 th, 2010 Marta Plebani marta.plebani@thomsonreuters.com Web Of Science: main purposes Find high-impact articles and conference proceedings.

More information

Linked Open Data and Semantic Technologies for Research in Agriculture and Forestry

Linked Open Data and Semantic Technologies for Research in Agriculture and Forestry Linked Open and Semantic Technologies for Research in Agriculture and Forestry Platform Linked Nederland 2 April 2015 Rob Lokers, Alterra, Wageningen UR Contents related challenges in agricultural (and

More information

1 Dulcian, Inc., 2001 All rights reserved. Oracle9i Data Warehouse Review. Agenda

1 Dulcian, Inc., 2001 All rights reserved. Oracle9i Data Warehouse Review. Agenda Agenda Oracle9i Warehouse Review Dulcian, Inc. Oracle9i Server OLAP Server Analytical SQL Mining ETL Infrastructure 9i Warehouse Builder Oracle 9i Server Overview E-Business Intelligence Platform 9i Server:

More information

Exploring Automated Patent Search with KNIME Possibilities, Limits, Future

Exploring Automated Patent Search with KNIME Possibilities, Limits, Future Exploring Automated Patent Search with KNIME Possibilities, Limits, Future Alexander Klenner-Bajaja, PhD aklenner@epo.org European Patent Office Offices: Berlin, Vienna, Munich, The Hague (Rijswijk), Brussels

More information

Keywords Data alignment, Data annotation, Web database, Search Result Record

Keywords Data alignment, Data annotation, Web database, Search Result Record Volume 5, Issue 8, August 2015 ISSN: 2277 128X International Journal of Advanced Research in Computer Science and Software Engineering Research Paper Available online at: www.ijarcsse.com Annotating Web

More information

OKKAM-based instance level integration

OKKAM-based instance level integration OKKAM-based instance level integration Paolo Bouquet W3C RDF2RDB This work is co-funded by the European Commission in the context of the Large-scale Integrated project OKKAM (GA 215032) RoadMap Using the

More information

Text Analytics (Text Mining)

Text Analytics (Text Mining) CSE 6242 / CX 4242 Text Analytics (Text Mining) Concepts and Algorithms Duen Horng (Polo) Chau Georgia Tech Some lectures are partly based on materials by Professors Guy Lebanon, Jeffrey Heer, John Stasko,

More information

Semantic Web Company. PoolParty - Server. PoolParty - Technical White Paper.

Semantic Web Company. PoolParty - Server. PoolParty - Technical White Paper. Semantic Web Company PoolParty - Server PoolParty - Technical White Paper http://www.poolparty.biz Table of Contents Introduction... 3 PoolParty Technical Overview... 3 PoolParty Components Overview...

More information

Semantic Web. Tahani Aljehani

Semantic Web. Tahani Aljehani Semantic Web Tahani Aljehani Motivation: Example 1 You are interested in SOAP Web architecture Use your favorite search engine to find the articles about SOAP Keywords-based search You'll get lots of information,

More information

CS473: Course Review CS-473. Luo Si Department of Computer Science Purdue University

CS473: Course Review CS-473. Luo Si Department of Computer Science Purdue University CS473: CS-473 Course Review Luo Si Department of Computer Science Purdue University Basic Concepts of IR: Outline Basic Concepts of Information Retrieval: Task definition of Ad-hoc IR Terminologies and

More information

Fishing Activity Visualization with Free Software Bigdata Analytics Institute

Fishing Activity Visualization with Free Software Bigdata Analytics Institute Fishing Activity Visualization with Free Software Bigdata Analytics Institute Erico N de Souza, PhD erico.souza@dal.ca Souza, Latouf (Bigdata Inst.) Bigdata Institute 1 / 22 Introduction What would you

More information

Mining Web Data. Lijun Zhang

Mining Web Data. Lijun Zhang Mining Web Data Lijun Zhang zlj@nju.edu.cn http://cs.nju.edu.cn/zlj Outline Introduction Web Crawling and Resource Discovery Search Engine Indexing and Query Processing Ranking Algorithms Recommender Systems

More information

Discovery of Agricultural Patterns Using Parallel Hybrid Clustering Paradigm

Discovery of Agricultural Patterns Using Parallel Hybrid Clustering Paradigm IOSR Journal of Engineering (IOSRJEN) ISSN (e): 2250-3021, ISSN (p): 2278-8719 PP 10-15 www.iosrjen.org Discovery of Agricultural Patterns Using Parallel Hybrid Clustering Paradigm P.Arun, M.Phil, Dr.A.Senthilkumar

More information

XETA: extensible metadata System

XETA: extensible metadata System XETA: extensible metadata System Abstract: This paper presents an extensible metadata system (XETA System) which makes it possible for the user to organize and extend the structure of metadata. We discuss

More information