Introduction to Graph Data Management

Size: px
Start display at page:

Download "Introduction to Graph Data Management"

Transcription

1 Introduction to Graph Data Management Claudio Gutierrez Center for Semantic Web Research (CIWS) Department of Computer Science Universidad de Chile EDBT Summer School Palamos 2015

2 Joint Work With Renzo Angles Universidad de Talca, Chile

3 Agenda for today: querying 1. Reminder / comment on first lecture 2. Graph query language concepts 3. Querying graphs 4. Graph database and systems

4 Golden Age of Graph Databases Alexandra Poulovassilis Jan Hidders

5 Reminder I: Property Graph data model

6 Reminder II: TOC of Graph-Theory/Networks books Graph Theory (R. Diestel) 1. Introduction 2. Matching 3. Connectivity 4. Planar Graphs 5. Colouring 6. Flows 7. Substructures in Dense Graph 8. Ramsey Theory for Graphs 9. Hamilton Cycles 10. Random Graphs 11. Minor, Trees, Well Quasi Orders Networks: An Introduction (M. Newman) 1. Introduction 2. Technological Netowrks 3. Social Networks 4. Networks of information 5. Biological Networks 6. Mathematics of Networks 7. Measures and Methods 8. The large-scale structure of networks 9. Basic concepts of algorithms 10. Fundamental network algorithms 11. Matrix algorithms and graph partitioning 12. Random Graphs 13. Random Graphs with general degree distribution 14. Models of network formation 15. Other network models 16. Percolation and network resilience 17. Epidemics on networks 18. Dynamical system on networks 19. Network search

7 Quiz / Inquiry Q1 (Property Graph data model) Name one positive feature and one negative feature of the Property Graph data model Q2 (Graph theory Data management) Name one result (theorem, area, topic, algorithm, technique, etc.) from Graph Theory that you consider could be useful for improving Graph Data management.

8 Agenda Graph Query Language Notions

9 Database Models: Codd s definition Data structures Integrity constraints Query Language

10 Database Models: Codd s definition Query Language Data manipulation is expressed by graph transformations, or by operations whose main primitives are on graph features like paths, neighborhoods, subgraphs, graph patterns, connectivity, and graph statistics.

11 A supermarket list of types of queries A. Basic Graph Queries 1. Pattern matching 2. Adjacency / neighborhood 3. Reachability / connectivity 1. Regular (and regular++) 2. CRPQ 3. etc. 4. Summarization 5.

12 A supermarket list of types queries (cont.) B. Analytical Queries 1. Centrality measures 2. Diameter and other global properties 3. Various statistics 4. Graph properties and parameters 5.

13 Something is getting wrong Seems like we are in Linnean times: lots of arbitrary animals collected and discovered, but no way of making sense of this diversity Either: we are not understanding graphs or graphs are not understandable by XXI s century humans or we do not know what we are looking for but one thing is clear: a scientific description cannot be an arbitrary list of properties

14 Some desirable features of a query language 1. Genericity (independence of coding of data) 2. Good expressive power 3. Low complexity of evaluation 4. Simple syntax and semantics 5. Compositionality 6. Few and simple constructors 7. Hopefully not operational semantics 8. User friendly / low barrier of entrance 9. Standard

15 Graph Query Language: I/O types Graphs Relations

16 Graph Query Language: basic modules transform define data sources

17 Graph query languages: their basic modules Language Define Source Extract Transform Construct SQL FROM WHERE SELECT SPARQL FROM, Service pattern matching operators Select, ASK, Contruct, Datalog match facts rules head XQuery XSLT Exercise: Fill in the blanks; add your favorite language

18 SPARQL Query X Y TRUE - FALSE Query Form CONSTRUCT DESCRIBE SELECT ASK Dataset FROM Dataset Clause FROM NAMED X Y Z Where Clause (Graph Pattern) Triple pattern FILTER OPTIONAL AND UNION

19 Cypher Query Language: structure MATCH (p:person)-[:knows]->(friend) WHERE p.age = 20 WITH p, count(friend) as friends WHERE friends > 0 Basic syntax (p:person) indicates the nodes having label Person [:Knows] indicates a relation of type Knows p.age indicates an attribute RETURN p.name, friends

20 Cypher Query Language: outputs A node A value A list of values An array get nodes of a given type MATCH (p:person {name:"tom"}) RETURN p MATCH (p:person {name:"tom"}) RETURN p.age MATCH (p:person) RETURN p.name LIMIT 5 MATCH p=shortestpath((a)-[*]->(b)) WHERE a.name="axel" AND b.name="tom" RETURN p A list of arrays MATCH p=((a)-[*]->(b)) WHERE a.name="axel" AND b.name="frank" RETURN p

21 The flow of data in SNA: a notion of data management a Data Collection Application Logic Local Consumer/Producer Incremental Data Feed Query & Transformation Network Manipulation and Storage Social Networks Data Management (Data Model/DBMS) Sharing and Porting Integration of Structural Measures Interactive Data Set Production Other Consumers/ Producers Social Network Analysis Tools External Consumers/ Producers Fig. 1. Data Management Needs for Social Networks. Each social application is a con Each social application is a consumer/producer of social networks, producing and/or collecting network data, and consuming data produced by other applications. [SNQL, SanMartin,_,Wood]

22 An aside: a different problem or the problem? Search/Query 1 <2> <3> 2 <4> 3 <5> 4 <3> <5> 5 href 1 <2> <3> 2 <4> 3 <5> 4 <3> <5> 5 The Web <uri1,r,uri4> <uri2,p,uri1>... uri1 Description of urij The Web of Data <uri2,q,uri3> <uri1,p,uri2>... uri2 p r n t uri4 q m <uri4,t,uri2>... <uri3,m, uri4> <uri1,n, uri3>... uri3 The web is one more artifact or is the answer to scalability?

23 The use case that triggered the Web design

24 Eight fallacies when querying [Umbrich,_,Hogan,Karnstedt, Parreira] 1. Data sources/services are reliable 2. Consumer behaviour can be anticipated 3. Publishers are infallible and play no role 4. You can know what s out there 5. Universal cost models can be mantained 6. Query execution is always deterministic 7. Standards = interoperability 8. One system can ACE them all (ACE: alignment, coverage, efficiency)

25 Agenda Graph Databases and Systems

26 Reminder: Database Technology APIs Applications Services Data Structure: Graphs Query languages X1 X2 Xn.. Oracle DB2 MySQL MSQL Postgres Native Data Store Files RDBMS

27 Classification (most influential models) Database model Abstraction level Data structure Information focus Network Physical Pointers,records Records Relational Logical Relations Data, attributes Semantic User Graph Schema, relations OO Physical/logical Objects Objects, methods Semi-structured Logical Tree Data,components Graph Logical/user Graph Data, relations

28 Classification issues (taken from P. Boncz s lecture) (Interactive, BI, Graph analytics) Graph Databases Graph programming frameworks RDF databases Relational databases NoSQL Key-value NoSQL MapReduce Batch processing

29 Classification issues (taken from B. Shao s lecture) Offline processing (offline analytics) Online processing (online querying) Optimized for response time or throughtput Transactional

30 Graph Databases 1. Address need of managing graph data 2. Architecture/goals inspired by classical DBMS 3. Persistent storage of graph data 4. Transactionality 5. Closed world 6. Efficiency (over scalability) 7. (Near future:) Portability (of data) 8. (Near future:) Declarative query languages

31 Graph Databases Data Storage Query Computing model method facilities model Simple graph Property graph Hypergraph Nested graph Native Non-native Query language API Graph algorithms Single-node Distributed Graph database AllegroGraph ArangoDB Bitsy Cayley FlockDB GraphBase Graphd Horton HyperGraphDB IBM System G imgraph InfiniteGraph InfoGrid Neo4j OrientDB Sparksee/DEX Titan Trinity TurboGraph

32 Graph Processing Frameworks (Offline Graph Analytical Systems) 1. Batch processing 2. Analysis of large graphs 3. Facilities for graph analytical algorithms 4. Distributed environment 5. Multiple machines 6. API or programming as user access

33 Graph Processing Frameworks / Offline graph analytical syst. Pregel Apache Giraph GraphLab Catch the Wind GPS Mizan Power Graph GraphX TurboGraph GraphChi

34 Some conclusions / opinions Graph data management has a bright future: we are living very interesting times One size does not fit all: Need different GDB for small, medium and web scale: marry one, get aware of your choice, and learn to love it try not to flirt with others. Not evident that there will be one standard graph query language: too diverse use cases. Need to better understand graphs What matters in a graph is its topology [if you do not need it, stay in the relational world] Need better interoperation between relational (tables) and graph data.

PROJECT PROPOSALS: COMMUNITY DETECTION AND ENTITY RESOLUTION. Donatella Firmani

PROJECT PROPOSALS: COMMUNITY DETECTION AND ENTITY RESOLUTION. Donatella Firmani PROJECT PROPOSALS: COMMUNITY DETECTION AND ENTITY RESOLUTION Donatella Firmani donatella.firmani@uniroma3.it PROJECT 1: COMMUNITY DETECTION What is Community Detection? What Social Network Analysis is?

More information

Graph Databases. Graph Databases. May 2015 Alberto Abelló & Oscar Romero

Graph Databases. Graph Databases. May 2015 Alberto Abelló & Oscar Romero Graph Databases 1 Knowledge Objectives 1. Describe what a graph database is 2. Explain the basics of the graph data model 3. Enumerate the best use cases for graph databases 4. Name two pros and cons of

More information

Querying from a Graph Database Perspective: the case of RDF

Querying from a Graph Database Perspective: the case of RDF Querying from a Database Perspective: the case of RDF Renzo Angles and Claudio Gutierrez Department of Computer Science Universidad de Chile {rangles, cgutierr}@dcc.uchile.cl Agenda Motivations, Problem

More information

E6885 Network Science Lecture 10: Graph Database (II)

E6885 Network Science Lecture 10: Graph Database (II) E 6885 Topics in Signal Processing -- Network Science E6885 Network Science Lecture 10: Graph Database (II) Ching-Yung Lin, Dept. of Electrical Engineering, Columbia University November 18th, 2013 Course

More information

FOUNDATIONS OF DATABASES AND QUERY LANGUAGES

FOUNDATIONS OF DATABASES AND QUERY LANGUAGES FOUNDATIONS OF DATABASES AND QUERY LANGUAGES Lecture 14: Database Theory in Practice Markus Krötzsch TU Dresden, 20 July 2015 Overview 1. Introduction Relational data model 2. First-order queries 3. Complexity

More information

Management and Analysis of Big Graph Data: Current Systems and Open Challenges

Management and Analysis of Big Graph Data: Current Systems and Open Challenges Management and Analysis of Big Graph Data: Current Systems and Open Challenges Martin Junghanns 1, André Petermann 1, Martin Neumann 2 and Erhard Rahm 1 1 Leipzig University, Database Research Group 2

More information

Graph Analytics in the Big Data Era

Graph Analytics in the Big Data Era Graph Analytics in the Big Data Era Yongming Luo, dr. George H.L. Fletcher Web Engineering Group What is really hot? 19-11-2013 PAGE 1 An old/new data model graph data Model entities and relations between

More information

Introduction to Graph Databases

Introduction to Graph Databases Introduction to Graph Databases David Montag @dmontag #neo4j 1 Agenda NOSQL overview Graph Database 101 A look at Neo4j The red pill 2 Why you should listen Forrester says: The market for graph databases

More information

Introduction to NoSQL Databases

Introduction to NoSQL Databases Introduction to NoSQL Databases Roman Kern KTI, TU Graz 2017-10-16 Roman Kern (KTI, TU Graz) Dbase2 2017-10-16 1 / 31 Introduction Intro Why NoSQL? Roman Kern (KTI, TU Graz) Dbase2 2017-10-16 2 / 31 Introduction

More information

Distributed Non-Relational Databases. Pelle Jakovits

Distributed Non-Relational Databases. Pelle Jakovits Distributed Non-Relational Databases Pelle Jakovits Tartu, 7 December 2018 Outline Relational model NoSQL Movement Non-relational data models Key-value Document-oriented Column family Graph Non-relational

More information

Distributed Graph Storage. Veronika Molnár, UZH

Distributed Graph Storage. Veronika Molnár, UZH Distributed Graph Storage Veronika Molnár, UZH Overview Graphs and Social Networks Criteria for Graph Processing Systems Current Systems Storage Computation Large scale systems Comparison / Best systems

More information

Big Data Management and NoSQL Databases

Big Data Management and NoSQL Databases NDBI040 Big Data Management and NoSQL Databases Lecture 10. Graph databases Doc. RNDr. Irena Holubova, Ph.D. holubova@ksi.mff.cuni.cz http://www.ksi.mff.cuni.cz/~holubova/ndbi040/ Graph Databases Basic

More information

Lecture 0: Course Intro

Lecture 0: Course Intro Databases (3): NoSQL & Deductive Databases Department of Applied Informatics Faculty of Mathematics, Physics and Informatics Comenius University in Bratislava 25 Sep 2018 Part I: NoSQL Databases NoSQL

More information

Event Stores (I) [Source: DB-Engines.com, accessed on August 28, 2016]

Event Stores (I) [Source: DB-Engines.com, accessed on August 28, 2016] Event Stores (I) Event stores are database management systems implementing the concept of event sourcing. They keep all state changing events for an object together with a timestamp, thereby creating a

More information

OPEN SOURCE DB SYSTEMS TYPES OF DBMS

OPEN SOURCE DB SYSTEMS TYPES OF DBMS OPEN SOURCE DB SYSTEMS Anna Topol 1 TYPES OF DBMS Relational Key-Value Document-oriented Graph 2 DBMS SELECTION Multi-platform or platform-agnostic Offers persistent storage Fairly well known Actively

More information

CISC 7610 Lecture 4 Approaches to multimedia databases. Topics: Document databases Graph databases Metadata Column databases

CISC 7610 Lecture 4 Approaches to multimedia databases. Topics: Document databases Graph databases Metadata Column databases CISC 7610 Lecture 4 Approaches to multimedia databases Topics: Document databases Graph databases Metadata Column databases NoSQL architectures: different tradeoffs for different workloads Already seen:

More information

NOSQL Databases and Neo4j

NOSQL Databases and Neo4j NOSQL Databases and Neo4j Database and DBMS Database - Organized collection of data The term database is correctly applied to the data and their supporting data structures. DBMS - Database Management System:

More information

Cray's YarcData claims early success for graph database appliance

Cray's YarcData claims early success for graph database appliance Cray's YarcData claims early success for graph database appliance Analyst: Matt Aslett 10 Aug, 2012 The launch of YarcData earlier this year gave supercomputing specialist Cray a graph database appliance

More information

Big Data Analytics using Apache Hadoop and Spark with Scala

Big Data Analytics using Apache Hadoop and Spark with Scala Big Data Analytics using Apache Hadoop and Spark with Scala Training Highlights : 80% of the training is with Practical Demo (On Custom Cloudera and Ubuntu Machines) 20% Theory Portion will be important

More information

Graph Databases: Their Power and Limitations

Graph Databases: Their Power and Limitations Graph Databases: Their Power and Limitations Jaroslav Pokorný To cite this version: Jaroslav Pokorný. Graph Databases: Their Power and Limitations. Khalid Saeed; Wladyslaw Homenda. 14th Computer Information

More information

Managing and Mining Billion Node Graphs. Haixun Wang Microsoft Research Asia

Managing and Mining Billion Node Graphs. Haixun Wang Microsoft Research Asia Managing and Mining Billion Node Graphs Haixun Wang Microsoft Research Asia Outline Overview Storage Online query processing Offline graph analytics Advanced applications Is it hard to manage graphs? Good

More information

Introduction to Databases CSE 414. Lecture 2: Data Models

Introduction to Databases CSE 414. Lecture 2: Data Models Introduction to Databases CSE 414 Lecture 2: Data Models CSE 414 - Autumn 2018 1 Class Overview Unit 1: Intro Unit 2: Relational Data Models and Query Languages Data models, SQL, Relational Algebra, Datalog

More information

Link Analysis in the Cloud

Link Analysis in the Cloud Cloud Computing Link Analysis in the Cloud Dell Zhang Birkbeck, University of London 2017/18 Graph Problems & Representations What is a Graph? G = (V,E), where V represents the set of vertices (nodes)

More information

CISC 7610 Lecture 4 Approaches to multimedia databases

CISC 7610 Lecture 4 Approaches to multimedia databases CISC 7610 Lecture 4 Approaches to multimedia databases Topics: Metadata Loose vs tight coupling of data and metadata Object (oriented) databases Graph databases Object-relational mapping Homework 1 Entity-relationship

More information

COMPUTER AND INFORMATION SCIENCE JENA DB. Group Abhishek Kumar Harshvardhan Singh Abhisek Mohanty Suhas Tumkur Chandrashekhara

COMPUTER AND INFORMATION SCIENCE JENA DB. Group Abhishek Kumar Harshvardhan Singh Abhisek Mohanty Suhas Tumkur Chandrashekhara JENA DB Group - 10 Abhishek Kumar Harshvardhan Singh Abhisek Mohanty Suhas Tumkur Chandrashekhara OUTLINE Introduction Data Model Query Language Implementation Features Applications Introduction Open Source

More information

An overview of Graph Categories and Graph Primitives

An overview of Graph Categories and Graph Primitives An overview of Graph Categories and Graph Primitives Dino Ienco (dino.ienco@irstea.fr) https://sites.google.com/site/dinoienco/ Topics I m interested in: Graph Database and Graph Data Mining Social Network

More information

RELATIONAL DATABASE AND GRAPH DATABASE: A COMPARATIVE ANALYSIS

RELATIONAL DATABASE AND GRAPH DATABASE: A COMPARATIVE ANALYSIS RELATIONAL DATABASE AND GRAPH DATABASE: A COMPARATIVE ANALYSIS Surajit Medhi 1, Hemanta K. Baruah 2 1 Department of Computer Science, Gauhati University, Assam, India 2 Bodoland University, Assam, India

More information

Big Data Technology Ecosystem. Mark Burnette Pentaho Director Sales Engineering, Hitachi Vantara

Big Data Technology Ecosystem. Mark Burnette Pentaho Director Sales Engineering, Hitachi Vantara Big Data Technology Ecosystem Mark Burnette Pentaho Director Sales Engineering, Hitachi Vantara Agenda End-to-End Data Delivery Platform Ecosystem of Data Technologies Mapping an End-to-End Solution Case

More information

CS143: Relational Model

CS143: Relational Model CS143: Relational Model Book Chapters (4th) Chapters 1.3-5, 3.1, 4.11 (5th) Chapters 1.3-7, 2.1, 3.1-2, 4.1 (6th) Chapters 1.3-6, 2.105, 3.1-2, 4.5 Things to Learn Data model Relational model Database

More information

Hands-on immersion on Big Data tools

Hands-on immersion on Big Data tools Hands-on immersion on Big Data tools NoSQL Databases Donato Summa THE CONTRACTOR IS ACTING UNDER A FRAMEWORK CONTRACT CONCLUDED WITH THE COMMISSION Summary : Definition Main features NoSQL DBs classification

More information

CS317 File and Database Systems

CS317 File and Database Systems CS317 File and Database Systems http://dilbert.com/strips/comic/1995-10-11/ Lecture 5 More SQL and Intro to Stored Procedures September 24, 2017 Sam Siewert SQL Theory and Standards Completion of SQL in

More information

An Brief Introduction to Data Storage

An Brief Introduction to Data Storage An Brief Introduction to Data Storage Jascha Schewtschenko Institute of Cosmology and Gravitation, University of Portsmouth May 10, 2018 JAS (ICG, Portsmouth) An Brief Introduction to Data Storage May

More information

Semantic Web Technologies. Topic: RDF Triple Stores

Semantic Web Technologies. Topic: RDF Triple Stores Semantic Web Technologies Topic: RDF Triple Stores olaf.hartig@liu.se Acknowledgement: Some slides in this slide set are adaptations of slides of Olivier Curé (University of Paris-Est Marne la Vallée,

More information

CISC 7610 Lecture 4 Approaches to multimedia databases. Topics: Graph databases Neo4j syntax and examples Document databases

CISC 7610 Lecture 4 Approaches to multimedia databases. Topics: Graph databases Neo4j syntax and examples Document databases CISC 7610 Lecture 4 Approaches to multimedia databases Topics: Graph databases Neo4j syntax and examples Document databases NoSQL architectures: different tradeoffs for different workloads Already seen:

More information

Analyzing Flight Data

Analyzing Flight Data IBM Analytics Analyzing Flight Data Jeff Carlson Rich Tarro July 21, 2016 2016 IBM Corporation Agenda Spark Overview a quick review Introduction to Graph Processing and Spark GraphX GraphX Overview Demo

More information

Databases 2 (VU) ( / )

Databases 2 (VU) ( / ) Databases 2 (VU) (706.711 / 707.030) MapReduce (Part 3) Mark Kröll ISDS, TU Graz Nov. 27, 2017 Mark Kröll (ISDS, TU Graz) MapReduce Nov. 27, 2017 1 / 42 Outline 1 Problems Suited for Map-Reduce 2 MapReduce:

More information

L24: NoSQL (continued) CS3200 Database design (sp18 s2) 4/12/2018

L24: NoSQL (continued) CS3200 Database design (sp18 s2)   4/12/2018 L24: NoSQL (continued) CS3200 Database design (sp18 s2) https://course.ccs.neu.edu/cs3200sp18s2/ 4/12/2018 71 Last Class today NoSQL (15min): Graph DBs Course Evaluation (15min) Course review 72 Outline

More information

CIB Session 12th NoSQL Databases Structures

CIB Session 12th NoSQL Databases Structures CIB Session 12th NoSQL Databases Structures By: Shahab Safaee & Morteza Zahedi Software Engineering PhD Email: safaee.shx@gmail.com, morteza.zahedi.a@gmail.com cibtrc.ir cibtrc cibtrc 2 Agenda What is

More information

Topics. History. Architecture. MongoDB, Mongoose - RDBMS - SQL. - NoSQL

Topics. History. Architecture. MongoDB, Mongoose - RDBMS - SQL. - NoSQL Databases Topics History - RDBMS - SQL Architecture - SQL - NoSQL MongoDB, Mongoose Persistent Data Storage What features do we want in a persistent data storage system? We have been using text files to

More information

Semantics in RDF and SPARQL Some Considerations

Semantics in RDF and SPARQL Some Considerations Semantics in RDF and SPARQL Some Considerations Dept. Computer Science, Universidad de Chile Center for Semantic Web Research http://ciws.cl Dagstuhl, June 2017 Semantics RDF and SPARQL 1 / 7 Semantics

More information

Real-time Fraud Detection with Innovative Big Graph Feature. Gaurav Deshpande, VP Marketing, TigerGraph; Mingxi Wu, VP Engineering, TigerGraph

Real-time Fraud Detection with Innovative Big Graph Feature. Gaurav Deshpande, VP Marketing, TigerGraph; Mingxi Wu, VP Engineering, TigerGraph Real-time Fraud Detection with Innovative Big Graph Feature Gaurav Deshpande, VP Marketing, TigerGraph; Mingxi Wu, VP Engineering, TigerGraph Speaking Today Gaurav Deshpande VP Marketing, TigerGraph gaurav@tigergraph.com

More information

G-CORE: A Core for Future Graph Query Languages

G-CORE: A Core for Future Graph Query Languages G-CORE: A Core for Future Graph Query Languages Designed by the LDBC Graph Query Language Task Force Hannes Voigt hannes.voigt@tu-dresden.de http://bit.ly/gcorelanguage @LDBCouncil FOSDEM Graph Feb 3rd,

More information

Unifying Big Data Workloads in Apache Spark

Unifying Big Data Workloads in Apache Spark Unifying Big Data Workloads in Apache Spark Hossein Falaki @mhfalaki Outline What s Apache Spark Why Unification Evolution of Unification Apache Spark + Databricks Q & A What s Apache Spark What is Apache

More information

CSE 258 Lecture 6. Web Mining and Recommender Systems. Community Detection

CSE 258 Lecture 6. Web Mining and Recommender Systems. Community Detection CSE 258 Lecture 6 Web Mining and Recommender Systems Community Detection Dimensionality reduction Goal: take high-dimensional data, and describe it compactly using a small number of dimensions Assumption:

More information

Querying Geo-social Data by Bridging Spatial Networks and Social Networks

Querying Geo-social Data by Bridging Spatial Networks and Social Networks Querying Geo-social Data by Bridging Spatial Networks and Social Networks Yerach Doytsher Ben Galon Yaron Kanza 1 Motivation Social networks provide valuable information on social relationships among people

More information

Ryan Stephens. Ron Plew Arie D. Jones. Sams Teach Yourself FIFTH EDITION. 800 East 96th Street, Indianapolis, Indiana, 46240

Ryan Stephens. Ron Plew Arie D. Jones. Sams Teach Yourself FIFTH EDITION. 800 East 96th Street, Indianapolis, Indiana, 46240 Ryan Stephens Ron Plew Arie D. Jones Sams Teach Yourself FIFTH EDITION 800 East 96th Street, Indianapolis, Indiana, 46240 Table of Contents Part I: An SQL Concepts Overview HOUR 1: Welcome to the World

More information

CSE 158 Lecture 6. Web Mining and Recommender Systems. Community Detection

CSE 158 Lecture 6. Web Mining and Recommender Systems. Community Detection CSE 158 Lecture 6 Web Mining and Recommender Systems Community Detection Dimensionality reduction Goal: take high-dimensional data, and describe it compactly using a small number of dimensions Assumption:

More information

Introduction to Data Management CSE 344. Lecture 2: Data Models

Introduction to Data Management CSE 344. Lecture 2: Data Models Introduction to Data Management CSE 344 Lecture 2: Data Models CSE 344 - Winter 2017 1 Announcements WQ1 and HW1 are out Use your CSE ids to access the HW docs Use Piazza to post questions OHs are up on

More information

Oracle Database 12c: Use XML DB

Oracle Database 12c: Use XML DB Oracle University Contact Us: 55-800-891-6502 Oracle Database 12c: Use XML DB Duration: 5 Days What you will learn This Oracle Database 12c: Use XML DB training allows you to deep dive into the key features

More information

CSE 544 Principles of Database Management Systems

CSE 544 Principles of Database Management Systems CSE 544 Principles of Database Management Systems Lecture 1 - Introduction and the Relational Model 1 Outline Introduction Class overview Why database management systems (DBMS)? The relational model 2

More information

Databases : Lecture 1 2: Beyond ACID/Relational databases Timothy G. Griffin Lent Term Apologies to Martin Fowler ( NoSQL Distilled )

Databases : Lecture 1 2: Beyond ACID/Relational databases Timothy G. Griffin Lent Term Apologies to Martin Fowler ( NoSQL Distilled ) Databases : Lecture 1 2: Beyond ACID/Relational databases Timothy G. Griffin Lent Term 2016 Rise of Web and cluster-based computing NoSQL Movement Relationships vs. Aggregates Key-value store XML or JSON

More information

CSE 255 Lecture 6. Data Mining and Predictive Analytics. Community Detection

CSE 255 Lecture 6. Data Mining and Predictive Analytics. Community Detection CSE 255 Lecture 6 Data Mining and Predictive Analytics Community Detection Dimensionality reduction Goal: take high-dimensional data, and describe it compactly using a small number of dimensions Assumption:

More information

Semantic Web Fundamentals

Semantic Web Fundamentals Semantic Web Fundamentals Web Technologies (706.704) 3SSt VU WS 2017/18 Vedran Sabol with acknowledgements to P. Höfler, V. Pammer, W. Kienreich ISDS, TU Graz December 11 th 2017 Overview What is Semantic

More information

The NoSQL Ecosystem. Adam Marcus MIT CSAIL

The NoSQL Ecosystem. Adam Marcus MIT CSAIL The NoSQL Ecosystem Adam Marcus MIT CSAIL marcua@csail.mit.edu / @marcua About Me Social Computing + Database Systems Easily Distracted: Wrote The NoSQL Ecosystem in The Architecture of Open Source Applications

More information

Semantic Web Fundamentals

Semantic Web Fundamentals Semantic Web Fundamentals Web Technologies (706.704) 3SSt VU WS 2018/19 with acknowledgements to P. Höfler, V. Pammer, W. Kienreich ISDS, TU Graz January 7 th 2019 Overview What is Semantic Web? Technology

More information

Part I What are Databases?

Part I What are Databases? Part I 1 Overview & Motivation 2 Architectures 3 Areas of Application 4 History Saake Database Concepts Last Edited: April 2019 1 1 Educational Objective for Today... Motivation for using database systems

More information

DataSToRM: Data Science and Technology Research Environment

DataSToRM: Data Science and Technology Research Environment The Future of Advanced (Secure) Computing DataSToRM: Data Science and Technology Research Environment This material is based upon work supported by the Assistant Secretary of Defense for Research and Engineering

More information

Lecture 25 Overview. Last Lecture Query optimisation/query execution strategies

Lecture 25 Overview. Last Lecture Query optimisation/query execution strategies Lecture 25 Overview Last Lecture Query optimisation/query execution strategies This Lecture Non-relational data models Source: web pages, textbook chapters 20-22 Next Lecture Revision COSC344 Lecture 25

More information

Overview. * Some History. * What is NoSQL? * Why NoSQL? * RDBMS vs NoSQL. * NoSQL Taxonomy. *TowardsNewSQL

Overview. * Some History. * What is NoSQL? * Why NoSQL? * RDBMS vs NoSQL. * NoSQL Taxonomy. *TowardsNewSQL * Some History * What is NoSQL? * Why NoSQL? * RDBMS vs NoSQL * NoSQL Taxonomy * Towards NewSQL Overview * Some History * What is NoSQL? * Why NoSQL? * RDBMS vs NoSQL * NoSQL Taxonomy *TowardsNewSQL NoSQL

More information

CS317 File and Database Systems

CS317 File and Database Systems CS317 File and Database Systems Lecture 3 Relational Model & Languages Part-1 September 7, 2018 Sam Siewert More Embedded Systems Summer - Analog, Digital, Firmware, Software Reasons to Consider Catch

More information

A NoSQL Introduction for Relational Database Developers. Andrew Karcher Las Vegas SQL Saturday September 12th, 2015

A NoSQL Introduction for Relational Database Developers. Andrew Karcher Las Vegas SQL Saturday September 12th, 2015 A NoSQL Introduction for Relational Database Developers Andrew Karcher Las Vegas SQL Saturday September 12th, 2015 About Me http://www.andrewkarcher.com Twitter: @akarcher LinkedIn, Twitter Email: akarcher@gmail.com

More information

Graph Databases. Guilherme Fetter Damasio. University of Ontario Institute of Technology and IBM Centre for Advanced Studies IBM Corporation

Graph Databases. Guilherme Fetter Damasio. University of Ontario Institute of Technology and IBM Centre for Advanced Studies IBM Corporation Graph Databases Guilherme Fetter Damasio University of Ontario Institute of Technology and IBM Centre for Advanced Studies Outline Introduction Relational Database Graph Database Our Research 2 Introduction

More information

COMP9321 Web Application Engineering

COMP9321 Web Application Engineering COMP9321 Web Application Engineering Semester 2, 2015 Dr. Amin Beheshti Service Oriented Computing Group, CSE, UNSW Australia Week 12 (Wrap-up) http://webapps.cse.unsw.edu.au/webcms2/course/index.php?cid=2411

More information

This presentation is for informational purposes only and may not be incorporated into a contract or agreement.

This presentation is for informational purposes only and may not be incorporated into a contract or agreement. This presentation is for informational purposes only and may not be incorporated into a contract or agreement. Oracle10g RDF Data Mgmt: In Life Sciences Xavier Lopez Director, Server Technologies Oracle

More information

B.H.GARDI COLLEGE OF MASTER OF COMPUTER APPLICATION. Ch. 1 :- Introduction Database Management System - 1

B.H.GARDI COLLEGE OF MASTER OF COMPUTER APPLICATION. Ch. 1 :- Introduction Database Management System - 1 Basic Concepts :- 1. What is Data? Data is a collection of facts from which conclusion may be drawn. In computer science, data is anything in a form suitable for use with a computer. Data is often distinguished

More information

COMP9321 Web Application Engineering

COMP9321 Web Application Engineering COMP9321 Web Application Engineering Semester 1, 2017 Dr. Amin Beheshti Service Oriented Computing Group, CSE, UNSW Australia Week 12 (Wrap-up) http://webapps.cse.unsw.edu.au/webcms2/course/index.php?cid=2457

More information

Review - Relational Model Concepts

Review - Relational Model Concepts Lecture 25 Overview Last Lecture Query optimisation/query execution strategies This Lecture Non-relational data models Source: web pages, textbook chapters 20-22 Next Lecture Revision Review - Relational

More information

RDF* and SPARQL* An Alternative Approach to Statement-Level Metadata in RDF

RDF* and SPARQL* An Alternative Approach to Statement-Level Metadata in RDF RDF* and SPARQL* An Alternative Approach to Statement-Level Metadata in RDF Olaf Hartig @olafhartig Picture source:htp://akae.blogspot.se/2008/08/dios-mo-doc-has-construido-una-mquina.html 2 4 htp://tinkerpop.apache.org/docs/current/reference/#intro

More information

Road to a Multi-model Database -- making PostgreSQL the most popular and versatile database

Road to a Multi-model Database -- making PostgreSQL the most popular and versatile database PGConf.ASIA 2017 Road to a Multi-model Database -- making PostgreSQL the most popular and versatile database December 5, 2017 Takayuki Tsunakawa Fujitsu Limited 0 Who am I? Takayuki Tsunakawa PostgreSQL

More information

Large Scale Graph Solutions: Use-cases And Lessons Learnt

Large Scale Graph Solutions: Use-cases And Lessons Learnt Large Scale Graph Solutions: Use-cases And Lessons Learnt Principal Engineer, AI/Cloud Platforms Abstraction Is The Art Euler s Bridges - Seven Bridges of Königsberg G = (V, E); V(id, attr1, attr2,..);

More information

Oracle Database 11g: Program with PL/SQL Release 2

Oracle Database 11g: Program with PL/SQL Release 2 Oracle University Contact Us: +41- (0) 56 483 31 31 Oracle Database 11g: Program with PL/SQL Release 2 Duration: 5 Days What you will learn This course introduces students to PL/SQL and helps them understand

More information

Query Languages for Document Stores

Query Languages for Document Stores Query Languages for Document Stores NoSQL matters conference 2013-04-26 Jan Steemann me I'm a software developer working at triagens GmbH on and with Documents Documents documents are self-contained, aggregate

More information

Oral Questions and Answers (DBMS LAB) Questions & Answers- DBMS

Oral Questions and Answers (DBMS LAB) Questions & Answers- DBMS Questions & Answers- DBMS https://career.guru99.com/top-50-database-interview-questions/ 1) Define Database. A prearranged collection of figures known as data is called database. 2) What is DBMS? Database

More information

Outline. Database Management Systems (DBMS) Database Management and Organization. IT420: Database Management and Organization

Outline. Database Management Systems (DBMS) Database Management and Organization. IT420: Database Management and Organization Outline IT420: Database Management and Organization Dr. Crăiniceanu Capt. Balazs www.cs.usna.edu/~adina/teaching/it420/spring2007 Class Survey Why Databases (DB)? A Problem DB Benefits In This Class? Admin

More information

Analyzing a social network using Big Data Spatial and Graph Property Graph

Analyzing a social network using Big Data Spatial and Graph Property Graph Analyzing a social network using Big Data Spatial and Graph Property Graph Oskar van Rest Principal Member of Technical Staff Gabriela Montiel-Moreno Principal Member of Technical Staff Safe Harbor Statement

More information

Oracle Database 11g: Program with PL/SQL

Oracle Database 11g: Program with PL/SQL Oracle University Contact: +31 (0)30 669 9244 Oracle Database 11g: Program with PL/SQL Duration: 5 Dagen What you will learn This course introduces students to PL/SQL and helps them understand the benefits

More information

Webinar Series TMIP VISION

Webinar Series TMIP VISION Webinar Series TMIP VISION TMIP provides technical support and promotes knowledge and information exchange in the transportation planning and modeling community. Today s Goals To Consider: Parallel Processing

More information

Database Systems: Design, Implementation, and Management Tenth Edition. Chapter 14 Database Connectivity and Web Technologies

Database Systems: Design, Implementation, and Management Tenth Edition. Chapter 14 Database Connectivity and Web Technologies Database Systems: Design, Implementation, and Management Tenth Edition Chapter 14 Database Connectivity and Web Technologies Database Connectivity Mechanisms by which application programs connect and communicate

More information

CS511 Design of Database Management Systems

CS511 Design of Database Management Systems Announcements CS511 Design of Database Management Systems HW incremental release starting last Sun. Class will reschedule next week: time: Wednesday Tuesday 5pm, place: 1310 DCL Lecture 05: Object Relational

More information

Compact and Efficient Representation of General Graph Databases 1

Compact and Efficient Representation of General Graph Databases 1 This is a post-peer-review, pre-copyedit version of an article published in Knowledge and Information Systems. The final authenticated version is available online at: http://dx.doi.org/.7/ s5-8-275-x Compact

More information

Research challenges in data-intensive computing The Stratosphere Project Apache Flink

Research challenges in data-intensive computing The Stratosphere Project Apache Flink Research challenges in data-intensive computing The Stratosphere Project Apache Flink Seif Haridi KTH/SICS haridi@kth.se e2e-clouds.org Presented by: Seif Haridi May 2014 Research Areas Data-intensive

More information

Chapter 13 XML: Extensible Markup Language

Chapter 13 XML: Extensible Markup Language Chapter 13 XML: Extensible Markup Language - Internet applications provide Web interfaces to databases (data sources) - Three-tier architecture Client V Application Programs Webserver V Database Server

More information

Information Integration

Information Integration Information Integration Part 1: Basics of Relational Database Theory Werner Nutt Faculty of Computer Science Master of Science in Computer Science A.Y. 2012/2013 Integration in Data Management: Evolution

More information

A Hybrid Solution for Mixed Workloads on Dynamic Graphs

A Hybrid Solution for Mixed Workloads on Dynamic Graphs A Hybrid Solution for Mixed Workloads on Dynamic Graphs Mahashweta Das, Alkis Simitsis, Kevin Wilkinson GRADES2016: Graph Data-management Experiences & Systems June 24, 2016 Background Graphs are everywhere!

More information

Handling time in RDF

Handling time in RDF Time in RDF p. 1/15 Handling time in RDF Claudio Gutierrez (Joint work with C. Hurtado and A. Vaisman) Department of Computer Science Universidad de Chile UPM, Madrid, January 2009 Time in RDF p. 2/15

More information

Introduction to Data Management. Lecture #1 (The Course Trailer )

Introduction to Data Management. Lecture #1 (The Course Trailer ) Introduction to Data Management Lecture #1 (The Course Trailer ) Instructor: Mike Carey mjcarey@ics.uci.edu Database Management Systems 3ed, R. Ramakrishnan and J. Gehrke 1 Today s Topics v Welcome to

More information

5/1/17. Announcements. NoSQL Motivation. NoSQL. Serverless Architecture. What is the Problem? Database Systems CSE 414

5/1/17. Announcements. NoSQL Motivation. NoSQL. Serverless Architecture. What is the Problem? Database Systems CSE 414 Announcements Database Systems CSE 414 Lecture 15: NoSQL & JSON (mostly not in textbook only Ch 11.1) 1 Homework 4 due tomorrow night [No Web Quiz 5] Midterm grading hopefully finished tonight post online

More information

Database Theory VU , SS Introduction: Relational Query Languages. Reinhard Pichler

Database Theory VU , SS Introduction: Relational Query Languages. Reinhard Pichler Database Theory Database Theory VU 181.140, SS 2018 1. Introduction: Relational Query Languages Reinhard Pichler Institut für Informationssysteme Arbeitsbereich DBAI Technische Universität Wien 6 March,

More information

CSE 344 JANUARY 3 RD - INTRODUCTION

CSE 344 JANUARY 3 RD - INTRODUCTION CSE 344 JANUARY 3 RD - INTRODUCTION COURSE FORMAT Lectures Location: SIG 134 Please attend Sections: Content: exercises, tutorials, questions, new materials (occasionally) Locations: see web Please attend

More information

Course Content. Object-Oriented Databases. Objectives of Lecture 6. CMPUT 391: Object Oriented Databases. Dr. Osmar R. Zaïane. University of Alberta 4

Course Content. Object-Oriented Databases. Objectives of Lecture 6. CMPUT 391: Object Oriented Databases. Dr. Osmar R. Zaïane. University of Alberta 4 Database Management Systems Fall 2001 CMPUT 391: Object Oriented Databases Dr. Osmar R. Zaïane University of Alberta Chapter 25 of Textbook Course Content Introduction Database Design Theory Query Processing

More information

BIS Database Management Systems.

BIS Database Management Systems. BIS 512 - Database Management Systems http://www.mis.boun.edu.tr/durahim/ Ahmet Onur Durahim Learning Objectives Database systems concepts Designing and implementing a database application Life of a Query

More information

Text transcript of show #280. August 18, Microsoft Research: Trinity is a Graph Database and a Distributed Parallel Platform for Graph Data

Text transcript of show #280. August 18, Microsoft Research: Trinity is a Graph Database and a Distributed Parallel Platform for Graph Data Hanselminutes is a weekly audio talk show with noted web developer and technologist Scott Hanselman and hosted by Carl Franklin. Scott discusses utilities and tools, gives practical how-to advice, and

More information

Lecture 1: Introduction and Motivation Markus Kr otzsch Knowledge-Based Systems

Lecture 1: Introduction and Motivation Markus Kr otzsch Knowledge-Based Systems KNOWLEDGE GRAPHS Introduction and Organisation Lecture 1: Introduction and Motivation Markus Kro tzsch Knowledge-Based Systems TU Dresden, 16th Oct 2018 Markus Krötzsch, 16th Oct 2018 Course Tutors Knowledge

More information

CS108 Lecture 18: Databases and SQL

CS108 Lecture 18: Databases and SQL CS108 Lecture 18: Databases and SQL Databases for data storage and access The Structured Query Language Aaron Stevens 4 March 2013 What You ll Learn Today How does Facebook generate unique pages for each

More information

Relational Model. Course A7B36DBS: Database Systems. Lecture 02: Martin Svoboda Irena Holubová Tomáš Skopal

Relational Model. Course A7B36DBS: Database Systems. Lecture 02: Martin Svoboda Irena Holubová Tomáš Skopal Course A7B36DBS: Database Systems Lecture 02: Relational Model Martin Svoboda Irena Holubová Tomáš Skopal Faculty of Electrical Engineering, Czech Technical University in Prague Outline Logical database

More information

Dynamic Graph Query Support for SDN Management. Ramya Raghavendra IBM TJ Watson Research Center

Dynamic Graph Query Support for SDN Management. Ramya Raghavendra IBM TJ Watson Research Center Dynamic Graph Query Support for SDN Management Ramya Raghavendra IBM TJ Watson Research Center Roadmap SDN scenario 1: Cloud provisioning Management/Analytics primitives Current Cloud Offerings Limited

More information

Jure Leskovec Including joint work with Y. Perez, R. Sosič, A. Banarjee, M. Raison, R. Puttagunta, P. Shah

Jure Leskovec Including joint work with Y. Perez, R. Sosič, A. Banarjee, M. Raison, R. Puttagunta, P. Shah Jure Leskovec (@jure) Including joint work with Y. Perez, R. Sosič, A. Banarjee, M. Raison, R. Puttagunta, P. Shah 2 My research group at Stanford: Mining and modeling large social and information networks

More information

Big Data. Big Data Analyst. Big Data Engineer. Big Data Architect

Big Data. Big Data Analyst. Big Data Engineer. Big Data Architect Big Data Big Data Analyst INTRODUCTION TO BIG DATA ANALYTICS ANALYTICS PROCESSING TECHNIQUES DATA TRANSFORMATION & BATCH PROCESSING REAL TIME (STREAM) DATA PROCESSING Big Data Engineer BIG DATA FOUNDATION

More information

10/18/2017. Announcements. NoSQL Motivation. NoSQL. Serverless Architecture. What is the Problem? Database Systems CSE 414

10/18/2017. Announcements. NoSQL Motivation. NoSQL. Serverless Architecture. What is the Problem? Database Systems CSE 414 Announcements Database Systems CSE 414 Lecture 11: NoSQL & JSON (mostly not in textbook only Ch 11.1) HW5 will be posted on Friday and due on Nov. 14, 11pm [No Web Quiz 5] Today s lecture: NoSQL & JSON

More information

Relational Model. Courses B0B36DBS, A4B33DS, A7B36DBS: Database Systems. Lecture 02: Martin Svoboda

Relational Model. Courses B0B36DBS, A4B33DS, A7B36DBS: Database Systems. Lecture 02: Martin Svoboda Courses B0B36DBS, A4B33DS, A7B36DBS: Database Systems Lecture 02: Relational Model Martin Svoboda 28. 2. 2017 Faculty of Electrical Engineering, Czech Technical University in Prague Lecture Outline Logical

More information