Answering Queries Using Cooperative Semantic Caching

Size: px
Start display at page:

Download "Answering Queries Using Cooperative Semantic Caching"

Transcription

1 Answering Queries Using Cooperative Caching Andrei Vancea 1, Prof. Dr. Burkhard Stiller 1,2 1 Department of Informatics IFI, Communication Systems Group CSG, University of Zürich 2 associated with the D-ITET, ETH Zürich Background Approach Evaluation Conclusion

2 Background Databases Client / server architecture Client : asks a query (SQL) Server : returns the result (tuples) Data shipping architectures Most of the query processing is performed on the client side Data is sent from the server to the client at processing time Client-side caching Response time Server load

3 Client-side caching Page caching Tuple caching caching Background caching Clients store the results of old queries, together with their descriptions Old query results are used when answering new queries

4 Example Background - Caching Q1 : select * from persons where age > 10 Database

5 Example Background - Caching result store Q1 : age > 10 Database

6 Example Background - Caching Q2 : select * from persons where age > 7 Q1 : age > 10 Database

7 Example Background - Caching select * from persons where age > 7 and age <= 10 select * from Q1 Q1 : age > 10 Database

8 Example Background - Caching result result Q1 : age > 10 Database

9 Background - Caching Query Cache entry Query description Result set Query rewriting Probe Remainder Queries descriptions Probe QUERY REWRITING Remainder Server

10 Cooperative Caching Share the local semantic s between clients in a cooperative matter Before sending a query to the server, it is checked if there are other clients that have useful semantic entries Why? Reduce the load of the database server Decrease query response time Database

11 Query Rewriting Query rewriting Probe Remote probes Remainder QUERY All queries descriptions Query REWRITING Network information... Probe Remote probe Remote probe Remainder Local Remote Remote Server

12 Architecture Issues Who rewrites the queries? (clients, server) How/where are the queries descriptions stored? Updates Time-outs Two possible architectures Centralized Distributed

13 Cooperative Caching Centralized Approach Centralized manager Stores the descriptions of all queries d by different clients Rewrite queries Advantages Easy to implement Query rewriting simplified Disadvantages Scalability problems (the manager is contacted before every query execution) Bottleneck

14 Cooperative Caching Distributed Approach Queries descriptions stored in a DHT Query rewriting executed locally by each client using the data stored in the DHT Advantages Scalable Disadvantages Query rewriting much more difficult

15 Query Rewriting Theoretical problem : answering queries using view Not possible for all SQL queries Query containment is undecidable for general relational queries Range queries Multi-dimensional range queries

16 Evaluation Test-bed consisting of a database server and number of clients (in a LAN) Dataset from Wisconsin benchmark The clients execute, in parallel, queries under three different scenarios Without using the Using only the local semantic Using the cooperative semantic Average query response time computed in each scenario

17 Conclusions P2P approach used for reducing the load of the database server Two possible architectures proposed Evaluation

18 Questions?

Fast Similarity Search for Structured P2P Systems Thomas Bocek1, Fabio Hecht1, Ela Hunt 2, David Hausheer1, and Burkhard Stiller1,3 1 CSG, IFI, UZH GlobIS, ETH Zurich 3 CSG, TIK, ETH Zurich E-Mail: bocek

More information

SCRIPT: An Architecture for IPFIX Data Distribution

SCRIPT: An Architecture for IPFIX Data Distribution SCRIPT Public Workshop January 20, 2010, Zurich, Switzerland SCRIPT: An Architecture for IPFIX Data Distribution Peter Racz Communication Systems Group CSG Department of Informatics IFI University of Zürich

More information

DATABASES AND THE CLOUD. Gustavo Alonso Systems Group / ECC Dept. of Computer Science ETH Zürich, Switzerland

DATABASES AND THE CLOUD. Gustavo Alonso Systems Group / ECC Dept. of Computer Science ETH Zürich, Switzerland DATABASES AND THE CLOUD Gustavo Alonso Systems Group / ECC Dept. of Computer Science ETH Zürich, Switzerland AVALOQ Conference Zürich June 2011 Systems Group www.systems.ethz.ch Enterprise Computing Center

More information

Module 4. Implementation of XQuery. Part 0: Background on relational query processing

Module 4. Implementation of XQuery. Part 0: Background on relational query processing Module 4 Implementation of XQuery Part 0: Background on relational query processing The Data Management Universe Lecture Part I Lecture Part 2 2 What does a Database System do? Input: SQL statement Output:

More information

Incrementally Maintaining Classification using an RDBMS. Presented by: Noah Golmant October 3, 2016

Incrementally Maintaining Classification using an RDBMS. Presented by: Noah Golmant October 3, 2016 Incrementally Maintaining Classification using an RDBMS Presented by: Noah Golmant October 3, 2016 HAZY An end-to-end system for imprecision management Goals: Integrate classification models into run-time

More information

Course Outline. Performance Tuning and Optimizing SQL Databases Course 10987B: 4 days Instructor Led

Course Outline. Performance Tuning and Optimizing SQL Databases Course 10987B: 4 days Instructor Led Performance Tuning and Optimizing SQL Databases Course 10987B: 4 days Instructor Led About this course This four-day instructor-led course provides students who manage and maintain SQL Server databases

More information

Hash Joins for Multi-core CPUs. Benjamin Wagner

Hash Joins for Multi-core CPUs. Benjamin Wagner Hash Joins for Multi-core CPUs Benjamin Wagner Joins fundamental operator in query processing variety of different algorithms many papers publishing different results main question: is tuning to modern

More information

Data Modeling and Databases Ch 10: Query Processing - Algorithms. Gustavo Alonso Systems Group Department of Computer Science ETH Zürich

Data Modeling and Databases Ch 10: Query Processing - Algorithms. Gustavo Alonso Systems Group Department of Computer Science ETH Zürich Data Modeling and Databases Ch 10: Query Processing - Algorithms Gustavo Alonso Systems Group Department of Computer Science ETH Zürich Transactions (Locking, Logging) Metadata Mgmt (Schema, Stats) Application

More information

Data Modeling and Databases Ch 9: Query Processing - Algorithms. Gustavo Alonso Systems Group Department of Computer Science ETH Zürich

Data Modeling and Databases Ch 9: Query Processing - Algorithms. Gustavo Alonso Systems Group Department of Computer Science ETH Zürich Data Modeling and Databases Ch 9: Query Processing - Algorithms Gustavo Alonso Systems Group Department of Computer Science ETH Zürich Transactions (Locking, Logging) Metadata Mgmt (Schema, Stats) Application

More information

Leveraging Smart Contracts for Automatic SLA Compensation The Case of NFV Environments

Leveraging Smart Contracts for Automatic SLA Compensation The Case of NFV Environments AIMS 2018, June 4-5, Munich, Germany Leveraging Smart Contracts for Automatic SLA Compensation The Case of NFV Environments Eder John Scheid, Burkhard Stiller Department of Informatics IFI, Communication

More information

Summary Cache: A Scalable Wide-Area Web Cache Sharing Protocol

Summary Cache: A Scalable Wide-Area Web Cache Sharing Protocol Summary Cache: A Scalable Wide-Area Web Cache Sharing Protocol Li Fan, Pei Cao and Jussara Almeida University of Wisconsin-Madison Andrei Broder Compaq/DEC System Research Center Why Web Caching One of

More information

NFSv4 as the Building Block for Fault Tolerant Applications

NFSv4 as the Building Block for Fault Tolerant Applications NFSv4 as the Building Block for Fault Tolerant Applications Alexandros Batsakis Overview Goal: To provide support for recoverability and application fault tolerance through the NFSv4 file system Motivation:

More information

Master Project Market HS 2016

Master Project Market HS 2016 Master Project Market HS 2016 Nathan Labhart Academic Coordinator 2016-11-30 Master Project Market HS 2016 Nathan Labhart 1 Master Project: Rules The Master Project is a group project with two or more

More information

Crescando: Predictable Performance for Unpredictable Workloads

Crescando: Predictable Performance for Unpredictable Workloads Crescando: Predictable Performance for Unpredictable Workloads G. Alonso, D. Fauser, G. Giannikis, D. Kossmann, J. Meyer, P. Unterbrunner Amadeus S.A. ETH Zurich, Systems Group (Funded by Enterprise Computing

More information

[MS10987A]: Performance Tuning and Optimizing SQL Databases

[MS10987A]: Performance Tuning and Optimizing SQL Databases [MS10987A]: Performance Tuning and Optimizing SQL Databases Length : 4 Days Audience(s) : IT Professionals Level : 300 Technology : Microsoft SQL Server Delivery Method : Instructor-led (Classroom) Course

More information

Perm Integrating Data Provenance Support in Database Systems

Perm Integrating Data Provenance Support in Database Systems Perm Integrating Data Provenance Support in Database Systems Boris Glavic Database Technology Group Department of Informatics University of Zurich glavic@ifi.uzh.ch Gustavo Alonso Systems Group Department

More information

Datenbanksysteme II: Caching and File Structures. Ulf Leser

Datenbanksysteme II: Caching and File Structures. Ulf Leser Datenbanksysteme II: Caching and File Structures Ulf Leser Content of this Lecture Caching Overview Accessing data Cache replacement strategies Prefetching File structure Index Files Ulf Leser: Implementation

More information

Performance Tuning & Optimizing SQL Databases Microsoft Official Curriculum (MOC 10987)

Performance Tuning & Optimizing SQL Databases Microsoft Official Curriculum (MOC 10987) Performance Tuning & Optimizing SQL Databases Microsoft Official Curriculum (MOC 10987) Course Length: 4 days Course Delivery: Traditional Classroom Online Live Course Overview This 4-day instructor-led

More information

Research Collection. Cluster-Computing and Parallelization for the Multi-Dimensional PH-Index. Master Thesis. ETH Library

Research Collection. Cluster-Computing and Parallelization for the Multi-Dimensional PH-Index. Master Thesis. ETH Library Research Collection Master Thesis Cluster-Computing and Parallelization for the Multi-Dimensional PH-Index Author(s): Vancea, Bogdan Aure Publication Date: 2015 Permanent Link: https://doi.org/10.3929/ethz-a-010437712

More information

6.830 Lecture 8 10/2/2017. Lab 2 -- Due Weds. Project meeting sign ups. Recap column stores & paper. Join Processing:

6.830 Lecture 8 10/2/2017. Lab 2 -- Due Weds. Project meeting sign ups. Recap column stores & paper. Join Processing: Lab 2 -- Due Weds. Project meeting sign ups 6.830 Lecture 8 10/2/2017 Recap column stores & paper Join Processing: S = {S} tuples, S pages R = {R} tuples, R pages R < S M pages of memory Types of joins

More information

Summary Cache based Co-operative Proxies

Summary Cache based Co-operative Proxies Summary Cache based Co-operative Proxies Project No: 1 Group No: 21 Vijay Gabale (07305004) Sagar Bijwe (07305023) 12 th November, 2007 1 Abstract Summary Cache based proxies cooperate behind a bottleneck

More information

Virtual views. Incremental View Maintenance. View maintenance. Materialized views. Review of bag algebra. Bag algebra operators (slide 1)

Virtual views. Incremental View Maintenance. View maintenance. Materialized views. Review of bag algebra. Bag algebra operators (slide 1) Virtual views Incremental View Maintenance CPS 296.1 Topics in Database Systems A view is defined by a query over base tables Example: CREATE VIEW V AS SELECT FROM R, S WHERE ; A view can be queried just

More information

From ER to Relational Model. Book Chapter 3 (part 2 )

From ER to Relational Model. Book Chapter 3 (part 2 ) From ER to Relational Model Book Chapter 3 (part 2 ) Logical DB Design: ER to Relational Translate Entity sets to tables: ssn name Employees lot CREATE TABLE Employees (ssn CHAR(11), name CHAR(20), lot

More information

Bloom Filters. References:

Bloom Filters. References: Bloom Filters References: Li Fan, Pei Cao, Jussara Almeida, Andrei Broder, Summary Cache: A Scalable Wide-Area Web Cache Sharing Protocol, IEEE/ACM Transactions on Networking, Vol. 8, No. 3, June 2000.

More information

Conjunctive queries. Many computational problems are much easier for conjunctive queries than for general first-order queries.

Conjunctive queries. Many computational problems are much easier for conjunctive queries than for general first-order queries. Conjunctive queries Relational calculus queries without negation and disjunction. Conjunctive queries have a normal form: ( y 1 ) ( y n )(p 1 (x 1,..., x m, y 1,..., y n ) p k (x 1,..., x m, y 1,..., y

More information

Orleans. Actors for High-Scale Services. Sergey Bykov extreme Computing Group, Microsoft Research

Orleans. Actors for High-Scale Services. Sergey Bykov extreme Computing Group, Microsoft Research Orleans Actors for High-Scale Services Sergey Bykov extreme Computing Group, Microsoft Research 3-Tier Architecture Frontends Middle Tier Storage Stateless frontends Stateless middle tier Storage is the

More information

Relational Model & Algebra. Announcements (Tue. Sep. 3) Relational data model. CompSci 316 Introduction to Database Systems

Relational Model & Algebra. Announcements (Tue. Sep. 3) Relational data model. CompSci 316 Introduction to Database Systems Relational Model & Algebra CompSci 316 Introduction to Database Systems Announcements (Tue. Sep. 3) Homework #1 has been posted Sign up for Gradiance now! Windows Azure passcode will be emailed soon sign

More information

AN INTELLIGENT APPROACH OF QUERY PROCESS OPTIMISATION USING COOPERATIVE SEMANTIC CACHING TECHNIQUE

AN INTELLIGENT APPROACH OF QUERY PROCESS OPTIMISATION USING COOPERATIVE SEMANTIC CACHING TECHNIQUE Journal of Engineering Science and Technology Vol. 12, No. 9 (2017) 2476-2487 School of Engineering, Taylor s University AN INTELLIGENT APPROACH OF QUERY PROCESS OPTIMISATION USING COOPERATIVE SEMANTIC

More information

B.H.GARDI COLLEGE OF MASTER OF COMPUTER APPLICATION. Ch. 1 :- Introduction Database Management System - 1

B.H.GARDI COLLEGE OF MASTER OF COMPUTER APPLICATION. Ch. 1 :- Introduction Database Management System - 1 Basic Concepts :- 1. What is Data? Data is a collection of facts from which conclusion may be drawn. In computer science, data is anything in a form suitable for use with a computer. Data is often distinguished

More information

SQL Server Administration 10987: Performance Tuning and Optimizing SQL Databases. Upcoming Dates. Course Description.

SQL Server Administration 10987: Performance Tuning and Optimizing SQL Databases. Upcoming Dates. Course Description. SQL Server Administration 10987: Performance Tuning and Optimizing SQL Databases Learn the high level architectural overview of SQL Server 2016 and explore SQL Server execution model, waits and queues

More information

(Extended) Entity Relationship

(Extended) Entity Relationship 03 - Database Design, UML and (Extended) Entity Relationship Modeling CS530 Database Architecture Models and Design Prof. Ian HORROCKS Dr. Robert STEVENS In this Section Topics Covered Database Design

More information

IP Networking Fundamentals Theory and Practice

IP Networking Fundamentals Theory and Practice IP ing Fundamentals Theory and Practice Introductory course into computer networking Prof. Dr. Károly Farkas Guest Professor Department of Informatics, UZH farkas@ifi.uzh.ch Introduction Reader: Prof.

More information

Visualize ComplexCities

Visualize ComplexCities Introduction to Python Chair of Information Architecture ETH Zürich February 22, 2013 First Steps Python Basics Conditionals Statements Loops User Input Functions Programming? Programming is the interaction

More information

CSE 444: Database Internals. Lecture 22 Distributed Query Processing and Optimization

CSE 444: Database Internals. Lecture 22 Distributed Query Processing and Optimization CSE 444: Database Internals Lecture 22 Distributed Query Processing and Optimization CSE 444 - Spring 2014 1 Readings Main textbook: Sections 20.3 and 20.4 Other textbook: Database management systems.

More information

Streaming Data Integration: Challenges and Opportunities. Nesime Tatbul

Streaming Data Integration: Challenges and Opportunities. Nesime Tatbul Streaming Data Integration: Challenges and Opportunities Nesime Tatbul Talk Outline Integrated data stream processing An example project: MaxStream Architecture Query model Conclusions ICDE NTII Workshop,

More information

Chronix A fast and efficient time series storage based on Apache Solr. Caution: Contains technical content.

Chronix A fast and efficient time series storage based on Apache Solr. Caution: Contains technical content. Chronix A fast and efficient time series storage based on Apache Solr Caution: Contains technical content. 68.000.000.000* time correlated data objects. How to store such amount of data on your laptop

More information

CS425 Midterm Exam Summer C 2012

CS425 Midterm Exam Summer C 2012 Q1) List five responsibilities of a database-management system. Q2) Fill in the terms in the right hand side of the table that match the description from the list below: Instance SQL Integrity constraints

More information

Announcements. Relational Model & Algebra. Example. Relational data model. Example. Schema versus instance. Lecture notes

Announcements. Relational Model & Algebra. Example. Relational data model. Example. Schema versus instance. Lecture notes Announcements Relational Model & Algebra CPS 216 Advanced Database Systems Lecture notes Notes version (incomplete) available in the morning on the day of lecture Slides version (complete) available after

More information

Several major software companies including IBM, Informix, Microsoft, Oracle, and Sybase have all released object-relational versions of their

Several major software companies including IBM, Informix, Microsoft, Oracle, and Sybase have all released object-relational versions of their Several major software companies including IBM, Informix, Microsoft, Oracle, and Sybase have all released object-relational versions of their products. These companies are promoting a new, extended version

More information

Software Defined Networking Data centre perspective: Open Flow

Software Defined Networking Data centre perspective: Open Flow Software Defined Networking Data centre perspective: Open Flow Seminar: Prof. Timothy Roscoe & Dr. Desislava Dimitrova D. Dimitrova, T. Roscoe 04.03.2016 1 OpenFlow Specification, protocol, architecture

More information

Using Strategies for Assessment of Functional Programming Exercises

Using Strategies for Assessment of Functional Programming Exercises Using Strategies for Assessment of Functional Programming Exercises Ir. Alex Gerdes Joint work with prof. dr. Johan Jeuring and dr. Bastiaan Heeren Open Universiteit Nederland School of Computer Science

More information

Master Course Computer Networks IN2097

Master Course Computer Networks IN2097 Chair for Network Architectures and Services Prof. Carle Department for Computer Science TU München Master Course Computer Networks IN2097 Prof. Dr.-Ing. Georg Carle Christian Grothoff, Ph.D. Chair for

More information

Rajashree Deka Tetherless World Constellation Rensselaer Polytechnic Institute

Rajashree Deka Tetherless World Constellation Rensselaer Polytechnic Institute Rajashree Deka Tetherless World Constellation Rensselaer Polytechnic Institute Ø The majority of data underpinning the Web are stored in Relational Databases (RDB). Ø Advantages: Secure and scalable architecture.

More information

Performance in the Multicore Era

Performance in the Multicore Era Performance in the Multicore Era Gustavo Alonso Systems Group -- ETH Zurich, Switzerland Systems Group Enterprise Computing Center Performance in the multicore era 2 BACKGROUND - SWISSBOX SwissBox: An

More information

Access Path Selection in Main-Memory Optimized Data Systems

Access Path Selection in Main-Memory Optimized Data Systems Access Path Selection in Main-Memory Optimized Data Systems Should I Scan or Should I Probe? Manos Athanassoulis Harvard University Talk at CS265, February 16 th, 2018 1 Access Path Selection SELECT x

More information

Files/News/Software Distribution on Demand. Replicated Internet Sites. Means of Content Distribution. Computer Networks 11/9/2009

Files/News/Software Distribution on Demand. Replicated Internet Sites. Means of Content Distribution. Computer Networks 11/9/2009 Content Distribution Kai Shen Files/News/Software Distribution on Demand Content distribution: Popular web directory sites like Yahoo; Breaking news from CNN; Online software downloads from Linux kernel

More information

Relational Model & Algebra. Announcements (Thu. Aug. 27) Relational data model. CPS 116 Introduction to Database Systems

Relational Model & Algebra. Announcements (Thu. Aug. 27) Relational data model. CPS 116 Introduction to Database Systems Relational Model & Algebra CPS 116 Introduction to Database Systems Announcements (Thu. Aug. 27) 2 Homework #1 will be assigned next Tuesday Office hours: see also course website Jun: LSRC D327 Tue. 1.5

More information

Basic operators: selection, projection, cross product, union, difference,

Basic operators: selection, projection, cross product, union, difference, CS145 Lecture Notes #6 Relational Algebra Steps in Building and Using a Database 1. Design schema 2. Create schema in DBMS 3. Load initial data 4. Repeat: execute queries and updates on the database Database

More information

Coefficient Constant Equivalent expressions Equation. 3 A mathematical sentence containing an equal sign

Coefficient Constant Equivalent expressions Equation. 3 A mathematical sentence containing an equal sign 8.4.0 Lesson Date Algebra Vocabulary and Generating Equivalent s Student Objectives I can identify how many terms an expression has and what the coefficients, constants, and like terms of that expression

More information

10987: Performance Tuning and Optimizing SQL Databases

10987: Performance Tuning and Optimizing SQL Databases Let s Reach For Excellence! TAN DUC INFORMATION TECHNOLOGY SCHOOL JSC Address: 103 Pasteur, Dist.1, HCMC Tel: 08 38245819; 38239761 Email: traincert@tdt-tanduc.com Website: www.tdt-tanduc.com; www.tanducits.com

More information

Information Systems for Engineers. Exercise 10. ETH Zurich, Fall Semester Hand-out Due

Information Systems for Engineers. Exercise 10. ETH Zurich, Fall Semester Hand-out Due Information Systems for Engineers Exercise 10 ETH Zurich, Fall Semester 2017 Hand-out 08.12.2017 Due 15.12.2017 1. (Exercise 8.1.1 in [1]) Movies(title, year, length, genre, studioname, producercertnumber)

More information

Compiler Design Spring 2018

Compiler Design Spring 2018 Compiler Design Spring 2018 Thomas R. Gross Computer Science Department ETH Zurich, Switzerland 1 Logistics Lecture Tuesdays: 10:15 11:55 Thursdays: 10:15 -- 11:55 In ETF E1 Recitation Announced later

More information

Performance Tuning and Optimizing SQL Databases (10987)

Performance Tuning and Optimizing SQL Databases (10987) Performance Tuning and Optimizing SQL Databases (10987) Formato do curso: Presencial Preço: 1420 Nível: Avançado Duração: 28 horas This four-day instructor-led course provides students who manage and maintain

More information

Learn Well Technocraft

Learn Well Technocraft Getting Started with ASP.NET This module explains how to build and configure a simple ASP.NET application. Introduction to ASP.NET Web Applications Features of ASP.NET Configuring ASP.NET Applications

More information

FG INET: Intelligent Networks

FG INET: Intelligent Networks FG INET: Intelligent Networks An-Institut Deutsche Telekom Laboratories Prof. Anja Feldmann, Ph.D. anja@net.t-labs.tu-berlin.de http://www.net.t-labs.tu-berlin.de/ 1 INET: Research Group Location Telefunkenhochhaus,

More information

Telematics Chapter 9: Peer-to-Peer Networks

Telematics Chapter 9: Peer-to-Peer Networks Telematics Chapter 9: Peer-to-Peer Networks Beispielbild User watching video clip Server with video clips Application Layer Presentation Layer Application Layer Presentation Layer Session Layer Session

More information

Arrakis: The Operating System is the Control Plane

Arrakis: The Operating System is the Control Plane Arrakis: The Operating System is the Control Plane Simon Peter, Jialin Li, Irene Zhang, Dan Ports, Doug Woos, Arvind Krishnamurthy, Tom Anderson University of Washington Timothy Roscoe ETH Zurich Building

More information

Chapter 4: Apache Spark

Chapter 4: Apache Spark Chapter 4: Apache Spark Lecture Notes Winter semester 2016 / 2017 Ludwig-Maximilians-University Munich PD Dr. Matthias Renz 2015, Based on lectures by Donald Kossmann (ETH Zürich), as well as Jure Leskovec,

More information

Query Processing over Data Streams. Formula for a Database Research Project. Following the Formula

Query Processing over Data Streams. Formula for a Database Research Project. Following the Formula Query Processing over Data Streams Joint project with Prof. Rajeev Motwani and a group of graduate students stanfordstreamdatamanager Formula for a Database Research Project Pick a simple but fundamental

More information

Data Modeling and Databases Ch 14: Data Replication. Gustavo Alonso, Ce Zhang Systems Group Department of Computer Science ETH Zürich

Data Modeling and Databases Ch 14: Data Replication. Gustavo Alonso, Ce Zhang Systems Group Department of Computer Science ETH Zürich Data Modeling and Databases Ch 14: Data Replication Gustavo Alonso, Ce Zhang Systems Group Department of Computer Science ETH Zürich Database Replication What is database replication The advantages of

More information

SparkBench: A Comprehensive Spark Benchmarking Suite Characterizing In-memory Data Analytics

SparkBench: A Comprehensive Spark Benchmarking Suite Characterizing In-memory Data Analytics SparkBench: A Comprehensive Spark Benchmarking Suite Characterizing In-memory Data Analytics Min LI,, Jian Tan, Yandong Wang, Li Zhang, Valentina Salapura, Alan Bivens IBM TJ Watson Research Center * A

More information

A201 Object Oriented Programming with Visual Basic.Net

A201 Object Oriented Programming with Visual Basic.Net A201 Object Oriented Programming with Visual Basic.Net By: Dr. Hossein Computer Science and Informatics IU South Bend 1 What do we need to learn in order to write computer programs? Fundamental programming

More information

Red-Black-Trees and Heaps in Timestamp-Adjusting Sweepline Based Algorithms

Red-Black-Trees and Heaps in Timestamp-Adjusting Sweepline Based Algorithms Department of Informatics, University of Zürich Vertiefungsarbeit Red-Black-Trees and Heaps in Timestamp-Adjusting Sweepline Based Algorithms Mirko Richter Matrikelnummer: 12-917-175 Email: mirko.richter@uzh.ch

More information

Lecture 6. Abstract Interpretation

Lecture 6. Abstract Interpretation Lecture 6. Abstract Interpretation Wei Le 2014.10 Outline Motivation History What it is: an intuitive understanding An example Steps of abstract interpretation Galois connection Narrowing and Widening

More information

What is new in the cloud? Donald Kossmann ETH Zurich

What is new in the cloud? Donald Kossmann ETH Zurich What is new in the cloud? Donald Kossmann ETH Zurich http://systems.ethz.ch Acknowledgments Questions? Agenda Why? How? What? Simple Truths Power of data the more data the merrier (GB > TB > PB) data comes

More information

Developing SQL Data Models(768)

Developing SQL Data Models(768) Developing SQL Data Models(768) Design a multidimensional business intelligence (BI) semantic model Create a multidimensional database by using Microsoft SQL Server Analysis Services (SSAS) Design, develop,

More information

CSE 5306 Distributed Systems

CSE 5306 Distributed Systems CSE 5306 Distributed Systems Naming Jia Rao http://ranger.uta.edu/~jrao/ 1 Naming Names play a critical role in all computer systems To access resources, uniquely identify entities, or refer to locations

More information

Achieving Horizontal Scalability. Alain Houf Sales Engineer

Achieving Horizontal Scalability. Alain Houf Sales Engineer Achieving Horizontal Scalability Alain Houf Sales Engineer Scale Matters InterSystems IRIS Database Platform lets you: Scale up and scale out Scale users and scale data Mix and match a variety of approaches

More information

88X + PERFORMANCE GAINS USING IBM DB2 WITH BLU ACCELERATION ON INTEL TECHNOLOGY

88X + PERFORMANCE GAINS USING IBM DB2 WITH BLU ACCELERATION ON INTEL TECHNOLOGY 05.11.2013 Thomas Kalb 88X + PERFORMANCE GAINS USING IBM DB2 WITH BLU ACCELERATION ON INTEL TECHNOLOGY Copyright 2013 ITGAIN GmbH 1 About ITGAIN Founded as a DB2 Consulting Company into 2001 DB2 Monitor

More information

OTRS Extensions are now verified providing you with even more confidence and quality!

OTRS Extensions are now verified providing you with even more confidence and quality! OTRS Extensions are now verified providing you with even more confidence and quality! Use OTRS Extensions and play it safe. quality seal. was introduced in 2013 as an official security and With this, we

More information

Scaling PortfolioCenter on a Network using 64-Bit Computing

Scaling PortfolioCenter on a Network using 64-Bit Computing Scaling PortfolioCenter on a Network using 64-Bit Computing Alternate Title: Scaling PortfolioCenter using 64-Bit Servers As your office grows, both in terms of the number of PortfolioCenter users and

More information

Selected Sections of Applied Informatics

Selected Sections of Applied Informatics Selected Sections of Applied Informatics M.Sc. Marcin Koniak koniakm@wt.pw.edu.pl http://www2.wt.pw.edu.pl/~a.czerepicki Based on lecture: Dr inż. Andrzej Czerepicki a.czerepicki@wt.pw.edu.pl 2018 Lecture

More information

740: Computer Architecture Memory Consistency. Prof. Onur Mutlu Carnegie Mellon University

740: Computer Architecture Memory Consistency. Prof. Onur Mutlu Carnegie Mellon University 740: Computer Architecture Memory Consistency Prof. Onur Mutlu Carnegie Mellon University Readings: Memory Consistency Required Lamport, How to Make a Multiprocessor Computer That Correctly Executes Multiprocess

More information

Scalable Concurrent Hash Tables via Relativistic Programming

Scalable Concurrent Hash Tables via Relativistic Programming Scalable Concurrent Hash Tables via Relativistic Programming Josh Triplett September 24, 2009 Speed of data < Speed of light Speed of light: 3e8 meters/second Processor speed: 3 GHz, 3e9 cycles/second

More information

Data Integration and Data Warehousing Database Integration Overview

Data Integration and Data Warehousing Database Integration Overview Data Integration and Data Warehousing Database Integration Overview Sergey Stupnikov Institute of Informatics Problems, RAS ssa@ipi.ac.ru Outline Information Integration Problem Heterogeneous Information

More information

Chair of Software Engineering. Languages in Depth Series: Java Programming. Prof. Dr. Bertrand Meyer. Exercise Session 9.

Chair of Software Engineering. Languages in Depth Series: Java Programming. Prof. Dr. Bertrand Meyer. Exercise Session 9. Chair of Software Engineering Languages in Depth Series: Java Programming Prof. Dr. Bertrand Meyer Exercise Session 9 Andrei Vancea Today s Exercise Session Pattern of the Day Chain of Responsibility Quizzes

More information

CSE 544 Principles of Database Management Systems

CSE 544 Principles of Database Management Systems CSE 544 Principles of Database Management Systems Alvin Cheung Fall 2015 Lecture 5 - DBMS Architecture and Indexing 1 Announcements HW1 is due next Thursday How is it going? Projects: Proposals are due

More information

Anti-Caching: A New Approach to Database Management System Architecture. Guide: Helly Patel ( ) Dr. Sunnie Chung Kush Patel ( )

Anti-Caching: A New Approach to Database Management System Architecture. Guide: Helly Patel ( ) Dr. Sunnie Chung Kush Patel ( ) Anti-Caching: A New Approach to Database Management System Architecture Guide: Helly Patel (2655077) Dr. Sunnie Chung Kush Patel (2641883) Abstract Earlier DBMS blocks stored on disk, with a main memory

More information

Improving Query Plans. CS157B Chris Pollett Mar. 21, 2005.

Improving Query Plans. CS157B Chris Pollett Mar. 21, 2005. Improving Query Plans CS157B Chris Pollett Mar. 21, 2005. Outline Parse Trees and Grammars Algebraic Laws for Improving Query Plans From Parse Trees To Logical Query Plans Syntax Analysis and Parse Trees

More information

Complex Queries in DHTbased Peer-to-Peer Networks

Complex Queries in DHTbased Peer-to-Peer Networks Complex Queries in DHTbased Peer-to-Peer Networks Matthew Harren et al. Ali Taleghani March 30, 2005 Outline Introduction Motivation Why not P2P Databases Substring Search P2P Query Processing CANDy Range

More information

Lecture 23 Database System Architectures

Lecture 23 Database System Architectures CMSC 461, Database Management Systems Spring 2018 Lecture 23 Database System Architectures These slides are based on Database System Concepts 6 th edition book (whereas some quotes and figures are used

More information

Data Warehousing 3. ICS 421 Spring Asst. Prof. Lipyeow Lim Information & Computer Science Department University of Hawaii at Manoa

Data Warehousing 3. ICS 421 Spring Asst. Prof. Lipyeow Lim Information & Computer Science Department University of Hawaii at Manoa ICS 421 Spring 2010 Data Warehousing 3 Asst. Prof. Lipyeow Lim Information & Computer Science Department University of Hawaii at Manoa 4/1/2010 Lipyeow Lim -- University of Hawaii at Manoa 1 Implementation

More information

Performance Tuning and Optimizing SQL Databases (10987)

Performance Tuning and Optimizing SQL Databases (10987) Performance Tuning and Optimizing SQL Databases (10987) Duration: 4 Days Price: $895 Delivery Option: Attend via MOC On-Demand Students Will Learn High level architectural overview of SQL Server and its

More information

CSE 5306 Distributed Systems. Naming

CSE 5306 Distributed Systems. Naming CSE 5306 Distributed Systems Naming 1 Naming Names play a critical role in all computer systems To access resources, uniquely identify entities, or refer to locations To access an entity, you have resolve

More information

itrails: Pay-as-you-go Information Integration in Dataspaces

itrails: Pay-as-you-go Information Integration in Dataspaces itrails: Pay-as-you-go Information Integration in Dataspaces Marcos Vaz Salles Jens Dittrich Shant Karakashian Olivier Girard Lukas Blunschi ETH Zurich VLDB 2007 Outline Motivation itrails Experiments

More information

Lecture 11: Middleboxes and NAT (Duct tape for IPv4)

Lecture 11: Middleboxes and NAT (Duct tape for IPv4) CSCI-351 Data communication and Networks Lecture 11: Middleboxes and NAT (Duct tape for IPv4) The slide is built with the help of Prof. Alan Mislove, Christo Wilson, and David Choffnes's class Middleboxes

More information

Adaptive Query Processing on Prefix Trees Wolfgang Lehner

Adaptive Query Processing on Prefix Trees Wolfgang Lehner Adaptive Query Processing on Prefix Trees Wolfgang Lehner Fachgruppentreffen, 22.11.2012 TU München Prof. Dr.-Ing. Wolfgang Lehner > Challenges for Database Systems Three things are important in the database

More information

SQL implementation of Singular Value Decomposition by Housholder transformation and QR formalization

SQL implementation of Singular Value Decomposition by Housholder transformation and QR formalization Robert Jan Stucki SQL implementation of Singular Value Decomposition by Housholder transformation and QR formalization December 2012 University of Zurich Department of Informatics (IFI) Binzmühlestrasse

More information

Design and Implementation of Bit-Vector filtering for executing of multi-join qureies

Design and Implementation of Bit-Vector filtering for executing of multi-join qureies Undergraduate Research Opportunity Program (UROP) Project Report Design and Implementation of Bit-Vector filtering for executing of multi-join qureies By Cheng Bin Department of Computer Science School

More information

Big and Fast. Anti-Caching in OLTP Systems. Justin DeBrabant

Big and Fast. Anti-Caching in OLTP Systems. Justin DeBrabant Big and Fast Anti-Caching in OLTP Systems Justin DeBrabant Online Transaction Processing transaction-oriented small footprint write-intensive 2 A bit of history 3 OLTP Through the Years relational model

More information

Data Warehousing and Decision Support

Data Warehousing and Decision Support Data Warehousing and Decision Support Chapter 23, Part B Database Management Systems, 2 nd Edition. R. Ramakrishnan and J. Gehrke Views and Decision Support OLAP queries are typically aggregate queries.

More information

Distributed Multi-modal Similarity Retrieval

Distributed Multi-modal Similarity Retrieval Distributed Multi-modal Similarity Retrieval David Novak Seminar of DISA Lab, October 14, 2014 David Novak Multi-modal Similarity Retrieval DISA Seminar 1 / 17 Outline of the Talk 1 Motivation Similarity

More information

GlobeTP: Template-Based Database Replication for Scalable. Web Applications

GlobeTP: Template-Based Database Replication for Scalable. Web Applications GlobeTP: Template-Based Database Replication for Scalable Page 1 of 18 Web Applications Tobias Groothuyse, Swaminathan Sivasubramanian, and Guillaume Pierre. In procedings of WWW 2007, May 8-12, 2007,

More information

A Hybrid Peer-to-Peer Recommendation System Architecture Based on Locality-Sensitive Hashing

A Hybrid Peer-to-Peer Recommendation System Architecture Based on Locality-Sensitive Hashing A Hybrid Peer-to-Peer Recommendation System Architecture Based on Locality-Sensitive Hashing Alexander Smirnov, Andrew Ponomarev St. Petersburg Institute for Informatics and Automation of the Russian Academy

More information

Chapter 2 CommVault Data Management Concepts

Chapter 2 CommVault Data Management Concepts Chapter 2 CommVault Data Management Concepts 10 - CommVault Data Management Concepts The Simpana product suite offers a wide range of features and options to provide great flexibility in configuring and

More information

Data Streams. Building a Data Stream Management System. DBMS versus DSMS. The (Simplified) Big Picture. (Simplified) Network Monitoring

Data Streams. Building a Data Stream Management System. DBMS versus DSMS. The (Simplified) Big Picture. (Simplified) Network Monitoring Building a Data Stream Management System Prof. Jennifer Widom Joint project with Prof. Rajeev Motwani and a team of graduate students http://www-db.stanford.edu/stream stanfordstreamdatamanager Data Streams

More information

Overview of Storage & Indexing (i)

Overview of Storage & Indexing (i) ICS 321 Spring 2013 Overview of Storage & Indexing (i) Asst. Prof. Lipyeow Lim Information & Computer Science Department University of Hawaii at Manoa 4/3/2013 Lipyeow Lim -- University of Hawaii at Manoa

More information

Homework 2: E/R Models and More SQL (due February 17 th, 2016, 4:00pm, in class hard-copy please)

Homework 2: E/R Models and More SQL (due February 17 th, 2016, 4:00pm, in class hard-copy please) Virginia Tech. Computer Science CS 4604 Introduction to DBMS Spring 2016, Prakash Homework 2: E/R Models and More SQL (due February 17 th, 2016, 4:00pm, in class hard-copy please) Reminders: a. Out of

More information

DISTRIBUTED COMPUTER SYSTEMS ARCHITECTURES

DISTRIBUTED COMPUTER SYSTEMS ARCHITECTURES DISTRIBUTED COMPUTER SYSTEMS ARCHITECTURES Dr. Jack Lange Computer Science Department University of Pittsburgh Fall 2015 Outline System Architectural Design Issues Centralized Architectures Application

More information

A Decentralized Content-based Aggregation Service for Pervasive Environments

A Decentralized Content-based Aggregation Service for Pervasive Environments A Decentralized Content-based Aggregation Service for Pervasive Environments Nanyan Jiang, Cristina Schmidt, Manish Parashar The Applied Software Systems Laboratory Rutgers, The State University of New

More information