CISC 7610 Lecture 4 Approaches to multimedia databases
|
|
- Shannon Lane
- 5 years ago
- Views:
Transcription
1 CISC 7610 Lecture 4 Approaches to multimedia databases Topics: Metadata Loose vs tight coupling of data and metadata Object (oriented) databases Graph databases Object-relational mapping
2 Homework 1 Entity-relationship diagram RecordingDate GPS Lat Tape GPS Lon Program Description CameraPerson 1 N Description Contains Contains N Name StartTime N StartTime EndTime StartTime EndTime N EndTime Description Shot FirstAired Contains N Story Title Reporter
3 Metadata is data about data Information on creation, content, and interaction Holistic or time-related Multimedia file types typically include facilities for embedding metadata
4 Camera files have EXIF metadata Exchangeable image file format (EXIF) Recorded by digital cameras, phones, scanners Somewhat easy to break when editing file For video and still images For a video:
5 A still image from the same camera
6 MP3s have ID3 metadata Mainly targeted at professional releases Info: Title, artist, album, track number Album art, lyrics De facto, not recognized by any standardization bodies
7 MP3s have ID3 metadata Mainly targeted at professional releases Info: Title, artist, album, track number Album art, lyrics De facto, not recognized by any standardization bodies
8 Holistic (Object-level) metadata Automatic metadata from creation: EXIF Metadata about the content Frame rate, resolution, quality, codecs, equipment Topics, tags, participants Mostly human-generated Will discuss machine-generated later in course Usage and interaction metadata Comments, thumbs ups, skips, shares
9 Time-related metadata Automatic metadata from creation (theoretically) Metadata about the content Location, view direction, camera/lens parameters, scene changes Closed captions, events/actions, scene descriptions Usage and interaction metadata Comments, thumbs ups, skips, shares
10 Time-related metadata
11 What type of metadata are these? RecordingDate GPS Lat Tape GPS Lon Program Description CameraPerson 1 N Description Contains Contains N Name StartTime N StartTime EndTime StartTime EndTime N EndTime Description Shot FirstAired Contains N Story Title Reporter
12 But where does the actual video go? RecordingDate GPS Lat Tape GPS Lon Program Description CameraPerson 1 N Description Contains Contains N Name StartTime N StartTime EndTime StartTime EndTime N EndTime Description Shot FirstAired Contains N Story Title Reporter
13 Simplest solution: on the filesystem Simple key-value store (filename data) Stores some metadata (size, create/modify dates) Fast access, can be distributed But: hard to query, hard to add metadata
14 Metadata is easy to store in a relational database But media data is hard to store in one No notion of constituent parts Can store it in BLOBs (Binary Large Objects) but can't do much with them Streams, tracks, frames Difficult to extend functionality to include mediaspecific operations The point of RDBMS is run-time querying But BLOBs are not useful in this context
15 RDBMS strengths and weaknesses Strengths Extremely flexible queries Database can have arbitrary schema Some overhead for accesses (esp with locking) Can distribute reads across multiple servers Weaknesses Difficult to build hierarchical models Fixed schema Can't perform media-specific operations Difficult to support distributed writes
16 Loose vs tight coupling of DB and multimedia storage Loose coupling Tight coupling
17 Loose vs tight coupling of DB and multimedia storage Loose coupling Tight coupling DBMS for metadata, filesystem for media Simpler to implement, maintain, optimize, improve Difficult to maintain integrity and consistency DMBS for metadata and media Maintains integrity and consistency between metadata and media We will strive for tightly coupled systems
18 Tight coupling attempt 1: Object (oriented) databases Application using the database The database, conversely Is procedural Deals with one item of data at a time Creates complex data structures Is declarative Deals with tuples in sets instead of individually Holds data in flat tables Combining them exposes an impedance mismatch Can we create a database that stores data in a way more similar to the application?
19 Object databases Persistent store for objects Preserves object type and structure (nesting) Preserves references between objects Easy to combine data and metadata Little querying, mainly reference-following Lookups performed in code, not in query language Example: VelocityDB for C#
20 Object databases strengths and weaknesses Stengths Stores objects directly Easy to extend datatypes Arbitrary and modify-able schema Stores metadata and data together Can define media-specific operations Weaknesses Hard to distribute load across machines Hard to query Mixes code and schema Difficult to administer
21 Tight coupling attempt 2: Graph databases One speed advantage of object databases over RDBMS, comes from reference following Why compute joins that you know the answer to? Precompute joins and store as a graph of relationships: a graph database Examples: Facebook TAO, Neo4j
22 Facebook's social graph Everyone's facebook feed is extremely customized Facebook data is a densely connected graph Can't cache pages, hard to cache anything Hard to partition into disconnected shards Were writing Memcache and MySQL code directly But in 2009 started building a graph database abstraction on top of them Described in post here and USENIX 2013 paper (Bronson et al, 2013)
23 The Associations and Objects (TAO)
24 TAO operations Insert objects and associations Point queries: find specific (id1, type, id2) triples (associations) Usually to check if two objects are connected or to fetch association data Range queries: find outgoing (id1, type) associations Include time stamps for temporal locality Order associations by time to find most recent comments, friends liking something, etc Count queries: find total number of outgoing (id1, type) associations Can keep track of this as associations are created and deleted too
25 Neo4j Example: Relational model
26 Neo4j Example: Graph model
27 Neo4j Example: Converting relational to graph-based Each row in a entity table is a node Each entity table becomes a label on nodes Columns on those tables become node properties Foreign keys become relationships to the corresponding nodes in the other table Join tables become relationships, columns on those tables become relationship properties
28 Neo4j Example: Relational vs graph schema Relational Graph-based
29 Graph database Strengths and weaknesses Strengths Joins are precomputed Easy to modify schema Fast Scalable Weaknesses Harder to execute queries not embodied in relationships
30 Between object and relational: Object-relational mapping (ORM) Layer between RDBMS and OO program Translates certain OO calls into queries Translates results tuples into objects Almost all languages have an ORM
31 Object-relational mapping Objects to be represented
32 Object-relational mapping Object database approach
33 Object-relational mapping Object-relational approach
34 ORM in pseudo-code for homework1 The name and description of every shot used in Program 1, in the order in which they appear p1 = Program.find('id': 1) shots = p1.shots('order by': 'starttime') for shot in shots: print shot.name, shot.description How many queries does this result in?
35 ORM in pseudo-code for homework1 The latitude and longitude at which every shot used in Story 3 was filmed, in the order in which they appear s3 = Story.find('id': 3) shots = s3.shots for shot in sorted(shots, key='starttime'): print shot.gpslat, shot.gpslon
36 ORM in pseudo-code for homework1 The tape number and start and end time on the tape of every shot used in Program 2, in the order in which they appear p2 = Program.find('id': 2) shots = p2.shots for shot in sorted(shots, key='starttime'): tape = shot.tape print tape.number, tape.starttime, tape.endtime
37 ORM in pseudo-code for homework1 The dates when programs containing Shot 1 first aired s1 = Shots.find('id': 1) for program in s1.programs: print program.dateaired
38 ORM Strengths and weaknesses Strengths Easier to extend with new operations than RDBMS Can be distributed across many computers (for reads) Arbitrary schema Weaknesses May require many queries Still can't store large files/objects Fixed schema
39 Summary Awkward to fit multimedia data directly into relational databases Object-relational impedance mismatch makes it difficult to use RDBMS in programs anyway Object-relational mappings provide an imperfect bridge between the two Object databases remove the impedance mismatch But make it awkward to query Graph databases extract associations from objects Or pre-compute joins in a relational model
CISC 7610 Lecture 4 Approaches to multimedia databases. Topics: Document databases Graph databases Metadata Column databases
CISC 7610 Lecture 4 Approaches to multimedia databases Topics: Document databases Graph databases Metadata Column databases NoSQL architectures: different tradeoffs for different workloads Already seen:
More informationCISC 7610 Lecture 4 Approaches to multimedia databases. Topics: Graph databases Neo4j syntax and examples Document databases
CISC 7610 Lecture 4 Approaches to multimedia databases Topics: Graph databases Neo4j syntax and examples Document databases NoSQL architectures: different tradeoffs for different workloads Already seen:
More informationSystems Analysis and Design in a Changing World, Fourth Edition. Chapter 12: Designing Databases
Systems Analysis and Design in a Changing World, Fourth Edition Chapter : Designing Databases Learning Objectives Describe the differences and similarities between relational and object-oriented database
More informationTopics. History. Architecture. MongoDB, Mongoose - RDBMS - SQL. - NoSQL
Databases Topics History - RDBMS - SQL Architecture - SQL - NoSQL MongoDB, Mongoose Persistent Data Storage What features do we want in a persistent data storage system? We have been using text files to
More informationDatabase Architectures
Database Architectures CPS352: Database Systems Simon Miner Gordon College Last Revised: 4/15/15 Agenda Check-in Parallelism and Distributed Databases Technology Research Project Introduction to NoSQL
More informationCISC 7610 Lecture 2b The beginnings of NoSQL
CISC 7610 Lecture 2b The beginnings of NoSQL Topics: Big Data Google s infrastructure Hadoop: open google infrastructure Scaling through sharding CAP theorem Amazon s Dynamo 5 V s of big data Everyone
More informationINFO 1103 Homework Project 2
INFO 1103 Homework Project 2 February 15, 2019 Due March 13, 2019, at the end of the lecture period. 1 Introduction In this project, you will design and create the appropriate tables for a version of the
More informationLecture 8. Database Management and Queries
Lecture 8 Database Management and Queries Lecture 8: Outline I. Database Components II. Database Structures A. Conceptual, Logical, and Physical Components III. Non-Relational Databases A. Flat File B.
More informationNoSQL systems: introduction and data models. Riccardo Torlone Università Roma Tre
NoSQL systems: introduction and data models Riccardo Torlone Università Roma Tre Leveraging the NoSQL boom 2 Why NoSQL? In the last fourty years relational databases have been the default choice for serious
More informationB.H.GARDI COLLEGE OF MASTER OF COMPUTER APPLICATION. Ch. 1 :- Introduction Database Management System - 1
Basic Concepts :- 1. What is Data? Data is a collection of facts from which conclusion may be drawn. In computer science, data is anything in a form suitable for use with a computer. Data is often distinguished
More informationCSE 344 JULY 9 TH NOSQL
CSE 344 JULY 9 TH NOSQL ADMINISTRATIVE MINUTIAE HW3 due Wednesday tests released actual_time should have 0s not NULLs upload new data file or use UPDATE to change 0 ~> NULL Extra OOs on Mondays 5-7pm in
More informationDatabase Management Systems
DATABASE CONCEPTS & APPLICATIONS Database Management Systems A Database Management System (DBMS) is a software package designed to store and manage databases through database applications. User Database
More informationUsing Relational Databases for Digital Research
Using Relational Databases for Digital Research Definition (using a) relational database is a way of recording information in a structure that maximizes efficiency by separating information into different
More information5/2/16. Announcements. NoSQL Motivation. The New Hipster: NoSQL. Serverless. What is the Problem? Database Systems CSE 414
Announcements Database Systems CSE 414 Lecture 16: NoSQL and JSon Current assignments: Homework 4 due tonight Web Quiz 6 due next Wednesday [There is no Web Quiz 5 Today s lecture: JSon The book covers
More informationHands-on immersion on Big Data tools
Hands-on immersion on Big Data tools NoSQL Databases Donato Summa THE CONTRACTOR IS ACTING UNDER A FRAMEWORK CONTRACT CONCLUDED WITH THE COMMISSION Summary : Definition Main features NoSQL DBs classification
More informationDatabase Systems CSE 414
Database Systems CSE 414 Lecture 16: NoSQL and JSon CSE 414 - Spring 2016 1 Announcements Current assignments: Homework 4 due tonight Web Quiz 6 due next Wednesday [There is no Web Quiz 5] Today s lecture:
More informationPractical object-oriented models in SQL. Bill Karwin July 22, OSCON
Practical object-oriented models in SQL Bill Karwin July 22, 2009 - OSCON Object-Oriented vs. Relational Impedance mismatch OO operates on instances; RDBMS operates on sets Compromise either OO strengths
More informationFundamentals of Physical Design: State of Art
Fundamentals of Physical Design: State of Art David Toman D. R. Cheriton School of Computer Science D. Toman (Waterloo) Physical Design: State of Art 1 / 13 Benefits of Database Technology 1 High-level/declarative
More informationCOMP9321 Web Application Engineering
COMP9321 Web Application Engineering Semester 2, 2015 Dr. Amin Beheshti Service Oriented Computing Group, CSE, UNSW Australia Week 6 http://webapps.cse.unsw.edu.au/webcms2/course/index.php?cid=2411 1 We
More informationCOMP9321 Web Application Engineering
COMP9321 Web Application Engineering Data Access in Web Applications Dr. Basem Suleiman Service Oriented Computing Group, CSE, UNSW Australia Semester 1, 2016, Week 5 http://webapps.cse.unsw.edu.au/webcms2/course/index.php?cid=2442
More informationMySQL Database Administrator Training NIIT, Gurgaon India 31 August-10 September 2015
MySQL Database Administrator Training Day 1: AGENDA Introduction to MySQL MySQL Overview MySQL Database Server Editions MySQL Products MySQL Services and Support MySQL Resources Example Databases MySQL
More informationPHP Object-Relational Mapping Libraries in action
PHP Object-Relational Mapping Libraries in action Apr 14, 2010 O'Reilly MySQL Conference and Expo Santa Clara, CA Fernando Ipar & Ryan Lowe Percona Inc. -2- Agenda What are ORM libraries Object Oriented
More informationBeyond Relational Databases: MongoDB, Redis & ClickHouse. Marcos Albe - Principal Support Percona
Beyond Relational Databases: MongoDB, Redis & ClickHouse Marcos Albe - Principal Support Engineer @ Percona Introduction MySQL everyone? Introduction Redis? OLAP -vs- OLTP Image credits: 451 Research (https://451research.com/state-of-the-database-landscape)
More informationINFO-H415 Adanvanced Databases Documents store and cloudant
INFO-H413 Heuristic Optimization Implemenation Exercise 1 Dany S Efila ULB 000349507 Universite Libre de Bruxelles Avril 2017 INFO-H415 Adanvanced Databases Documents store and cloudant Dany S EFILA Michel
More informationORDBMS - Introduction
ORDBMS - Introduction 1 Theme The need for extensions in Relational Data Model Classification of database systems Introduce extensions to the basic relational model Applications that would benefit from
More informationDatabases : Lecture 1 2: Beyond ACID/Relational databases Timothy G. Griffin Lent Term Apologies to Martin Fowler ( NoSQL Distilled )
Databases : Lecture 1 2: Beyond ACID/Relational databases Timothy G. Griffin Lent Term 2016 Rise of Web and cluster-based computing NoSQL Movement Relationships vs. Aggregates Key-value store XML or JSON
More informationWhat is database? Types and Examples
What is database? Types and Examples Visit our site for more information: www.examplanning.com Facebook Page: https://www.facebook.com/examplanning10/ Twitter: https://twitter.com/examplanning10 TABLE
More informationCIB Session 12th NoSQL Databases Structures
CIB Session 12th NoSQL Databases Structures By: Shahab Safaee & Morteza Zahedi Software Engineering PhD Email: safaee.shx@gmail.com, morteza.zahedi.a@gmail.com cibtrc.ir cibtrc cibtrc 2 Agenda What is
More information3. Object-Oriented Databases
3. Object-Oriented Databases Weaknesses of Relational DBMSs Poor representation of 'real world' entities Poor support for integrity and business rules Homogenous data structure Limited operations Difficulty
More informationPart I What are Databases?
Part I 1 Overview & Motivation 2 Architectures 3 Areas of Application 4 History Saake Database Concepts Last Edited: April 2019 1 1 Educational Objective for Today... Motivation for using database systems
More informationSEARCHING FOR FRIENDS
Step One In the top right hand corner, click on the Find Friends link. You will be redirected to a new page. In the bottom left hand side of the page you will see a text box labeled Search for People.
More informationIntroduction to System Design
Introduction to System Design Software Requirements and Design CITS 4401 Lecture 8 System Design is a creative process no cook book solutions goal driven we create a design for solving some problem constraint
More informationMongoDB Schema Design for. David Murphy MongoDB Practice Manager - Percona
MongoDB Schema Design for the Click "Dynamic to edit Master Schema" title World style David Murphy MongoDB Practice Manager - Percona Who is this Person and What Does He Know? Former MongoDB Master Former
More informationHeckaton. SQL Server's Memory Optimized OLTP Engine
Heckaton SQL Server's Memory Optimized OLTP Engine Agenda Introduction to Hekaton Design Consideration High Level Architecture Storage and Indexing Query Processing Transaction Management Transaction Durability
More informationTitle. Prolog, Rules, Reasoning and SPARQLing Magic in the real world. Franz Inc
Prolog, Rules, Reasoning and SPARQLing Magic in the real world 1 Contents How do we fit it all together: rules and prolog and reasoning and magic predicates and SPARQL Use case: BigBank Event view of the
More informationCISC 7610 Lecture 5 Distributed multimedia databases. Topics: Scaling up vs out Replication Partitioning CAP Theorem NoSQL NewSQL
CISC 7610 Lecture 5 Distributed multimedia databases Topics: Scaling up vs out Replication Partitioning CAP Theorem NoSQL NewSQL Motivation YouTube receives 400 hours of video per minute That is 200M hours
More informationProject # 1: Database Programming
Project # 1: Database Programming CSE462 Database Concepts Demian Lessa Department of Computer Science and Engineering State University of New York, Buffalo February 21, 2011 Outline 1 Database Programming
More informationNOSQL Databases and Neo4j
NOSQL Databases and Neo4j Database and DBMS Database - Organized collection of data The term database is correctly applied to the data and their supporting data structures. DBMS - Database Management System:
More informationScott Meder Senior Regional Sales Manager
www.raima.com Scott Meder Senior Regional Sales Manager scott.meder@raima.com Short Introduction to Raima What is Data Management What are your requirements? How do I make the right decision? - Architecture
More informationObject-Relational Modeling
Object-Relational Modeling Holger Pirk Holger Pirk Object-Relational Modeling 1 / 44 Purpose of this Lecture Introduce Object-Relational-Mapping Understand the problem it solves Understand the problems
More information4. CONTAINER DATABASE OBJECT ORIENTED DESIGN
32 4. CONTAINER DATABASE OBJECT ORIENTED DESIGN We propose an Object-oriented design for the Container Database. The abstraction itself is not necessarily dependent on OO technologies nor do we claim it
More informationNoSQL systems. Lecture 21 (optional) Instructor: Sudeepa Roy. CompSci 516 Data Intensive Computing Systems
CompSci 516 Data Intensive Computing Systems Lecture 21 (optional) NoSQL systems Instructor: Sudeepa Roy Duke CS, Spring 2016 CompSci 516: Data Intensive Computing Systems 1 Key- Value Stores Duke CS,
More informationXML/Relational mapping Introduction of the Main Challenges
HELSINKI UNIVERSITY OF TECHNOLOGY November 30, 2004 Telecommunications Software and Multimedia Laboratory T-111.590 Research Seminar on Digital Media (2-5 cr.): Autumn 2004: Web Service Technologies XML/Relational
More informationCS317 File and Database Systems
CS317 File and Database Systems http://dilbert.com/strips/comic/1995-10-11/ Lecture 5 More SQL and Intro to Stored Procedures September 24, 2017 Sam Siewert SQL Theory and Standards Completion of SQL in
More informationMysql Performance Schema Has The Wrong Structure
Mysql Performance Schema Has The Wrong Structure events_waits_summary_by_instance' has the wrong structure 141006 As for the performance schema problems they sound as though they are quite broken. events_waits_history_long'
More informationCS 200. Lecture 06. Database Introduction. Database Introduction. CS 200 Winter 2018
CS 200 Lecture 06 1 Miscellaneous Notes Abbreviations aka also known as DBMS DataBase Management System mutatis mutantis with the necessary changes having been made 2 Please read and highlight BEFORE lab
More informationChapter 18: Parallel Databases
Chapter 18: Parallel Databases Introduction Parallel machines are becoming quite common and affordable Prices of microprocessors, memory and disks have dropped sharply Recent desktop computers feature
More informationMotivation and basic concepts Storage Principle Query Principle Index Principle Implementation and Results Conclusion
JSON Schema-less into RDBMS Most of the material was taken from the Internet and the paper JSON data management: sup- porting schema-less development in RDBMS, Liu, Z.H., B. Hammerschmidt, and D. McMahon,
More informationStreaming Data Integration: Challenges and Opportunities. Nesime Tatbul
Streaming Data Integration: Challenges and Opportunities Nesime Tatbul Talk Outline Integrated data stream processing An example project: MaxStream Architecture Query model Conclusions ICDE NTII Workshop,
More informationBuilding loosely coupled and scalable systems using Event-Driven Architecture. Jonas Bonér Patrik Nordwall Andreas Källberg
Building loosely coupled and scalable systems using Event-Driven Architecture Jonas Bonér Patrik Nordwall Andreas Källberg Why is EDA Important for Scalability? What building blocks does EDA consists of?
More informationOverview. * Some History. * What is NoSQL? * Why NoSQL? * RDBMS vs NoSQL. * NoSQL Taxonomy. *TowardsNewSQL
* Some History * What is NoSQL? * Why NoSQL? * RDBMS vs NoSQL * NoSQL Taxonomy * Towards NewSQL Overview * Some History * What is NoSQL? * Why NoSQL? * RDBMS vs NoSQL * NoSQL Taxonomy *TowardsNewSQL NoSQL
More informationDatabase Application Architectures
Chapter 15 Database Application Architectures Database Systems(Part 2) p. 221/287 Database Applications Most users do not interact directly with a database system The DBMS is hidden behind application
More informationLecture2: Database Environment
College of Computer and Information Sciences - Information Systems Dept. Lecture2: Database Environment 1 IS220 : D a t a b a s e F u n d a m e n t a l s Topics Covered Data abstraction Schemas and Instances
More informationDatabase Paradigms for Recordings Management
MASTER S THESIS LUND UNIVERSITY 15 Database Paradigms for Recordings Management Eric Ottosson, Suraj Alok Sinha Department of Computer Science Faculty of Engineering LTH ISSN 1650-2884 LU-CS-EX 15-21 Database
More informationData! CS 133: Databases. Goals for Today. So, what is a database? What is a database anyway? From the textbook:
CS 133: Databases Fall 2018 Lec 01 09/04 Introduction & Relational Model Data! Need systems to Data is everywhere Banking, airline reservations manage the data Social media, clicking anything on the internet
More information745: Advanced Database Systems
745: Advanced Database Systems Yanlei Diao University of Massachusetts Amherst Outline Overview of course topics Course requirements Database Management Systems 1. Online Analytical Processing (OLAP) vs.
More informationbig picture parallel db (one data center) mix of OLTP and batch analysis lots of data, high r/w rates, 1000s of cheap boxes thus many failures
Lecture 20 -- 11/20/2017 BigTable big picture parallel db (one data center) mix of OLTP and batch analysis lots of data, high r/w rates, 1000s of cheap boxes thus many failures what does paper say Google
More informationCommon MySQL Scalability Mistakes AUTHOR
Common MySQL Scalability Mistakes Ronald Bradford http://ronaldbradford.com 2011.04 EffectiveMySQL.com - Its all about Performance and Scalability EffectiveMySQL.com - Its all about Performance and Scalability
More informationCourse Design Document: IS202 Data Management. Version 4.5
Course Design Document: IS202 Data Management Version 4.5 Friday, October 1, 2010 Table of Content 1. Versions History... 4 2. Overview of the Data Management... 5 3. Output and Assessment Summary... 6
More information10/18/2017. Announcements. NoSQL Motivation. NoSQL. Serverless Architecture. What is the Problem? Database Systems CSE 414
Announcements Database Systems CSE 414 Lecture 11: NoSQL & JSON (mostly not in textbook only Ch 11.1) HW5 will be posted on Friday and due on Nov. 14, 11pm [No Web Quiz 5] Today s lecture: NoSQL & JSON
More informationNoSQL Databases. CPS352: Database Systems. Simon Miner Gordon College Last Revised: 4/22/15
NoSQL Databases CPS352: Database Systems Simon Miner Gordon College Last Revised: 4/22/15 Agenda Check-in NoSQL Databases Aggregate databases Key-value, document, and column family Graph databases Related
More informationIntroduction. Example Databases
Introduction Example databases Overview of concepts Why use database systems Example Databases University Data: departments, students, exams, rooms,... Usage: creating exam plans, enter exam results, create
More informationLarge-Scale Web Applications
Large-Scale Web Applications Mendel Rosenblum Web Application Architecture Web Browser Web Server / Application server Storage System HTTP Internet CS142 Lecture Notes - Intro LAN 2 Large-Scale: Scale-Out
More informationAdministrivia Carnegie Mellon Univ. Dept. of Computer Science /615 - DB Applications
Administrivia Carnegie Mellon Univ. Dept. of Computer Science 15-415/615 - DB Applications C. Faloutsos A. Pavlo Lecture#18: Physical Database Design HW6 is due right now. HW7 is out today Phase 1: Wed
More informationDEMYSTIFYING BIG DATA WITH RIAK USE CASES. Martin Schneider Basho Technologies!
DEMYSTIFYING BIG DATA WITH RIAK USE CASES Martin Schneider Basho Technologies! Agenda Defining Big Data in Regards to Riak A Series of Trade-Offs Use Cases Q & A About Basho & Riak Basho Technologies is
More informationAnnouncements. Two Classes of Database Applications. Class Overview. NoSQL Motivation. RDBMS Review: Serverless
Introduction to Database Systems CSE 414 Lecture 11: NoSQL 1 HW 3 due Friday Announcements Upload data with DataGrip editor see message board Azure timeout for question 5: Try DataGrip or SQLite HW 2 Grades
More informationA Survey Paper on NoSQL Databases: Key-Value Data Stores and Document Stores
A Survey Paper on NoSQL Databases: Key-Value Data Stores and Document Stores Nikhil Dasharath Karande 1 Department of CSE, Sanjay Ghodawat Institutes, Atigre nikhilkarande18@gmail.com Abstract- This paper
More informationAdministrivia Carnegie Mellon Univ. Dept. of Computer Science /615 - DB Applications
Administrivia Carnegie Mellon Univ. Dept. of Computer Science 15-415/615 - DB Applications HW6 is due right now. HW7 is out today Phase 1: Wed Nov 9 th Phase 2: Mon Nov 28 th C. Faloutsos A. Pavlo Lecture#18:
More informationDEC Computer Technology LESSON 6: DATABASES AND WEB SEARCH ENGINES
DEC. 1-5 Computer Technology LESSON 6: DATABASES AND WEB SEARCH ENGINES Monday Overview of Databases A web search engine is a large database containing information about Web pages that have been registered
More informationDatabases : Lectures 11 and 12: Beyond ACID/Relational databases Timothy G. Griffin Lent Term 2013
Databases : Lectures 11 and 12: Beyond ACID/Relational databases Timothy G. Griffin Lent Term 2013 Rise of Web and cluster-based computing NoSQL Movement Relationships vs. Aggregates Key-value store XML
More informationAN ALGORITHM FOR MAPPING THE RELATIONAL DATABASES TO MONGODB A CASE STUDY
International Journal of Computer Science and Applications, Technomathematics Research Foundation Vol. 14, No. 1, pp. 65 79, 2017 AN ALGORITHM FOR MAPPING THE RELATIONAL DATABASES TO MONGODB A CASE STUDY
More informationClass Overview. Two Classes of Database Applications. NoSQL Motivation. RDBMS Review: Client-Server. RDBMS Review: Serverless
Introduction to Database Systems CSE 414 Lecture 12: NoSQL 1 Class Overview Unit 1: Intro Unit 2: Relational Data Models and Query Languages Unit 3: Non-relational data NoSQL Json SQL++ Unit 4: RDMBS internals
More informationQuery Processing with Indexes. Announcements (February 24) Review. CPS 216 Advanced Database Systems
Query Processing with Indexes CPS 216 Advanced Database Systems Announcements (February 24) 2 More reading assignment for next week Buffer management (due next Wednesday) Homework #2 due next Thursday
More informationIntroduction to Databases
Introduction to Databases Matthew J. Graham CACR Methods of Computational Science Caltech, 2009 January 27 - Acknowledgements to Julian Bunn and Ed Upchurch what is a database? A structured collection
More informationUse the below enhanced Entity Relationship diagram for relevant questions on this quiz
Use the below enhanced Entity Relationship diagram for relevant questions on this quiz Phone Donation OrganizationID Sponsor M Supports N SName ----------- Stage FID Festival Location N M d Performs On
More informationWhat s a database system? Review of Basic Database Concepts. Entity-relationship (E/R) diagram. Two important questions. Physical data independence
What s a database system? Review of Basic Database Concepts CPS 296.1 Topics in Database Systems According to Oxford Dictionary Database: an organized body of related information Database system, DataBase
More informationTopic 5: Mapping of EER Diagrams to Relations
Topic 5: Mapping of EER Diagrams to Relations Olaf Hartig olaf.hartig@liu.se Recall: DB Design Process 2 Running Example 3 Algorithm for Mapping from the ER Model to the Relational Model Step 1: Map Regular
More information5/1/17. Announcements. NoSQL Motivation. NoSQL. Serverless Architecture. What is the Problem? Database Systems CSE 414
Announcements Database Systems CSE 414 Lecture 15: NoSQL & JSON (mostly not in textbook only Ch 11.1) 1 Homework 4 due tomorrow night [No Web Quiz 5] Midterm grading hopefully finished tonight post online
More informationJargons, Concepts, Scope and Systems. Key Value Stores, Document Stores, Extensible Record Stores. Overview of different scalable relational systems
Jargons, Concepts, Scope and Systems Key Value Stores, Document Stores, Extensible Record Stores Overview of different scalable relational systems Examples of different Data stores Predictions, Comparisons
More informationDatabase Design. A Bottom-Up Approach
Database Design A Bottom-Up Approach Reality Check Why do you need a database? What is the primary use of your database? Fast data entry Fast queries Summary data Who is responsible for the content? Who
More informationCS5412: DIVING IN: INSIDE THE DATA CENTER
1 CS5412: DIVING IN: INSIDE THE DATA CENTER Lecture V Ken Birman We ve seen one cloud service 2 Inside a cloud, Dynamo is an example of a service used to make sure that cloud-hosted applications can scale
More informationMIS Database Systems.
MIS 335 - Database Systems http://www.mis.boun.edu.tr/durahim/ Ahmet Onur Durahim Learning Objectives Database systems concepts Designing and implementing a database application Life of a Query in a Database
More informationCSE 132A. Database Systems Principles
CSE 132A Database Systems Principles Prof. Victor Vianu 1 Data Management An evolving, expanding field: Classical stand-alone databases (Oracle, DB2, SQL Server) Computer science is becoming data-centric:
More informationBIS Database Management Systems.
BIS 512 - Database Management Systems http://www.mis.boun.edu.tr/durahim/ Ahmet Onur Durahim Learning Objectives Database systems concepts Designing and implementing a database application Life of a Query
More informationChapter 18: Parallel Databases Chapter 19: Distributed Databases ETC.
Chapter 18: Parallel Databases Chapter 19: Distributed Databases ETC. Introduction Parallel machines are becoming quite common and affordable Prices of microprocessors, memory and disks have dropped sharply
More informationOPEN SOURCE DB SYSTEMS TYPES OF DBMS
OPEN SOURCE DB SYSTEMS Anna Topol 1 TYPES OF DBMS Relational Key-Value Document-oriented Graph 2 DBMS SELECTION Multi-platform or platform-agnostic Offers persistent storage Fairly well known Actively
More informationCMPT 354 Database Systems I
CMPT 354 Database Systems I Chapter 8 Database Application Programming Introduction Executing SQL queries: Interactive SQL interface uncommon. Application written in a host language with SQL abstraction
More informationOracle Compare Two Database Tables Sql Query List All
Oracle Compare Two Database Tables Sql Query List All We won't show you that ad again. I need to implement comparing 2 tables by set of keys (columns of compared tables). This pl/sql stored procedure works
More informationIntroduction p. 1 What is the World Wide Web? p. 1 A Brief History of the Web and the Internet p. 2 Web Data Mining p. 4 What is Data Mining? p.
Introduction p. 1 What is the World Wide Web? p. 1 A Brief History of the Web and the Internet p. 2 Web Data Mining p. 4 What is Data Mining? p. 6 What is Web Mining? p. 6 Summary of Chapters p. 8 How
More informationData, Databases, and DBMSs
Todd S. Bacastow January 2004 IST 210 Data, Databases, and DBMSs 1 Evolution Ways of storing data Files ancient times (1960) Databases Hierarchical (1970) Network (1970) Relational (1980) Object (1990)
More informationHow to set up and manage a Facebook page for your RSLWA sub-branch
How to set up and manage a Facebook page for your RSLWA sub-branch INTRODUCTION To stay relevant and attract new members, having a Facebook page for your sub-branch is going to be increasingly important.
More informationRelational databases
COSC 6397 Big Data Analytics NoSQL databases Edgar Gabriel Spring 2017 Relational databases Long lasting industry standard to store data persistently Key points concurrency control, transactions, standard
More informationMySQL for Beginners Ed 3
MySQL for Beginners Ed 3 Duration: 4 Days What you will learn The MySQL for Beginners course helps you learn about the world's most popular open source database. Expert Oracle University instructors will
More informationITS. MySQL for Database Administrators (40 Hours) (Exam code 1z0-883) (OCP My SQL DBA)
MySQL for Database Administrators (40 Hours) (Exam code 1z0-883) (OCP My SQL DBA) Prerequisites Have some experience with relational databases and SQL What will you learn? The MySQL for Database Administrators
More informationUtilizing Databases in Grid Engine 6.0
Utilizing Databases in Grid Engine 6.0 Joachim Gabler Software Engineer Sun Microsystems http://sun.com/grid Current status flat file spooling binary format for jobs ASCII format for other objects accounting
More information1
1 2 3 6 7 8 9 10 Storage & IO Benchmarking Primer Running sysbench and preparing data Use the prepare option to generate the data. Experiments Run sysbench with different storage systems and instance
More informationOracle Compare Two Database Tables Sql Query Join
Oracle Compare Two Database Tables Sql Query Join data types. Namely, it assumes that the two tables payments and How to use SQL PIVOT to Compare Two Tables in Your Database. This can (not that using the
More informationThe Object-Oriented Paradigm. Employee Application Object. The Reality of DBMS. Employee Database Table. From Database to Application.
The Object-Oriented Paradigm CS422 Principles of Database Systems Object-Relational Mapping (ORM) Chengyu Sun California State University, Los Angeles The world consists of objects So we use object-oriented
More informationWeek. Lecture Topic day (including assignment/test) 1 st 1 st Introduction to Module 1 st. Practical
Name of faculty: Gaurav Gambhir Discipline: Computer Science Semester: 6 th Subject: CSE 304 N - Essentials of Information Technology Lesson Plan Duration: 15 Weeks (from January, 2018 to April, 2018)
More informationApp Engine: Datastore Introduction
App Engine: Datastore Introduction Part 1 Another very useful course: https://www.udacity.com/course/developing-scalableapps-in-java--ud859 1 Topics cover in this lesson What is Datastore? Datastore and
More information