Storing data in databases
|
|
- Justin Benson
- 5 years ago
- Views:
Transcription
1 Storing data in databases The webinar will begin at 3pm You now have a menu in the top right corner of your screen. The red button with a white arrow allows you to expand and contract the webinar menu, in which you can write questions/comments. We won t have time to answer questions while we are presenting, but will answer them at the end You will be on mute throughout we can t hear you.
2 Storing data in databases Webinar 25 October 2016 Peter Smyth UK Data Service
3 Can you hear us?
4 Can you hear us? If Not: Check your volume, and that your speaker/headset is plugged in. Your invitation also included a phone number, you can call that to listen in. o UK +44 (0) o US +1 (914) We are recording this webinar, so you can always listen to it later.
5 Overview of this webinar Definition of a database Why Excel isn t always good enough Different Database types and availability Relational Databases A bit of history Data organisation Limitations Query examples Document Databases MongoDB Query examples Graph Database demo
6 Definition of Database A structured set of data held in a computer, especially one that is accessible in various ways. (Oxford University Press) Structured = Ordered? Or Arranged? Nothing about the details of the structuring Accessible = Searchable, able to query the contents to see what is there
7 Not a database! - Why not?
8 What about Excel? Worksheets are tabular in nature - very structured You can join sheets together using the VLOOKUP function There is a set of Database type functions (DSUM, DCOUNT etc.) You can write queries to filter the rows
9 Excel Restrictions Sheets have limit of 1 million rows (2 20 ) VLOOKUP can only return a single column The database functions can only return a single value Setting up queries is quite complex
10 Why use a desktop database? Size of data Convenience of a desktop system Flexibility in collecting and persisting data Flexibility in querying and analysis
11 Growing and shrinking data Desktop Application Big Data Environment Sent Tweet Data from Tweet Tweets All tweets from user All tweets from User & Friends All Smart meter data Smart meter by day Smart meter by Month Smart meter data By Month and Geography 1Kb 1Mb 1Gb 10+ Gb
12 Growing and shrinking data Sent Tweet Desktop Application Desktop Database Tweets Big Data Environment Data from Tweet All tweets from user All tweets from User & Friends All Smart meter data Smart meter by day Smart meter by Month By Month and Geography Smart meter data 1Kb 1Gb 5GB 25 Gb 25+ GB
13 Types of Databases There are many different types of Databases For the end user there are probably four main types. Relational Databases (MySQL, MS SQL, SQLite, Postgres ) Document databases MongoDB, CouchDB, ) Graph databases (Neo4j, Titan, ) Wide column stores (Cassandra, Hbase,, )
14 Types of Databases Relational Databases predominate by a long way Data held in tables with defined relationships between the tables Document databases and wide column databases use storage architectures designed to overcome some of the scalability problems of relational databases. Since Big Data sources have become available, these are gaining in popularity Graph Databases are designed to optimise specific type of querying of data where you are more interested in the relationship between different items that the actual attributes of the items, often used with Social networks
15 Types of Databases The link below provides a table of the different Databases systems available and their relative use. Both Commercial and Free databases systems are included.
16 Types of Databases (Table) Freely available options
17 The Relational Model Why do we have it? What is it good for? What are the pros and cons? What do we mean by relational?
18 The Relational Model - History The term "relational database" was first used by E. F. Codd in 1970 in the paper "A Relational Model of Data for Large Shared Data Banks Although not necessarily the primary driver, it should be noted that at the time computer storage was very expensive The Relational model can be very efficient when storing data. Typically data items are stored only once
19 The Relational Model - History Storage prices fell from about $193K per Gb in 1980 to about $0.03 in
20 The Relational Model How it works If I wanted to record the details of a house and the people who lived there, I could create a table like this: HouseHold_All HouseHold_Id Address PostCode Person_id FirstName LastName DOB Sex Age No_of _Rooms No_of_Occupan ts Type Construction I would need a single record for each person at that address
21 The Relational Model How it works And populate it with data, like this HouseHold_Id Address PostCode Person_id FirstName LastName DOB Sex Age No_of _Rooms No_of_Occupa nts Type Construction Some street, Some 1Town AA1 2BB 1Alfie Smith 17/09/1963 M Semi Brick Some street, Some 1Town AA1 2BB 2Jane Smith 05/02/1970 F Semi Brick Some street, Some 1Town AA1 2BB 3John Smith 03/01/2001 M Semi Brick Some street, Some 1Town AA1 2BB 4Jack Smith 10/10/2005 M Semi Brick Some street, Some 1Town AA1 2BB 5 Jenny Smith 07/05/2009 F Semi Brick These records all relate to the same household, but the data about the house itself is repeated for each person in the house
22 The Relational Model How it works It makes more sense to use multiple tables and split the data between them This eliminates the need to duplicate data The arrows represent relationships between the tables. If I only wanted details about the a person, I wouldn t need to refer to the other tables
23 The Relational Model How it works All of the Occupant information is kept in a single table. Details of the Property are only recorded once in the three smaller tables
24 The Relational Model - Advantages Data is only stored once (across multiple tables if necessary) Efficient for well known and structured data Well defined and understood query language (SQL) variants available for all relational databases Schema on Write allows comprehensive data checking before loading making for cleaner data
25 The Relational Model - Disadvantages The need for multiple tables increases loading times Uses vertical scaling Not really relevant for desktop databases Schema on write cannot deal with unstructured data efficiently, if at all
26 Document Databases Why do we have it? What is it good for? What are the pros and cons? What is meant by a document?
27 Document Database A document does not mean a pdf or word document A document is semi-structured data It is structured in that every data item in the document has name associated with it It is semi- in that different documents in the same collection of documents don t have to have the same set of names
28 JSON Example semi-structured data The most popular format for Semi-structured data is JSON. Most data that can be downloaded from a Web based API will be in JSON format (or at least offer JSON as a choice of format)
29 JSON Example semi-structured data The following is a simple example of JSON formatted data { Name : Manchester, PostCode : M13 9PL, Established : 1824 } It is split over several lines just to aid reading. Everything between the { and } represents a single record, or document
30 Document Databases The semi-structured nature means that it is difficult to store the data in tables Not all fields need to be in each document Fields don t need to be in the same order { 'id' : 1234, 'Name' : 'Peter', 'Tel' : } { 'Name' : 'John', 'id' : 3523, ' ' : ['John@abc.com', 'j.smith@xyz.com'],'mob' : } Even more difficult to create a schema for the data in advance Instead, data is stored as-is and a schema is created when the data is read Schema on read
31 Document Databases - NoSQL Non-Relational databases like MongoDB typically do not use SQL to query the data. When you install MongoDB you are provided with a Simple Shell interface from which you can query the database. Use of the Shell to query requires a knowledge of Javascript. As an alternative, both Python and R have packages which interface to MongoDB to allow querying of the database using native Python or R like constructs The unstructured nature of the data, adds to the complexity of querying
32 A Graphics Database Neo4j The default installation of Neo4j provides a simple default Movies database. It also comes with tutorials to help get you started
33 Summary The size of your data may be enough to make you decide on using a desktop database But it may not be the only consideration o How are you collecting the data over time? o What is the structure of the data? o How do you intend to use the data o Can you clean and structure the data as you collect it? o Do you need to keep all of the raw data just in case?
34 Questions Peter Smyth ukdataservice.ac.uk/help/ Subscribe to the UK Data Service news list at Follow us on Twitter or Facebook
35
SQLite vs. MongoDB for Big Data
SQLite vs. MongoDB for Big Data In my latest tutorial I walked readers through a Python script designed to download tweets by a set of Twitter users and insert them into an SQLite database. In this post
More informationWhat is database? Types and Examples
What is database? Types and Examples Visit our site for more information: www.examplanning.com Facebook Page: https://www.facebook.com/examplanning10/ Twitter: https://twitter.com/examplanning10 TABLE
More informationrelational Key-value Graph Object Document
NoSQL Databases Earlier We have spent most of our time with the relational DB model so far. There are other models: Key-value: a hash table Graph: stores graph-like structures efficiently Object: good
More informationUnit 10 Databases. Computer Concepts Unit Contents. 10 Operational and Analytical Databases. 10 Section A: Database Basics
Unit 10 Databases Computer Concepts 2016 ENHANCED EDITION 10 Unit Contents Section A: Database Basics Section B: Database Tools Section C: Database Design Section D: SQL Section E: Big Data Unit 10: Databases
More informationOverview. * Some History. * What is NoSQL? * Why NoSQL? * RDBMS vs NoSQL. * NoSQL Taxonomy. *TowardsNewSQL
* Some History * What is NoSQL? * Why NoSQL? * RDBMS vs NoSQL * NoSQL Taxonomy * Towards NewSQL Overview * Some History * What is NoSQL? * Why NoSQL? * RDBMS vs NoSQL * NoSQL Taxonomy *TowardsNewSQL NoSQL
More informationBIG DATA TECHNOLOGIES: WHAT EVERY MANAGER NEEDS TO KNOW ANALYTICS AND FINANCIAL INNOVATION CONFERENCE JUNE 26-29,
BIG DATA TECHNOLOGIES: WHAT EVERY MANAGER NEEDS TO KNOW ANALYTICS AND FINANCIAL INNOVATION CONFERENCE JUNE 26-29, 2016 1 OBJECTIVES ANALYTICS AND FINANCIAL INNOVATION CONFERENCE JUNE 26-29, 2016 2 WHAT
More information10/18/2017. Announcements. NoSQL Motivation. NoSQL. Serverless Architecture. What is the Problem? Database Systems CSE 414
Announcements Database Systems CSE 414 Lecture 11: NoSQL & JSON (mostly not in textbook only Ch 11.1) HW5 will be posted on Friday and due on Nov. 14, 11pm [No Web Quiz 5] Today s lecture: NoSQL & JSON
More information5/2/16. Announcements. NoSQL Motivation. The New Hipster: NoSQL. Serverless. What is the Problem? Database Systems CSE 414
Announcements Database Systems CSE 414 Lecture 16: NoSQL and JSon Current assignments: Homework 4 due tonight Web Quiz 6 due next Wednesday [There is no Web Quiz 5 Today s lecture: JSon The book covers
More informationDatabase Systems CSE 414
Database Systems CSE 414 Lecture 16: NoSQL and JSon CSE 414 - Spring 2016 1 Announcements Current assignments: Homework 4 due tonight Web Quiz 6 due next Wednesday [There is no Web Quiz 5] Today s lecture:
More informationTopics. History. Architecture. MongoDB, Mongoose - RDBMS - SQL. - NoSQL
Databases Topics History - RDBMS - SQL Architecture - SQL - NoSQL MongoDB, Mongoose Persistent Data Storage What features do we want in a persistent data storage system? We have been using text files to
More informationPerformance Comparison of NOSQL Database Cassandra and SQL Server for Large Databases
Performance Comparison of NOSQL Database Cassandra and SQL Server for Large Databases Khalid Mahmood Shaheed Zulfiqar Ali Bhutto Institute of Science and Technology, Karachi Pakistan khalidmdar@yahoo.com
More informationRelational databases
COSC 6397 Big Data Analytics NoSQL databases Edgar Gabriel Spring 2017 Relational databases Long lasting industry standard to store data persistently Key points concurrency control, transactions, standard
More informationDatabase Solution in Cloud Computing
Database Solution in Cloud Computing CERC liji@cnic.cn Outline Cloud Computing Database Solution Our Experiences in Database Cloud Computing SaaS Software as a Service PaaS Platform as a Service IaaS Infrastructure
More informationNon-Relational Databases. Pelle Jakovits
Non-Relational Databases Pelle Jakovits 25 October 2017 Outline Background Relational model Database scaling The NoSQL Movement CAP Theorem Non-relational data models Key-value Document-oriented Column
More informationNoSQL DBs and MongoDB DATA SCIENCE BOOTCAMP
NoSQL DBs and MongoDB DATA SCIENCE BOOTCAMP Terminology DBMS: Database management system So;ware which controls the storage, retrieval, dele:on, security, and integrity of data within the database Examples:
More informationIntroduction to Big Data. NoSQL Databases. Instituto Politécnico de Tomar. Ricardo Campos
Instituto Politécnico de Tomar Introduction to Big Data NoSQL Databases Ricardo Campos Mestrado EI-IC Análise e Processamento de Grandes Volumes de Dados Tomar, Portugal, 2016 Part of the slides used in
More informationWebinar Series TMIP VISION
Webinar Series TMIP VISION TMIP provides technical support and promotes knowledge and information exchange in the transportation planning and modeling community. Today s Goals To Consider: Parallel Processing
More information5/1/17. Announcements. NoSQL Motivation. NoSQL. Serverless Architecture. What is the Problem? Database Systems CSE 414
Announcements Database Systems CSE 414 Lecture 15: NoSQL & JSON (mostly not in textbook only Ch 11.1) 1 Homework 4 due tomorrow night [No Web Quiz 5] Midterm grading hopefully finished tonight post online
More informationHands-on immersion on Big Data tools
Hands-on immersion on Big Data tools NoSQL Databases Donato Summa THE CONTRACTOR IS ACTING UNDER A FRAMEWORK CONTRACT CONCLUDED WITH THE COMMISSION Summary : Definition Main features NoSQL DBs classification
More informationBig Data Analytics. Rasoul Karimi
Big Data Analytics Rasoul Karimi Information Systems and Machine Learning Lab (ISMLL) Institute of Computer Science University of Hildesheim, Germany Big Data Analytics Big Data Analytics 1 / 1 Outline
More informationUnderstanding NoSQL Database Implementations
Understanding NoSQL Database Implementations Sadalage and Fowler, Chapters 7 11 Class 07: Understanding NoSQL Database Implementations 1 Foreword NoSQL is a broad and diverse collection of technologies.
More informationCOMP9321 Web Application Engineering
COMP9321 Web Application Engineering Semester 2, 2015 Dr. Amin Beheshti Service Oriented Computing Group, CSE, UNSW Australia Week 6 http://webapps.cse.unsw.edu.au/webcms2/course/index.php?cid=2411 1 We
More informationA NoSQL Introduction for Relational Database Developers. Andrew Karcher Las Vegas SQL Saturday September 12th, 2015
A NoSQL Introduction for Relational Database Developers Andrew Karcher Las Vegas SQL Saturday September 12th, 2015 About Me http://www.andrewkarcher.com Twitter: @akarcher LinkedIn, Twitter Email: akarcher@gmail.com
More informationStages of Data Processing
Data processing can be understood as the conversion of raw data into a meaningful and desired form. Basically, producing information that can be understood by the end user. So then, the question arises,
More informationNOSQL EGCO321 DATABASE SYSTEMS KANAT POOLSAWASD DEPARTMENT OF COMPUTER ENGINEERING MAHIDOL UNIVERSITY
NOSQL EGCO321 DATABASE SYSTEMS KANAT POOLSAWASD DEPARTMENT OF COMPUTER ENGINEERING MAHIDOL UNIVERSITY WHAT IS NOSQL? Stands for No-SQL or Not Only SQL. Class of non-relational data storage systems E.g.
More informationDistributed Databases: SQL vs NoSQL
Distributed Databases: SQL vs NoSQL Seda Unal, Yuchen Zheng April 23, 2017 1 Introduction Distributed databases have become increasingly popular in the era of big data because of their advantages over
More informationIEMS 5722 Mobile Network Programming and Distributed Server Architecture
Department of Information Engineering, CUHK MScIE 2 nd Semester, 2016/17 IEMS 5722 Mobile Network Programming and Distributed Server Architecture Lecture 6 Databases and Caches Lecturer: Albert C. M. Au
More informationA Review to the Approach for Transformation of Data from MySQL to NoSQL
A Review to the Approach for Transformation of Data from MySQL to NoSQL Monika 1 and Ashok 2 1 M. Tech. Scholar, Department of Computer Science and Engineering, BITS College of Engineering, Bhiwani, Haryana
More informationRelational Database Features
Relational Features s Why has the relational model been so successful? Data independence High level query language - SQL Query optimisation Support for integrity constraints Well-understood database design
More informationCOSC 416 NoSQL Databases. NoSQL Databases Overview. Dr. Ramon Lawrence University of British Columbia Okanagan
COSC 416 NoSQL Databases NoSQL Databases Overview Dr. Ramon Lawrence University of British Columbia Okanagan ramon.lawrence@ubc.ca Databases Brought Back to Life!!! Image copyright: www.dragoart.com Image
More informationSurvey of the Azure Data Landscape. Ike Ellis
Survey of the Azure Data Landscape Ike Ellis Wintellect Core Services Consulting Custom software application development and architecture Instructor Led Training Microsoft s #1 training vendor for over
More informationNOSQL Databases and Neo4j
NOSQL Databases and Neo4j Database and DBMS Database - Organized collection of data The term database is correctly applied to the data and their supporting data structures. DBMS - Database Management System:
More informationCSE 344 JULY 9 TH NOSQL
CSE 344 JULY 9 TH NOSQL ADMINISTRATIVE MINUTIAE HW3 due Wednesday tests released actual_time should have 0s not NULLs upload new data file or use UPDATE to change 0 ~> NULL Extra OOs on Mondays 5-7pm in
More informationCS-580K/480K Advanced Topics in Cloud Computing. NoSQL Database
CS-580K/480K dvanced Topics in Cloud Computing NoSQL Database 1 1 Where are we? Cloud latforms 2 VM1 VM2 VM3 3 Operating System 4 1 2 3 Operating System 4 1 2 Virtualization Layer 3 Operating System 4
More informationNoSQL Databases An efficient way to store and query heterogeneous astronomical data in DACE. Nicolas Buchschacher - University of Geneva - ADASS 2018
NoSQL Databases An efficient way to store and query heterogeneous astronomical data in DACE DACE https://dace.unige.ch Data and Analysis Center for Exoplanets. Facility to store, exchange and analyse data
More informationWhat is a Database? Peter Wood
Why study database management? 1. The database market is huge 2. There s a big demand for database skills Email: ptw@dcs.bbk.ac.uk 3. Managing data is a fundamental need for most applications Web: http://www.dcs.bbk.ac.uk/~ptw/
More informationIn-Memory Data processing using Redis Database
In-Memory Data processing using Redis Database Gurpreet Kaur Spal Department of Computer Science and Engineering Baba Banda Singh Bahadur Engineering College, Fatehgarh Sahib, Punjab, India Jatinder Kaur
More informationMongoDB and Mysql: Which one is a better fit for me? Room 204-2:20PM-3:10PM
MongoDB and Mysql: Which one is a better fit for me? Room 204-2:20PM-3:10PM About us Adamo Tonete MongoDB Support Engineer Agustín Gallego MySQL Support Engineer Agenda What are MongoDB and MySQL; NoSQL
More informationColumn-Family Databases Cassandra and HBase
Column-Family Databases Cassandra and HBase Kevin Swingler Google Big Table Google invented BigTableto store the massive amounts of semi-structured data it was generating Basic model stores items indexed
More informationChapter 24 NOSQL Databases and Big Data Storage Systems
Chapter 24 NOSQL Databases and Big Data Storage Systems - Large amounts of data such as social media, Web links, user profiles, marketing and sales, posts and tweets, road maps, spatial data, email - NOSQL
More informationIntroduction to NoSQL Databases
Introduction to NoSQL Databases Roman Kern KTI, TU Graz 2017-10-16 Roman Kern (KTI, TU Graz) Dbase2 2017-10-16 1 / 31 Introduction Intro Why NoSQL? Roman Kern (KTI, TU Graz) Dbase2 2017-10-16 2 / 31 Introduction
More informationPresented by Sunnie S Chung CIS 612
By Yasin N. Silva, Arizona State University Presented by Sunnie S Chung CIS 612 This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License. See http://creativecommons.org/licenses/by-nc-sa/4.0/
More informationComparing SQL and NOSQL databases
COSC 6397 Big Data Analytics Data Formats (II) HBase Edgar Gabriel Spring 2014 Comparing SQL and NOSQL databases Types Development History Data Storage Model SQL One type (SQL database) with minor variations
More information/ Cloud Computing. Recitation 8 October 18, 2016
15-319 / 15-619 Cloud Computing Recitation 8 October 18, 2016 1 Overview Administrative issues Office Hours, Piazza guidelines Last week s reflection Project 3.2, OLI Unit 3, Module 13, Quiz 6 This week
More informationA Sandbox environment for Hadoop
A Sandbox environment for Hadoop Presentation 21 February 2017 Peter Smyth UK Data Service Overview of this presentation Download and basic install of Hortonworks Sandbox Changing the size of the Sandbox
More informationInternational Journal of Informative & Futuristic Research ISSN:
www.ijifr.com Volume 5 Issue 8 April 2018 International Journal of Informative & Futuristic Research ISSN: 2347-1697 TRANSITION FROM TRADITIONAL DATABASES TO NOSQL DATABASES Paper ID IJIFR/V5/ E8/ 010
More informationYeSQL: Battling the NoSQL Hype Cycle with Postgres
YeSQL: Battling the NoSQL Hype Cycle with Postgres BRUCE MOMJIAN This talk explores how new NoSQL technologies are unique, and how existing relational database systems like Postgres are adapting to handle
More informationDistributed Non-Relational Databases. Pelle Jakovits
Distributed Non-Relational Databases Pelle Jakovits Tartu, 7 December 2018 Outline Relational model NoSQL Movement Non-relational data models Key-value Document-oriented Column family Graph Non-relational
More informationCassandra, MongoDB, and HBase. Cassandra, MongoDB, and HBase. I have chosen these three due to their recent
Tanton Jeppson CS 401R Lab 3 Cassandra, MongoDB, and HBase Introduction For my report I have chosen to take a deeper look at 3 NoSQL database systems: Cassandra, MongoDB, and HBase. I have chosen these
More informationSpotfire Advanced Data Services. Lunch & Learn Tuesday, 21 November 2017
Spotfire Advanced Data Services Lunch & Learn Tuesday, 21 November 2017 CONFIDENTIALITY The following information is confidential information of TIBCO Software Inc. Use, duplication, transmission, or republication
More informationDatabases and Big Data Today. CS634 Class 22
Databases and Big Data Today CS634 Class 22 Current types of Databases SQL using relational tables: still very important! NoSQL, i.e., not using relational tables: term NoSQL popular since about 2007.
More informationA Non-Relational Storage Analysis
A Non-Relational Storage Analysis Cassandra & Couchbase Alexandre Fonseca, Anh Thu Vu, Peter Grman Cloud Computing - 2nd semester 2012/2013 Universitat Politècnica de Catalunya Microblogging - big data?
More informationClass Overview. Two Classes of Database Applications. NoSQL Motivation. RDBMS Review: Client-Server. RDBMS Review: Serverless
Introduction to Database Systems CSE 414 Lecture 12: NoSQL 1 Class Overview Unit 1: Intro Unit 2: Relational Data Models and Query Languages Unit 3: Non-relational data NoSQL Json SQL++ Unit 4: RDMBS internals
More informationDatabase Technologies. Madalina CROITORU IUT Montpellier
Database Technologies Madalina CROITORU croitoru@lirmm.fr IUT Montpellier Course practicalities 2 x 2h per week (14 weeks) Basics of database theory relational model, relational algebra, SQL and database
More informationGiftWorks Import Guide Page 2
Import Guide Introduction... 2 GiftWorks Import Services... 3 Import Sources... 4 Preparing for Import... 9 Importing and Matching to Existing Donors... 11 Handling Receipting of Imported Donations...
More informationModule - 17 Lecture - 23 SQL and NoSQL systems. (Refer Slide Time: 00:04)
Introduction to Morden Application Development Dr. Gaurav Raina Prof. Tanmai Gopal Department of Computer Science and Engineering Indian Institute of Technology, Madras Module - 17 Lecture - 23 SQL and
More informationNoSQL + SQL = MySQL Get the Best of Both Worlds
NoSQL + SQL = MySQL Get the Best of Both Worlds Jesper Wisborg Krogh Senior Principal Technical Support Engineer Oracle, MySQL Support October 22, 2018 NEXT 15-MINUTE BRIEFING NoSQL + SQL = MySQL Safe
More informationSESSION TITLE GOES HERE Second Cosmos for Line the Goes Business Here Intelligence Professional
Azure Cosmos DB with Power BI SESSION TITLE GOES HERE Second Cosmos for Line the Goes Business Here Intelligence Professional Cosmos for the Business Intelligence Professional Speaker Name Speaker Title
More informationScaling Up HBase. Duen Horng (Polo) Chau Assistant Professor Associate Director, MS Analytics Georgia Tech. CSE6242 / CX4242: Data & Visual Analytics
http://poloclub.gatech.edu/cse6242 CSE6242 / CX4242: Data & Visual Analytics Scaling Up HBase Duen Horng (Polo) Chau Assistant Professor Associate Director, MS Analytics Georgia Tech Partly based on materials
More informationIntro To Big Data. John Urbanic Parallel Computing Scientist Pittsburgh Supercomputing Center. Copyright 2017
Intro To Big Data John Urbanic Parallel Computing Scientist Pittsburgh Supercomputing Center Copyright 2017 Big data is a broad term for data sets so large or complex that traditional data processing applications
More informationCISC 7610 Lecture 4 Approaches to multimedia databases. Topics: Document databases Graph databases Metadata Column databases
CISC 7610 Lecture 4 Approaches to multimedia databases Topics: Document databases Graph databases Metadata Column databases NoSQL architectures: different tradeoffs for different workloads Already seen:
More informationBruce Moore Fall 99 Internship September 23, 1999 Supervised by Dr. John P.
Bruce Moore Fall 99 Internship September 23, 1999 Supervised by Dr. John P. Russo Active Server Pages Active Server Pages are Microsoft s newest server-based technology for building dynamic and interactive
More informationIntroduction to Graph Databases
Introduction to Graph Databases David Montag @dmontag #neo4j 1 Agenda NOSQL overview Graph Database 101 A look at Neo4j The red pill 2 Why you should listen Forrester says: The market for graph databases
More informationAnnouncements. Two Classes of Database Applications. Class Overview. NoSQL Motivation. RDBMS Review: Serverless
Introduction to Database Systems CSE 414 Lecture 11: NoSQL 1 HW 3 due Friday Announcements Upload data with DataGrip editor see message board Azure timeout for question 5: Try DataGrip or SQLite HW 2 Grades
More informationLocalization and value creation
Localization and value creation Table of Contents 1. Localization brings interesting new dimensions............................................. 1 a. Example - Facebook Local Awareness Feature 1 b. Example
More informationPolyglot Persistence in Today s Data World
Polyglot Persistence in Today s Data World Kimberly Wilkins Principal Engineer Databases ObjectRocket by Rackspace www.linkedin.com/in/wilkinskimberly, kimberly.wilkins@rackspace.com, @dba_denizen 1 Background
More informationMotivation Overview of NoSQL space Comparing technologies used Getting hands dirty tutorial section
NOSQL 1 GOAL Motivation Overview of NoSQL space Comparing technologies used Getting hands dirty tutorial section 2 MOTIVATION Assume we have a product that becomes popular 3. 1 TYPICAL WEBSERVER ARCHITECTURE
More informationAccess Basics: When and How
Access Basics: When and How Hal Jankowski CACUBO Winter Workshop Kansas City, MO April 2014 Learning outcome disclaimer Access is a complex tool that requires significant hands on time to become familiar.
More informationIntroduction Aggregate data model Distribution Models Consistency Map-Reduce Types of NoSQL Databases
Introduction Aggregate data model Distribution Models Consistency Map-Reduce Types of NoSQL Databases Key-Value Document Column Family Graph John Edgar 2 Relational databases are the prevalent solution
More informationAccessing other data fdw, dblink, pglogical, plproxy,...
Accessing other data fdw, dblink, pglogical, plproxy,... Hannu Krosing, Quito 2017.12.01 1 Arctic Circle 2 Who am I Coming from Estonia PostgreSQL user since about 1990 (when it was just Postgres 4.2)
More informationCIB Session 12th NoSQL Databases Structures
CIB Session 12th NoSQL Databases Structures By: Shahab Safaee & Morteza Zahedi Software Engineering PhD Email: safaee.shx@gmail.com, morteza.zahedi.a@gmail.com cibtrc.ir cibtrc cibtrc 2 Agenda What is
More informationStudy of NoSQL Database Along With Security Comparison
Study of NoSQL Database Along With Security Comparison Ankita A. Mall [1], Jwalant B. Baria [2] [1] Student, Computer Engineering Department, Government Engineering College, Modasa, Gujarat, India ank.fetr@gmail.com
More informationCOMP9321 Web Application Engineering
COMP9321 Web Application Engineering Data Access in Web Applications Dr. Basem Suleiman Service Oriented Computing Group, CSE, UNSW Australia Semester 1, 2016, Week 5 http://webapps.cse.unsw.edu.au/webcms2/course/index.php?cid=2442
More informationAvancier Methods (AM) From logical model to physical database
Methods (AM) From logical model to physical database Data structures It is illegal to copy, share or show this document (or other document published at http://avancier.co.uk) without the written permission
More informationA Review Paper on Big data & Hadoop
A Review Paper on Big data & Hadoop Rupali Jagadale MCA Department, Modern College of Engg. Modern College of Engginering Pune,India rupalijagadale02@gmail.com Pratibha Adkar MCA Department, Modern College
More informationVS2010 C# Programming - DB intro 1
VS2010 C# Programming - DB intro 1 Topics Database Relational - linked tables SQL ADO.NET objects Referencing Data Using the Wizard Displaying data 1 VS2010 C# Programming - DB intro 2 Database A collection
More informationAnnouncements. Using Electronics in Class. Review. Staff Instructor: Alvin Cheung Office hour on Wednesdays, 1-2pm. Class Overview
Announcements Introduction to Databases CSE 414 Lecture 2: Data Models HW1 and WQ1 released Both due next Tuesday Office hours start this week Sections tomorrow Make sure you sign up on piazza Please ask
More informationChallenges for Data Driven Systems
Challenges for Data Driven Systems Eiko Yoneki University of Cambridge Computer Laboratory Data Centric Systems and Networking Emergence of Big Data Shift of Communication Paradigm From end-to-end to data
More informationShine a Light on Dark Data with Vertica Flex Tables
White Paper Analytics and Big Data Shine a Light on Dark Data with Vertica Flex Tables Hidden within the dark recesses of your enterprise lurks dark data, information that exists but is forgotten, unused,
More informationStream Processing Platforms Storm, Spark,.. Batch Processing Platforms MapReduce, SparkSQL, BigQuery, Hive, Cypher,...
Data Ingestion ETL, Distcp, Kafka, OpenRefine, Query & Exploration SQL, Search, Cypher, Stream Processing Platforms Storm, Spark,.. Batch Processing Platforms MapReduce, SparkSQL, BigQuery, Hive, Cypher,...
More informationNoSQL Databases Analysis
NoSQL Databases Analysis Jeffrey Young Intro I chose to investigate Redis, MongoDB, and Neo4j. I chose Redis because I always read about Redis use and its extreme popularity yet I know little about it.
More informationData Analysis Using Sql And Excel 2nd Edition
We have made it easy for you to find a PDF Ebooks without any digging. And by having access to our ebooks online or by storing it on your computer, you have convenient answers with data analysis using
More informationDatabases : Lectures 11 and 12: Beyond ACID/Relational databases Timothy G. Griffin Lent Term 2013
Databases : Lectures 11 and 12: Beyond ACID/Relational databases Timothy G. Griffin Lent Term 2013 Rise of Web and cluster-based computing NoSQL Movement Relationships vs. Aggregates Key-value store XML
More informationConnecting to Webex for eorganic Webinar Attendees: Instructions and Troubleshooting
Connecting to Webex for eorganic Webinar Attendees: Instructions and Troubleshooting We hope this detailed guide will help anyone who has trouble getting connected to our webinars or hearing the sound!
More information(Poor) Example code. Objec+ves. Comparing Rela+onal Databases and Elas+csearch. Review 3/13/17. for(; iter.hasnext();) {... } Elas+csearch MongoDB
Objec+ves Elas+csearch MongoDB (Poor) Example code for(; iter.hasnext();) {...!StringUtils.isNotEmpty(str) March 13, 2017 Sprenkle - CSCI397 1 March 13, 2017 Sprenkle - CSCI397 2 Review What data storage/search
More informationCOSC 304 Introduction to Database Systems. NoSQL Databases. Dr. Ramon Lawrence University of British Columbia Okanagan
COSC 304 Introduction to Database Systems NoSQL Databases Dr. Ramon Lawrence University of British Columbia Okanagan ramon.lawrence@ubc.ca Relational Databases Relational databases are the dominant form
More informationAn Adventure in Data Modeling
An Adventure in Data Modeling The Entity-Attribute-Value Data Model!! PGConf NYC! April 4, 2014 Mark Wong! mark.wong@myemma.com! Emma Email Marketing!! @emmaemailtech Who is Emma? At Emma, we're out to
More informationUnderstanding the SAP HANA Difference. Amit Satoor, SAP Data Management
Understanding the SAP HANA Difference Amit Satoor, SAP Data Management Webinar Logistics Got Flash? http://get.adobe.com/flashplayer to download. The future holds many transformational opportunities Capitalize
More informationKim Greene - Introduction
Kim Greene kim@kimgreene.com 507-216-5632 Skype/Twitter: iseriesdomino Copyright Kim Greene Consulting, Inc. All rights reserved worldwide. 1 Kim Greene - Introduction Owner of an IT consulting company
More informationData Formats and APIs
Data Formats and APIs Mike Carey mjcarey@ics.uci.edu 0 Announcements Keep watching the course wiki page (especially its attachments): https://grape.ics.uci.edu/wiki/asterix/wiki/stats170ab-2018 Ditto for
More informationQuery Languages for Document Stores
Query Languages for Document Stores NoSQL matters conference 2013-04-26 Jan Steemann me I'm a software developer working at triagens GmbH on and with Documents Documents documents are self-contained, aggregate
More informationReview - Relational Model Concepts
Lecture 25 Overview Last Lecture Query optimisation/query execution strategies This Lecture Non-relational data models Source: web pages, textbook chapters 20-22 Next Lecture Revision Review - Relational
More informationSession 6: Relational Databases
INFM 603: Information Technology and Organizational Context Session 6: Relational Databases Jimmy Lin The ischool University of Maryland Thursday, October 16, 2014 Databases Yesterday Databases Today What
More informationGOING MOBILE: Setting The Scene for RTOs.
GOING MOBILE: Setting The Scene for RTOs. 29 November, 4:00 pm 4:45 pm, General Session Presented by Lawrence Smith & Chris Adams WHERE: Usage of Mobile Devices Source: State of American Traveler Research
More informationPerformance Evaluation of Redis and MongoDB Databases for Handling Semi-structured Data
Performance Evaluation of Redis and MongoDB Databases for Handling Semi-structured Data Gurpreet Kaur Spal 1, Prof. Jatinder Kaur 2 1,2 Department of Computer Science and Engineering, Baba Banda Singh
More informationCISC 7610 Lecture 4 Approaches to multimedia databases. Topics: Graph databases Neo4j syntax and examples Document databases
CISC 7610 Lecture 4 Approaches to multimedia databases Topics: Graph databases Neo4j syntax and examples Document databases NoSQL architectures: different tradeoffs for different workloads Already seen:
More informationCSC 355 Database Systems
CSC 355 Database Systems Marcus Schaefer Databases? Database 1. DB models aspects of the real world (miniworld, universe of discourse) 2. Collection of data logically coherent Meaningful Information 3.
More informationAdvanced Database Project: Document Stores and MongoDB
Advanced Database Project: Document Stores and MongoDB Sivaporn Homvanish (0472422) Tzu-Man Wu (0475596) Table of contents Background 3 Introduction of Database Management System 3 SQL vs NoSQL 3 Document
More informationCONTENT CALENDAR USER GUIDE SOCIAL MEDIA TABLE OF CONTENTS. Introduction pg. 3
TABLE OF CONTENTS SOCIAL MEDIA Introduction pg. 3 CONTENT 1 Chapter 1: What Is Historical Optimization? pg. 4 2 CALENDAR Chapter 2: Why Historical Optimization Is More Important Now Than Ever Before pg.
More informationHow to integrate data into Tableau
1 How to integrate data into Tableau a comparison of 3 approaches: ETL, Tableau self-service and WHITE PAPER WHITE PAPER 2 data How to integrate data into Tableau a comparison of 3 es: ETL, Tableau self-service
More information