NoSQL database and its business applications

Size: px
Start display at page:

Download "NoSQL database and its business applications"

Transcription

1 COSC 657 Db. Management Systems Professor: RAMESH K. Student: BUER JIANG Research paper NoSQL database and its business applications The original purpose has been contemporary web-expand dbs. The movement started since early 2009 and is increasing rapidly. Usually more features apply: schema-less, easy replication uphold, easy API, eventually consistent / BASE (other than ACID), a large amount of query and more. Therefore, the misleading term "NoSQL" (the community currently interpret it mostly with "not only sql") should be treated as an alternative to something like the definition above. NoSQL was rising a decade ago by giant Internet companies including Google, Amazon, Facebook, and LinkedIn to conquer limitations of relational dbs. such as Oracle, and MySQL for contemporary web apps. Once those front pioneers proved the pros and efficacy of NoSQL, app by corporations began to unveil in three different overlapping stages: Grassroots Experimentation step: In stage I (which initiated around 2010), corporation programmers began experimenting with NoSQL on side projects and non-duty-critical apps. Their main requirement was flexibility to uphold agile evolution of proofs of idea and small apps. Duty Critical Establishments: In stage II (which initiated about 2013), corporations started to took NoSQL for duty critical apps. In this stage, the critical requirements are performance, scalability, and availability to develop and / or migrate targeted services. Broad Re-platforming: In stage III (which is just starting in late 2015), both programmers and corporations require a general-purpose db. for broad corporation adoption to re-platform all duty-critical apps and services for the internet economy. In this stage, NoSQL db. requirements include flexibility, performance, scalability, and availability as well as a extensive query language and useful indexing. Why relational dbs. Become imperfection

2 Companies have relied on relational dbs. like Oracle, SQL Server, DB2, MySQL and others for years. So why does relational technology fail to meet the requirements of today s web, mobile? Relational dbs. were born in the era of mainframes and business apps long before the Internet, the cloud, big info, mobile and currently, the Internet period. As a matter of fact, the first business implementation was released by Oracle in These dbs. were designed to run on a single host the bigger, the better. The only way to increase the capacity of these dbs. was to upgrade the servers processors, memory, and reserve to expand up. NoSQL dbs. appeared because of the exponential growth of the Internet and the rise of web apps. Google released the BigTable research in 2006, and Amazon released the Dynamo research paper in Those dbs. were programed to meet a new generation of corporation needs: The need to develop with agility and to run at any expand. Develop with Agility To sustain competitive in the Internet era, business must innovate and currently they must do it faster than ever before. As this innovation centers on the evolution of contemporary web, mobile, programmers must deliver apps and services faster than before. Speed is critical, so is agility, since these apps evolve far more rapidly than legacy apps like ERP. Relational dbs. are a major blockage to agility, since they do not uphold agile evolution very well because their monologue info model. Flexibility for faster evolution A critical rule of agile evolution is evolving app requirements: when the requirements change, the info prototype changes as well. This is a issue for relational dbs. because the info prototypes fixed and defined by a static schema. So, to adjust the info model, programmers should modify the schema, or worse, ask for a schema change from the DBA. That slows down the pace of evolution, not only because it is a manual, time-consuming process, but it also impacts other apps and services.

3 Why choosing NoSQL? By comparison, the reasons for businesses to adopt a NoSQL database environment over a relational database have almost every aspect to do with the following market drivers and technical requirements. When making the change, consider checking out this roadmap relational database to NoSQL database for a walkthrough of NoSQL education, migration and success.

4 Simplicity for Easier Evolution Another pro of a document db. that allows faster innovation is the ability for apps to directly read documents: There s no need for an instancerelational mapping layer between the app prototype and the info. Apps and services prototype info as instances (e.g. employee), multi-valued info as collections (e.g., roles), and related info as nested instances or collections (e.g. manager). Therefore, relational dbs. Prototype info treated as tables of rows and columns related info as rows within different tables, multi-valued info as rows within the same table. The problem with relational dbs.is that info is read and written by disassembling, and reassembling instances. This is called the instance- relational impedance mismatch. The workplace is instance-relational mapping frameworks, which are inefficient at best, problematic at worst. For instance, thinking about an app for managing resumes. It interacts with resumes as an instance, the user instance. It contains an array for skills and a collection for positions. Therefore, writing a resume to a relational db. requires the app to delete the user instance. Storing this resume will need the app to insert six rows into three tables:

5 Reading this profile would need the app to input six rows from three tables: In contrast, a document-oriented NoSQL db. reads and writes info formatted in JSON which is the matter of a fact standard for consuming and producing info for web, mobile, and apps. It not only kills the instance-relational impedance mismatch, it also deletes the extra cost of ORM frameworks and simplifies app evolution since instances are read and written without deleting them i.e., a single instance can be read or written as a single document:

6 What about querying and SQL? It s critical to remember that NoSQL stands for not only SQL. SQL is a comparatively mature query technology used by millions of programmers. Virtually every programming language and framework, as well as nearly all BI and reporting tools, uphold SQL. Therefore, it s important that programmers should be able to influence their SQL skills and tools when working with a NoSQL db. Host4.0 introduced N1QL, a useful query language that extends SQL to JSON, enabling programmers to control both the power of SQL and the flexibility of JSON. It not only upholds queries such as SELECT / FROM / WHERE statements, it also upholds aggregation (GROUP BY), sorting (SORT BY), joins (LEFT OUTER / INNER), and querying nested arrays and collections. Other than those, query performance can be improved with composite, partial, covering indexes, and more.

7 Run at Any Scope Dbs. that uphold web, mobile, and apps must be able to run at any expand. While it is possible to expand a relational db. like Oracle (using, for example, Oracle RAC), doing so is typically complex, expensive, and not fully reliable. With Oracle, for example, scaling out using RAC technology requires numerous components and creates a single point of failure that jeopardizes availability. By comparison, a NoSQL distributed db. designed with a expand-out architecture and no single point of failure provides compelling operational advantages. Flexibility for Performance at Scope Apps and services must uphold an ever-increasing number of users and info hundreds to thousands to millions of users, and gigabytes to terabytes of operational info. At the same time, they should expand to sustain performance, and they must do it efficiently. The db. should be able to expand reads, writes, and reserve. This is a problem for relational dbs. that are limited to scaling up i.e., increasing the number of processors, memory, and reserve to a single physical server. As a result, the ability to expand efficiently, and on demand, is a challenge. It becomes increasingly expensive, because business must purchase bigger and bigger servers to accommodate more users and more traffic. Other than, it can cause time outfit the db. must be taken offline to run hardware upgrades. If the host turns out to be too big, the excess capacity is

8 an unnecessary cost. If it proved to be too small, degraded performance results in a poor user experience. As distributed NoSQL db., Therefore, influences product hardware to expand out for instance, add more resources merely by increasing the number of servers. The ability to expand up allows business to expand more efficiently by (a) establishing less hardware than is required to meet the current load (b) influencing cheaper hardware and/or cloud infrastructure; and (c) scaling in-demand and without timeout. Other than being able to expand effectively and efficiently, distributed NoSQL dbs. are no hard to setup, configure, and expand. They were designed to distribute reads, writes, and reserve, and they were programed to run at any level including the management and monitoring of nodes of all size.

9 Availability for global establishment as increasing client s participants take place online through web and cell apps, availability gradually becomes a major concern. These duty-critical apps must be available 24/7 no exceptions. Delivering all time availability is a defiance for relational dbs. that are established to a single physical host or that rely on aggregating with shared reserve. If established as a single host and it fails, or as a node and the shared reserve fails, the db. becomes unavailable.

10 Other than the info can be copied to one or more instances for high availability (internode copy). While relational dbs. like Oracle need discrete software for duplication, for instance, Oracle active info guard, NoSQL dbs.do not it s built in and it s self-activate. In contrary to relational dbs., a distributed, NoSQL db. partitions and distributes info to multiple db. instances with no shared resources. Furthermore, self-activating failover ensures that if a node fails, the db. can uninterrupted to perform reads and writes by sending the calls to a different node. Ensuring global availability is difficult for relational dbs. where discrete add-ons are required which increases complexity or where replication between multiple info centers can only be used for failover, because only one info center is active at a time. Oracle, for example, requires Oracle Golden Gate. When copying between info centers, apps built on relational dbs. can experience performance degradation or find that the info centers are heavily out of sync. As clients participants move online, the need to be available in multiple countries and regions becomes important. While set up a db. to multiple info centers increases availability and helps with disaster recovery, it also has the benefit of increasing performance as well since all reads and writes can be run on the nearest info center, therefore reducing latency.

11 As distributed NoSQL db., contains built-in copy among info centers no discrete app is needed. Moreover, some contains both unidirectional and bidirectional copy making full active establishments to several info centers which also making the db. to be designed in several countries and area and to provide local info to local apps and their subscribers. NoSQL is a good fit for current internet economy. As business move to the Internet era made by cloud, mobile, and big info technologies programmers and operations teams should create and sustain web, mobile, and Internet faster and faster, and at greater expand. NoSQL is

12 increasingly the db. technology to power today s web, mobile and apps. Thousands of business, along with tens of thousands medium-small businesses and startups, have took NoSQL. The use of NoSQL started with a cache, proof of idea or a small app, then expanded to targeted important apps, and is currently the base for all app evolution. Under NoSQL, business are easier for both develop with agility and control at any scope and to submit the performance and availability required to satisfied the needs of internet economy businesses. Second Steps We start with recommendations for targeting and choosing the right app. Then, we include ideas for conforming relational info as documents, how to access them in your app, and how to move info from a relational db. Finally, we emphasis the basics of controlling a NoSQL db. in contrast to a relational db., and provide instruction on how to make a successful NoSQL proof of idea. It starts with Info, because the key requirement for Stage three apps in the modern era is the capability to query info with an expressive language that allows programmers to query any type of info independent of how it is constructed. Web and book reference: Couch DB the Definitive Guide, J. Chris Anderson, Jan Lehnardt and Noah Slater. O Reilly Media Inc., Sebastopool, CA, USA a practical guide to NoSQL, Posted by Denise Miura on March 17, 2011 at NoSQL (RDBMS) Ellis, Jonathan: NoSQL Ecosystem. November Blog post of

When, Where & Why to Use NoSQL?

When, Where & Why to Use NoSQL? When, Where & Why to Use NoSQL? 1 Big data is becoming a big challenge for enterprises. Many organizations have built environments for transactional data with Relational Database Management Systems (RDBMS),

More information

Database Architectures

Database Architectures Database Architectures CPS352: Database Systems Simon Miner Gordon College Last Revised: 4/15/15 Agenda Check-in Parallelism and Distributed Databases Technology Research Project Introduction to NoSQL

More information

CISC 7610 Lecture 2b The beginnings of NoSQL

CISC 7610 Lecture 2b The beginnings of NoSQL CISC 7610 Lecture 2b The beginnings of NoSQL Topics: Big Data Google s infrastructure Hadoop: open google infrastructure Scaling through sharding CAP theorem Amazon s Dynamo 5 V s of big data Everyone

More information

Moving from RELATIONAL TO NoSQL: Relational to NoSQL:

Moving from RELATIONAL TO NoSQL: Relational to NoSQL: Moving from RELATIONAL TOtoNoSQL: Relational NoSQL: GETTING STARTED SQL SERVER HOW TOFROM GET STARTED Moving from Relational to NoSQL: How to Get Started Why the shift to NoSQL? NoSQL has become a foundation

More information

L22: NoSQL. CS3200 Database design (sp18 s2) 4/5/2018 Several slides courtesy of Benny Kimelfeld

L22: NoSQL. CS3200 Database design (sp18 s2)   4/5/2018 Several slides courtesy of Benny Kimelfeld L22: NoSQL CS3200 Database design (sp18 s2) https://course.ccs.neu.edu/cs3200sp18s2/ 4/5/2018 Several slides courtesy of Benny Kimelfeld 2 Outline 3 Introduction Transaction Consistency 4 main data models

More information

Overview. * Some History. * What is NoSQL? * Why NoSQL? * RDBMS vs NoSQL. * NoSQL Taxonomy. *TowardsNewSQL

Overview. * Some History. * What is NoSQL? * Why NoSQL? * RDBMS vs NoSQL. * NoSQL Taxonomy. *TowardsNewSQL * Some History * What is NoSQL? * Why NoSQL? * RDBMS vs NoSQL * NoSQL Taxonomy * Towards NewSQL Overview * Some History * What is NoSQL? * Why NoSQL? * RDBMS vs NoSQL * NoSQL Taxonomy *TowardsNewSQL NoSQL

More information

Enterprise Open Source Databases

Enterprise Open Source Databases Enterprise Open Source Databases WHITE PAPER MariaDB vs. Oracle MySQL vs. EnterpriseDB MariaDB TX Born of the community. Raised in the enterprise. MariaDB TX, with a history of proven enterprise reliability

More information

Focus On: Oracle Database 11g Release 2

Focus On: Oracle Database 11g Release 2 Focus On: Oracle Database 11g Release 2 Focus on: Oracle Database 11g Release 2 Oracle s most recent database version, Oracle Database 11g Release 2 [11g R2] is focused on cost saving, high availability

More information

Relational to NoSQL: Getting started from SQL Server. Shane Johnson Sr. Product Marketing Manager Couchbase

Relational to NoSQL: Getting started from SQL Server. Shane Johnson Sr. Product Marketing Manager Couchbase Relational to NoSQL: Getting started from SQL Server Shane Johnson Sr. Product Marketing Manager Couchbase Today s agenda Why NoSQL? Identifying the right application Modeling your data Accessing your

More information

Introduction to NoSQL

Introduction to NoSQL Introduction to NoSQL Agenda History What is NoSQL Types of NoSQL The CAP theorem History - RDBMS Relational DataBase Management Systems were invented in the 1970s. E. F. Codd, "Relational Model of Data

More information

Building a Data Strategy for a Digital World

Building a Data Strategy for a Digital World Building a Data Strategy for a Digital World Jason Hunter, CTO, APAC Data Challenge: Pushing the Limits of What's Possible The Art of the Possible Multiple Government Agencies Data Hub 100 s of Service

More information

Hierarchy of knowledge BIG DATA 9/7/2017. Architecture

Hierarchy of knowledge BIG DATA 9/7/2017. Architecture BIG DATA Architecture Hierarchy of knowledge Data: Element (fact, figure, etc.) which is basic information that can be to be based on decisions, reasoning, research and which is treated by the human or

More information

Intro Cassandra. Adelaide Big Data Meetup.

Intro Cassandra. Adelaide Big Data Meetup. Intro Cassandra Adelaide Big Data Meetup instaclustr.com @Instaclustr Who am I and what do I do? Alex Lourie Worked at Red Hat, Datastax and now Instaclustr We currently manage x10s nodes for various customers,

More information

There And Back Again

There And Back Again There And Back Again Databases At Uber Evan Klitzke October 4, 2016 Outline Background MySQL To Postgres Connection Scalability Write Amplification/Replication Miscellaneous Other Things Databases at Uber

More information

Virtual vs Physical ADC

Virtual vs Physical ADC WHITEPAPER What are the primary differences and the pros and cons of virtual vs physical application delivery controllers? Snapt Technical Team sales@snapt.net pg. 1 Forward-thinking organizations are

More information

CIB Session 12th NoSQL Databases Structures

CIB Session 12th NoSQL Databases Structures CIB Session 12th NoSQL Databases Structures By: Shahab Safaee & Morteza Zahedi Software Engineering PhD Email: safaee.shx@gmail.com, morteza.zahedi.a@gmail.com cibtrc.ir cibtrc cibtrc 2 Agenda What is

More information

Fusion iomemory PCIe Solutions from SanDisk and Sqrll make Accumulo Hypersonic

Fusion iomemory PCIe Solutions from SanDisk and Sqrll make Accumulo Hypersonic WHITE PAPER Fusion iomemory PCIe Solutions from SanDisk and Sqrll make Accumulo Hypersonic Western Digital Technologies, Inc. 951 SanDisk Drive, Milpitas, CA 95035 www.sandisk.com Table of Contents Executive

More information

Open Source Database Ecosystem in Peter Zaitsev 3 October 2016

Open Source Database Ecosystem in Peter Zaitsev 3 October 2016 Open Source Database Ecosystem in 2016 Peter Zaitsev 3 October 2016 Great things are happening with Open Source Databases It is great Industry and Community to be a part of 2 Why? 3 Data Continues Exponential

More information

A Journey to DynamoDB

A Journey to DynamoDB A Journey to DynamoDB and maybe away from DynamoDB Adam Dockter VP of Engineering ServiceTarget Who are we? Small Company 4 Developers AWS Infrastructure NO QA!! About our product Self service web application

More information

Introduction to Big Data. NoSQL Databases. Instituto Politécnico de Tomar. Ricardo Campos

Introduction to Big Data. NoSQL Databases. Instituto Politécnico de Tomar. Ricardo Campos Instituto Politécnico de Tomar Introduction to Big Data NoSQL Databases Ricardo Campos Mestrado EI-IC Análise e Processamento de Grandes Volumes de Dados Tomar, Portugal, 2016 Part of the slides used in

More information

MySQL CLOUD SERVICE. Propel Innovation and Time-to-Market

MySQL CLOUD SERVICE. Propel Innovation and Time-to-Market MySQL CLOUD SERVICE Propel Innovation and Time-to-Market The #1 open source database in Oracle. Looking to drive digital transformation initiatives and deliver new modern applications? Oracle MySQL Service

More information

State of the Dolphin Developing new Apps in MySQL 8

State of the Dolphin Developing new Apps in MySQL 8 State of the Dolphin Developing new Apps in MySQL 8 Highlights of MySQL 8.0 technology updates Mark Swarbrick MySQL Principle Presales Consultant Jill Anolik MySQL Global Business Unit Israel Copyright

More information

Jean-Marc Krikorian Strategic Alliance Director

Jean-Marc Krikorian Strategic Alliance Director Jean-Marc Krikorian Strategic Alliance Director JeanMarc.Krikorian@EnterpriseDB.com +1 773-383-6517 Introduction to EnterpriseDB 2 Founded in 2004 Mission: Enable the adoption of high quality Postgres

More information

How to integrate data into Tableau

How to integrate data into Tableau 1 How to integrate data into Tableau a comparison of 3 approaches: ETL, Tableau self-service and WHITE PAPER WHITE PAPER 2 data How to integrate data into Tableau a comparison of 3 es: ETL, Tableau self-service

More information

Hands-on immersion on Big Data tools

Hands-on immersion on Big Data tools Hands-on immersion on Big Data tools NoSQL Databases Donato Summa THE CONTRACTOR IS ACTING UNDER A FRAMEWORK CONTRACT CONCLUDED WITH THE COMMISSION Summary : Definition Main features NoSQL DBs classification

More information

Oracle Database 18c and Autonomous Database

Oracle Database 18c and Autonomous Database Oracle Database 18c and Autonomous Database Maria Colgan Oracle Database Product Management March 2018 @SQLMaria Safe Harbor Statement The following is intended to outline our general product direction.

More information

NoSQL systems: introduction and data models. Riccardo Torlone Università Roma Tre

NoSQL systems: introduction and data models. Riccardo Torlone Università Roma Tre NoSQL systems: introduction and data models Riccardo Torlone Università Roma Tre Leveraging the NoSQL boom 2 Why NoSQL? In the last fourty years relational databases have been the default choice for serious

More information

INFO-H415 Adanvanced Databases Documents store and cloudant

INFO-H415 Adanvanced Databases Documents store and cloudant INFO-H413 Heuristic Optimization Implemenation Exercise 1 Dany S Efila ULB 000349507 Universite Libre de Bruxelles Avril 2017 INFO-H415 Adanvanced Databases Documents store and cloudant Dany S EFILA Michel

More information

Safe Harbor Statement

Safe Harbor Statement Safe Harbor Statement The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment

More information

A Review to the Approach for Transformation of Data from MySQL to NoSQL

A Review to the Approach for Transformation of Data from MySQL to NoSQL A Review to the Approach for Transformation of Data from MySQL to NoSQL Monika 1 and Ashok 2 1 M. Tech. Scholar, Department of Computer Science and Engineering, BITS College of Engineering, Bhiwani, Haryana

More information

Carbonite Availability. Technical overview

Carbonite Availability. Technical overview Carbonite Availability Technical overview Table of contents Executive summary The availability imperative...3 True real-time replication More efficient and better protection... 4 Robust protection Reliably

More information

How we build TiDB. Max Liu PingCAP Amsterdam, Netherlands October 5, 2016

How we build TiDB. Max Liu PingCAP Amsterdam, Netherlands October 5, 2016 How we build TiDB Max Liu PingCAP Amsterdam, Netherlands October 5, 2016 About me Infrastructure engineer / CEO of PingCAP Working on open source projects: TiDB: https://github.com/pingcap/tidb TiKV: https://github.com/pingcap/tikv

More information

Moving from Relational to NoSQL: How to Get Started

Moving from Relational to NoSQL: How to Get Started Moving from Relational to NoSQL: How to Get Started Why the shift to NoSQL? NoSQL has become a foundation for modern web, mobile, and IoT application development. At Couchbase, we ve enabled hundreds of

More information

FIVE BEST PRACTICES FOR ENSURING A SUCCESSFUL SQL SERVER MIGRATION

FIVE BEST PRACTICES FOR ENSURING A SUCCESSFUL SQL SERVER MIGRATION FIVE BEST PRACTICES FOR ENSURING A SUCCESSFUL SQL SERVER MIGRATION The process of planning and executing SQL Server migrations can be complex and risk-prone. This is a case where the right approach and

More information

Composite Software Data Virtualization The Five Most Popular Uses of Data Virtualization

Composite Software Data Virtualization The Five Most Popular Uses of Data Virtualization Composite Software Data Virtualization The Five Most Popular Uses of Data Virtualization Composite Software, Inc. June 2011 TABLE OF CONTENTS INTRODUCTION... 3 DATA FEDERATION... 4 PROBLEM DATA CONSOLIDATION

More information

Lecture 25 Overview. Last Lecture Query optimisation/query execution strategies

Lecture 25 Overview. Last Lecture Query optimisation/query execution strategies Lecture 25 Overview Last Lecture Query optimisation/query execution strategies This Lecture Non-relational data models Source: web pages, textbook chapters 20-22 Next Lecture Revision COSC344 Lecture 25

More information

Embedded Technosolutions

Embedded Technosolutions Hadoop Big Data An Important technology in IT Sector Hadoop - Big Data Oerie 90% of the worlds data was generated in the last few years. Due to the advent of new technologies, devices, and communication

More information

Abstract. The Challenges. ESG Lab Review InterSystems IRIS Data Platform: A Unified, Efficient Data Platform for Fast Business Insight

Abstract. The Challenges. ESG Lab Review InterSystems IRIS Data Platform: A Unified, Efficient Data Platform for Fast Business Insight ESG Lab Review InterSystems Data Platform: A Unified, Efficient Data Platform for Fast Business Insight Date: April 218 Author: Kerry Dolan, Senior IT Validation Analyst Abstract Enterprise Strategy Group

More information

Evolution For Enterprises In A Cloud World

Evolution For Enterprises In A Cloud World Evolution For Enterprises In A Cloud World Foreword Cloud is no longer an unseen, futuristic technology that proves unattainable for enterprises. Rather, it s become the norm; a necessity for realizing

More information

Agenda. AWS Database Services Traditional vs AWS Data services model Amazon RDS Redshift DynamoDB ElastiCache

Agenda. AWS Database Services Traditional vs AWS Data services model Amazon RDS Redshift DynamoDB ElastiCache Databases on AWS 2017 Amazon Web Services, Inc. and its affiliates. All rights served. May not be copied, modified, or distributed in whole or in part without the express consent of Amazon Web Services,

More information

Safe Harbor Statement

Safe Harbor Statement Safe Harbor Statement The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment

More information

From Single Purpose to Multi Purpose Data Lakes. Thomas Niewel Technical Sales Director DACH Denodo Technologies March, 2019

From Single Purpose to Multi Purpose Data Lakes. Thomas Niewel Technical Sales Director DACH Denodo Technologies March, 2019 From Single Purpose to Multi Purpose Data Lakes Thomas Niewel Technical Sales Director DACH Denodo Technologies March, 2019 Agenda Data Lakes Multiple Purpose Data Lakes Customer Example Demo Takeaways

More information

A Survey Paper on NoSQL Databases: Key-Value Data Stores and Document Stores

A Survey Paper on NoSQL Databases: Key-Value Data Stores and Document Stores A Survey Paper on NoSQL Databases: Key-Value Data Stores and Document Stores Nikhil Dasharath Karande 1 Department of CSE, Sanjay Ghodawat Institutes, Atigre nikhilkarande18@gmail.com Abstract- This paper

More information

Rule 14 Use Databases Appropriately

Rule 14 Use Databases Appropriately Rule 14 Use Databases Appropriately Rule 14: What, When, How, and Why What: Use relational databases when you need ACID properties to maintain relationships between your data. For other data storage needs

More information

TWOO.COM CASE STUDY CUSTOMER SUCCESS STORY

TWOO.COM CASE STUDY CUSTOMER SUCCESS STORY TWOO.COM CUSTOMER SUCCESS STORY With over 30 million users, Twoo.com is Europe s leading social discovery site. Twoo runs the world s largest scale-out SQL deployment, with 4.4 billion transactions a day

More information

Paper. Delivering Strong Security in a Hyperconverged Data Center Environment

Paper. Delivering Strong Security in a Hyperconverged Data Center Environment Paper Delivering Strong Security in a Hyperconverged Data Center Environment Introduction A new trend is emerging in data center technology that could dramatically change the way enterprises manage and

More information

A Make-or-Break Decision: Choosing the Right Serialization Technology for Revenue, Operational, and Brand Success

A Make-or-Break Decision: Choosing the Right Serialization Technology for Revenue, Operational, and Brand Success A Make-or-Break Decision: Choosing the Right Serialization Technology for Revenue, Operational, and Brand Success Introduction The pharmaceutical industry is on the verge of a critical turning point: as

More information

How to Lift-and-Shift a Line of Business Application onto Google Cloud Platform

How to Lift-and-Shift a Line of Business Application onto Google Cloud Platform How to Lift-and-Shift a Line of Business Application onto Google Cloud Platform by Andy Wu, Solutions Architect, Magenic White Paper How to Lift-and-Shift a Line of Business Application onto Google Cloud

More information

CompSci 516 Database Systems

CompSci 516 Database Systems CompSci 516 Database Systems Lecture 20 NoSQL and Column Store Instructor: Sudeepa Roy Duke CS, Fall 2018 CompSci 516: Database Systems 1 Reading Material NOSQL: Scalable SQL and NoSQL Data Stores Rick

More information

Building High Performance Apps using NoSQL. Swami Sivasubramanian General Manager, AWS NoSQL

Building High Performance Apps using NoSQL. Swami Sivasubramanian General Manager, AWS NoSQL Building High Performance Apps using NoSQL Swami Sivasubramanian General Manager, AWS NoSQL Building high performance apps There is a lot to building high performance apps Scalability Performance at high

More information

Performance Comparison of NOSQL Database Cassandra and SQL Server for Large Databases

Performance Comparison of NOSQL Database Cassandra and SQL Server for Large Databases Performance Comparison of NOSQL Database Cassandra and SQL Server for Large Databases Khalid Mahmood Shaheed Zulfiqar Ali Bhutto Institute of Science and Technology, Karachi Pakistan khalidmdar@yahoo.com

More information

Oracle Applications Cloud User Experience Strategy & Roadmap

Oracle Applications Cloud User Experience Strategy & Roadmap Oracle Applications Cloud User Experience Strategy & Roadmap By Jeremy Ashley, Group Vice President Oracle Applications User Experience Copyright 2017 Oracle Corporation. All Rights Reserved. Statement

More information

Architekturen für die Cloud

Architekturen für die Cloud Architekturen für die Cloud Eberhard Wolff Architecture & Technology Manager adesso AG 08.06.11 What is Cloud? National Institute for Standards and Technology (NIST) Definition On-demand self-service >

More information

Whitepaper Wishful Thinking vs. Reality in Regards to Virtual Backup and Restore Environments

Whitepaper Wishful Thinking vs. Reality in Regards to Virtual Backup and Restore Environments Whitepaper Wishful Thinking vs. Reality in Regards to Virtual Backup and Restore Environments Best practices for backing up virtual environments Table of Contents Why choose virtualization?... 3 What is

More information

NOSQL EGCO321 DATABASE SYSTEMS KANAT POOLSAWASD DEPARTMENT OF COMPUTER ENGINEERING MAHIDOL UNIVERSITY

NOSQL EGCO321 DATABASE SYSTEMS KANAT POOLSAWASD DEPARTMENT OF COMPUTER ENGINEERING MAHIDOL UNIVERSITY NOSQL EGCO321 DATABASE SYSTEMS KANAT POOLSAWASD DEPARTMENT OF COMPUTER ENGINEERING MAHIDOL UNIVERSITY WHAT IS NOSQL? Stands for No-SQL or Not Only SQL. Class of non-relational data storage systems E.g.

More information

August Oracle - GoldenGate Statement of Direction

August Oracle - GoldenGate Statement of Direction August 2015 Oracle - GoldenGate Statement of Direction Disclaimer This document in any form, software or printed matter, contains proprietary information that is the exclusive property of Oracle. Your

More information

Mega-scale Postgres How to run 1,000,000 Postgres Databases

Mega-scale Postgres How to run 1,000,000 Postgres Databases Mega-scale Postgres How to run 1,000,000 Postgres Databases Program What is Heroku & Heroku Postgres? Organizing principles for mega-scale operations Heroku Postgres Code deployment is good, but what

More information

MySQL Cluster Web Scalability, % Availability. Andrew

MySQL Cluster Web Scalability, % Availability. Andrew MySQL Cluster Web Scalability, 99.999% Availability Andrew Morgan @andrewmorgan www.clusterdb.com Safe Harbour Statement The following is intended to outline our general product direction. It is intended

More information

THE BUSINESS CASE FOR SIP

THE BUSINESS CASE FOR SIP THE BUSINESS CASE FOR SIP TIMES, THEY ARE A CHANGIN Over the past few decades, cultural and technological trends have dramatically transformed the workplace. Today, flexible working is a way of life. Employees

More information

CIO Guide: Disaster recovery solutions that work. Making it happen with Azure in the public cloud

CIO Guide: Disaster recovery solutions that work. Making it happen with Azure in the public cloud CIO Guide: Disaster recovery solutions that work Making it happen with Azure in the public cloud Consult Build Transform Support When you re considering a shift to Disaster Recovery as a service (DRaaS),

More information

Distributed Data Infrastructures, Fall 2017, Chapter 2. Jussi Kangasharju

Distributed Data Infrastructures, Fall 2017, Chapter 2. Jussi Kangasharju Distributed Data Infrastructures, Fall 2017, Chapter 2 Jussi Kangasharju Chapter Outline Warehouse-scale computing overview Workloads and software infrastructure Failures and repairs Note: Term Warehouse-scale

More information

Using the Network to Optimize a Virtualized Data Center

Using the Network to Optimize a Virtualized Data Center Using the Network to Optimize a Virtualized Data Center Contents Section I: Introduction The Rise of Virtual Computing. 1 Section II: The Role of the Network. 3 Section III: Network Requirements of the

More information

Comparing SQL and NOSQL databases

Comparing SQL and NOSQL databases COSC 6397 Big Data Analytics Data Formats (II) HBase Edgar Gabriel Spring 2014 Comparing SQL and NOSQL databases Types Development History Data Storage Model SQL One type (SQL database) with minor variations

More information

Chapter 24 NOSQL Databases and Big Data Storage Systems

Chapter 24 NOSQL Databases and Big Data Storage Systems Chapter 24 NOSQL Databases and Big Data Storage Systems - Large amounts of data such as social media, Web links, user profiles, marketing and sales, posts and tweets, road maps, spatial data, email - NOSQL

More information

DATABASE SCALE WITHOUT LIMITS ON AWS

DATABASE SCALE WITHOUT LIMITS ON AWS The move to cloud computing is changing the face of the computer industry, and at the heart of this change is elastic computing. Modern applications now have diverse and demanding requirements that leverage

More information

Elevate the Conversation: Put IT Resilience into Practice for Cloud Service Providers

Elevate the Conversation: Put IT Resilience into Practice for Cloud Service Providers Elevate the Conversation: Put IT Resilience into Practice for Cloud Service Providers Don Wales, VP, Global Cloud Sales Mariah West, Director, Global Marketing Programs & Operations IT Resilience Protect

More information

Cloud Computing: Making the Right Choice for Your Organization

Cloud Computing: Making the Right Choice for Your Organization Cloud Computing: Making the Right Choice for Your Organization A decade ago, cloud computing was on the leading edge. Now, 95 percent of businesses use cloud technology, and Gartner says that by 2020,

More information

Scaling for Humongous amounts of data with MongoDB

Scaling for Humongous amounts of data with MongoDB Scaling for Humongous amounts of data with MongoDB Alvin Richards Technical Director, EMEA alvin@10gen.com @jonnyeight alvinonmongodb.com From here... http://bit.ly/ot71m4 ...to here... http://bit.ly/oxcsis

More information

Review - Relational Model Concepts

Review - Relational Model Concepts Lecture 25 Overview Last Lecture Query optimisation/query execution strategies This Lecture Non-relational data models Source: web pages, textbook chapters 20-22 Next Lecture Revision Review - Relational

More information

Extreme Computing. NoSQL.

Extreme Computing. NoSQL. Extreme Computing NoSQL PREVIOUSLY: BATCH Query most/all data Results Eventually NOW: ON DEMAND Single Data Points Latency Matters One problem, three ideas We want to keep track of mutable state in a scalable

More information

Scalable Web Software. CS193S - Jan Jannink - 1/05/10

Scalable Web Software. CS193S - Jan Jannink - 1/05/10 Scalable Web Software CS193S - Jan Jannink - 1/05/10 Administrative Stuff Jan Jannink: jannink@stanford.edu Aditya Acharya: acharyaa@cs.stanford.edu Ed Suh: edsuh@stanford.edu virtual office hours: phone

More information

Advanced Database Technologies NoSQL: Not only SQL

Advanced Database Technologies NoSQL: Not only SQL Advanced Database Technologies NoSQL: Not only SQL Christian Grün Database & Information Systems Group NoSQL Introduction 30, 40 years history of well-established database technology all in vain? Not at

More information

Migrating Oracle Databases To Cassandra

Migrating Oracle Databases To Cassandra BY UMAIR MANSOOB Why Cassandra Lower Cost of ownership makes it #1 choice for Big Data OLTP Applications. Unlike Oracle, Cassandra can store structured, semi-structured, and unstructured data. Cassandra

More information

MongoDB Schema Design for. David Murphy MongoDB Practice Manager - Percona

MongoDB Schema Design for. David Murphy MongoDB Practice Manager - Percona MongoDB Schema Design for the Click "Dynamic to edit Master Schema" title World style David Murphy MongoDB Practice Manager - Percona Who is this Person and What Does He Know? Former MongoDB Master Former

More information

מרכז התמחות DBA. NoSQL and MongoDB תאריך: 3 דצמבר 2015 מציג: רז הורוביץ, ארכיטקט מרכז ההתמחות

מרכז התמחות DBA. NoSQL and MongoDB תאריך: 3 דצמבר 2015 מציג: רז הורוביץ, ארכיטקט מרכז ההתמחות מרכז התמחות DBA NoSQL and MongoDB תאריך: 3 דצמבר 2015 מציג: רז הורוביץ, ארכיטקט מרכז ההתמחות Raziel.Horovitz@tangram-soft.co.il Matrix IT work Copyright 2013. Do not remove source or Attribution from any

More information

Sony Adopts Cisco Solution for Global IPv6 Project

Sony Adopts Cisco Solution for Global IPv6 Project Customer Case Study Sony Adopts Cisco Solution for Global IPv6 Project Sony aims to accelerate global collaboration and business across business units to realize goal of "One Sony." EXECUTIVE SUMMARY Customer

More information

CISC 7610 Lecture 5 Distributed multimedia databases. Topics: Scaling up vs out Replication Partitioning CAP Theorem NoSQL NewSQL

CISC 7610 Lecture 5 Distributed multimedia databases. Topics: Scaling up vs out Replication Partitioning CAP Theorem NoSQL NewSQL CISC 7610 Lecture 5 Distributed multimedia databases Topics: Scaling up vs out Replication Partitioning CAP Theorem NoSQL NewSQL Motivation YouTube receives 400 hours of video per minute That is 200M hours

More information

An Introduction to Big Data Formats

An Introduction to Big Data Formats Introduction to Big Data Formats 1 An Introduction to Big Data Formats Understanding Avro, Parquet, and ORC WHITE PAPER Introduction to Big Data Formats 2 TABLE OF TABLE OF CONTENTS CONTENTS INTRODUCTION

More information

Introduction Aggregate data model Distribution Models Consistency Map-Reduce Types of NoSQL Databases

Introduction Aggregate data model Distribution Models Consistency Map-Reduce Types of NoSQL Databases Introduction Aggregate data model Distribution Models Consistency Map-Reduce Types of NoSQL Databases Key-Value Document Column Family Graph John Edgar 2 Relational databases are the prevalent solution

More information

International Journal of Informative & Futuristic Research ISSN:

International Journal of Informative & Futuristic Research ISSN: www.ijifr.com Volume 5 Issue 8 April 2018 International Journal of Informative & Futuristic Research ISSN: 2347-1697 TRANSITION FROM TRADITIONAL DATABASES TO NOSQL DATABASES Paper ID IJIFR/V5/ E8/ 010

More information

Data Replication Buying Guide

Data Replication Buying Guide Data Replication Buying Guide 1 How to Choose a Data Replication Solution IT professionals are increasingly turning to heterogenous data replication to modernize data while avoiding the costs and risks

More information

ENTERPRISE DATA STRATEGY IN THE HEALTHCARE LANDSCAPE

ENTERPRISE DATA STRATEGY IN THE HEALTHCARE LANDSCAPE ENTERPRISE DATA STRATEGY IN THE HEALTHCARE LANDSCAPE MARKLOGIC WHITE PAPER The healthcare landscape is changing. Heightened competition and risk in this evolving environment demands an enterprise data

More information

Big Data Analytics. Rasoul Karimi

Big Data Analytics. Rasoul Karimi Big Data Analytics Rasoul Karimi Information Systems and Machine Learning Lab (ISMLL) Institute of Computer Science University of Hildesheim, Germany Big Data Analytics Big Data Analytics 1 / 1 Outline

More information

Oracle Autonomous Database

Oracle Autonomous Database Oracle Autonomous Database Maria Colgan Master Product Manager Oracle Database Development August 2018 @SQLMaria #thinkautonomous Safe Harbor Statement The following is intended to outline our general

More information

Hyper-Converged Infrastructure: Providing New Opportunities for Improved Availability

Hyper-Converged Infrastructure: Providing New Opportunities for Improved Availability Hyper-Converged Infrastructure: Providing New Opportunities for Improved Availability IT teams in companies of all sizes face constant pressure to meet the Availability requirements of today s Always-On

More information

NOSQL OPERATIONAL CHECKLIST

NOSQL OPERATIONAL CHECKLIST WHITEPAPER NOSQL NOSQL OPERATIONAL CHECKLIST NEW APPLICATION REQUIREMENTS ARE DRIVING A DATABASE REVOLUTION There is a new breed of high volume, highly distributed, and highly complex applications that

More information

Enterprise Findability Without the Complexity

Enterprise Findability Without the Complexity Enterprise Findability Without the Complexity With the clutter of information inside enterprises today, effective findability 1 is fast becoming a necessity. Users are asking for it and executives are

More information

Sql Server Compare Two Tables To Find Differences

Sql Server Compare Two Tables To Find Differences Sql Server Compare Two Tables To Find Differences compare and find differences for SQL Server tables and data When the User set two Employees ID (for example : 1 & 2) the program is supposed to show. Ways

More information

MySQL Group Replication. Bogdan Kecman MySQL Principal Technical Engineer

MySQL Group Replication. Bogdan Kecman MySQL Principal Technical Engineer MySQL Group Replication Bogdan Kecman MySQL Principal Technical Engineer Bogdan.Kecman@oracle.com 1 Safe Harbor Statement The following is intended to outline our general product direction. It is intended

More information

The Future of Interoperability: Emerging NoSQLs Save Time, Increase Efficiency, Optimize Business Processes, and Maximize Database Value

The Future of Interoperability: Emerging NoSQLs Save Time, Increase Efficiency, Optimize Business Processes, and Maximize Database Value The Future of Interoperability: Emerging NoSQLs Save Time, Increase Efficiency, Optimize Business Processes, and Maximize Database Value Author: Tim Dunnington Director of Interoperability, Informatics

More information

NoSQL Database Comparison: Bigtable, Cassandra and MongoDB CJ Campbell Brigham Young University October 16, 2015

NoSQL Database Comparison: Bigtable, Cassandra and MongoDB CJ Campbell Brigham Young University October 16, 2015 Running Head: NOSQL DATABASE COMPARISON: BIGTABLE, CASSANDRA AND MONGODB NoSQL Database Comparison: Bigtable, Cassandra and MongoDB CJ Campbell Brigham Young University October 16, 2015 1 INTRODUCTION

More information

DEMYSTIFYING BIG DATA WITH RIAK USE CASES. Martin Schneider Basho Technologies!

DEMYSTIFYING BIG DATA WITH RIAK USE CASES. Martin Schneider Basho Technologies! DEMYSTIFYING BIG DATA WITH RIAK USE CASES Martin Schneider Basho Technologies! Agenda Defining Big Data in Regards to Riak A Series of Trade-Offs Use Cases Q & A About Basho & Riak Basho Technologies is

More information

Megastore: Providing Scalable, Highly Available Storage for Interactive Services & Spanner: Google s Globally- Distributed Database.

Megastore: Providing Scalable, Highly Available Storage for Interactive Services & Spanner: Google s Globally- Distributed Database. Megastore: Providing Scalable, Highly Available Storage for Interactive Services & Spanner: Google s Globally- Distributed Database. Presented by Kewei Li The Problem db nosql complex legacy tuning expensive

More information

Distributed Databases: SQL vs NoSQL

Distributed Databases: SQL vs NoSQL Distributed Databases: SQL vs NoSQL Seda Unal, Yuchen Zheng April 23, 2017 1 Introduction Distributed databases have become increasingly popular in the era of big data because of their advantages over

More information

SQL Gone Wild: Taming Bad SQL the Easy Way (or the Hard Way) Sergey Koltakov Product Manager, Database Manageability

SQL Gone Wild: Taming Bad SQL the Easy Way (or the Hard Way) Sergey Koltakov Product Manager, Database Manageability SQL Gone Wild: Taming Bad SQL the Easy Way (or the Hard Way) Sergey Koltakov Product Manager, Database Manageability Oracle Enterprise Manager Top-Down, Integrated Application Management Complete, Open,

More information

BUT HOW DID THE CLOUD AS WE KNOW IT COME TO BE AND WHERE IS IT GOING?

BUT HOW DID THE CLOUD AS WE KNOW IT COME TO BE AND WHERE IS IT GOING? A DECADE OF CLOUD CLOUD COMPUTING: A WORLD-CHANGING INNOVATION When one considers technology having a profound impact on humanity, a number of major innovations such as electricity, the gas engine, airplanes,

More information

Copyright 2018, Oracle and/or its affiliates. All rights reserved.

Copyright 2018, Oracle and/or its affiliates. All rights reserved. Beyond SQL Tuning: Insider's Guide to Maximizing SQL Performance Monday, Oct 22 10:30 a.m. - 11:15 a.m. Marriott Marquis (Golden Gate Level) - Golden Gate A Ashish Agrawal Group Product Manager Oracle

More information

MySQL Performance Improvements

MySQL Performance Improvements Taking Advantage of MySQL Performance Improvements Baron Schwartz, Percona Inc. Introduction About Me (Baron Schwartz) Author of High Performance MySQL 2 nd Edition Creator of Maatkit, innotop, and so

More information

Topics. Big Data Analytics What is and Why Hadoop? Comparison to other technologies Hadoop architecture Hadoop ecosystem Hadoop usage examples

Topics. Big Data Analytics What is and Why Hadoop? Comparison to other technologies Hadoop architecture Hadoop ecosystem Hadoop usage examples Hadoop Introduction 1 Topics Big Data Analytics What is and Why Hadoop? Comparison to other technologies Hadoop architecture Hadoop ecosystem Hadoop usage examples 2 Big Data Analytics What is Big Data?

More information

Oracle Application Container Cloud

Oracle Application Container Cloud Oracle Application Container Cloud Matthew Baldwin Principal Product Manager Safe Harbor Statement The following is intended to outline our general product direction. It is intended for information purposes

More information