Dr. Chuck Cartledge. 3 Dec. 2015

Similar documents
Dr. Chuck Cartledge. 19 Nov. 2015

Dr. Chuck Cartledge. 5 Nov. 2015

Dr. Chuck Cartledge. 14 Sept. 2015

Dr. Chuck Cartledge. 1 Oct. 2015

ICALEPS 2013 Exploring No-SQL Alternatives for ALMA Monitoring System ADC

Using Oracle NoSQL Database Workshop Ed 1

Final Exam Review 2. Kathleen Durant CS 3200 Northeastern University Lecture 23

Study of NoSQL Database Along With Security Comparison

NoSQL systems. Lecture 21 (optional) Instructor: Sudeepa Roy. CompSci 516 Data Intensive Computing Systems

Beyond Relational Databases: MongoDB, Redis & ClickHouse. Marcos Albe - Principal Support Percona

Dr. Chuck Cartledge. 18 Feb. 2015

Relational databases

MongoDB Distributed Write and Read

Modern Database Concepts

Big Data Management and NoSQL Databases

Introduction Aggregate data model Distribution Models Consistency Map-Reduce Types of NoSQL Databases

Invitation to a New Kind of Database. Sheer El Showk Cofounder, Lore Ai We re Hiring!

Document Sub Title. Yotpo. Technical Overview 07/18/ Yotpo

CIB Session 12th NoSQL Databases Structures

NoSQL Databases Analysis

Building an on premise Kubernetes cluster DANNY TURNER

Common MySQL Scalability Mistakes AUTHOR

CA485 Ray Walshe NoSQL

When does RDBMS representation make sense When do other representations make sense. Prerequisites: CS 450/550 Database Concepts

Database Solution in Cloud Computing

DEMYSTIFYING BIG DATA WITH RIAK USE CASES. Martin Schneider Basho Technologies!

Putting together the platform: Riak, Redis, Solr and Spark. Bryan Hunt

NoSQL Databases. CPS352: Database Systems. Simon Miner Gordon College Last Revised: 4/22/15

Extreme Computing. NoSQL.

FAQs Snapshots and locks Vector Clock

Introduction Storage Processing Monitoring Review. Scaling at Showyou. Operations. September 26, 2011

MongoDB and Mysql: Which one is a better fit for me? Room 204-2:20PM-3:10PM

Introduction to Data Management. Lecture #2 (Big Picture, Cont.)

CS 655 Advanced Topics in Distributed Systems

Scaling. Marty Weiner Grayskull, Eternia. Yashh Nelapati Gotham City

ZooKeeper & Curator. CS 475, Spring 2018 Concurrent & Distributed Systems

Hands-on immersion on Big Data tools

Scalability of web applications

State of the Dolphin Developing new Apps in MySQL 8

Topics. History. Architecture. MongoDB, Mongoose - RDBMS - SQL. - NoSQL

Shen PingCAP 2017

Introduction to Big Data. NoSQL Databases. Instituto Politécnico de Tomar. Ricardo Campos

June 20, 2017 Revision NoSQL Database Architectural Comparison

NoSQL Databases An efficient way to store and query heterogeneous astronomical data in DACE. Nicolas Buchschacher - University of Geneva - ADASS 2018

Realtime visitor analysis with Couchbase and Elasticsearch

How do we build TiDB. a Distributed, Consistent, Scalable, SQL Database

CS352 Lecture: Database System Architectures last revised 11/22/06

Key Value Store. Yiding Wang, Zhaoxiong Yang

CS122 Lecture 3 Winter Term,

MariaDB MaxScale 2.0, basis for a Two-speed IT architecture

ITG Software Engineering

8/3/17. Encryption and Decryption centralized Single point of contact First line of defense. Bishop

2017 GridGain Systems, Inc. In-Memory Performance Durability of Disk

4/9/2018 Week 13-A Sangmi Lee Pallickara. CS435 Introduction to Big Data Spring 2018 Colorado State University. FAQs. Architecture of GFS

CS 445 Introduction to Database Systems

Seven Databases In Seven Weeks 2e

GridGain and Apache Ignite In-Memory Performance with Durability of Disk

Cassandra- A Distributed Database

Perspectives on NoSQL

MongoDB Schema Design for. David Murphy MongoDB Practice Manager - Percona

Cassandra Design Patterns

Introduction to Data Management. Lecture #2 (Big Picture, Cont.) Instructor: Chen Li

Deploying a Highly Available Distributed Caching Layer on Oracle Cloud Infrastructure using Memcached & Redis

Switching to Innodb from MyISAM. Matt Yonkovit Percona

Agenda. AWS Database Services Traditional vs AWS Data services model Amazon RDS Redshift DynamoDB ElastiCache

Comparing SQL and NOSQL databases

High-Level Data Models on RAMCloud

Advanced Databases ( CIS 6930) Fall Instructor: Dr. Markus Schneider. Group 17 Anirudh Sarma Bhaskara Sreeharsha Poluru Ameya Devbhankar

TALK 1: CONVINCE YOUR BOSS: CHOOSE THE "RIGHT" DATABASE. Prof. Dr. Stefan Edlich Beuth University of Technology Berlin (App.Sc.)

Hadoop. Course Duration: 25 days (60 hours duration). Bigdata Fundamentals. Day1: (2hours)

Spread the Database Love with Heterogeneous Replication. MC Brown, VP, Products

Course Content MongoDB

CompSci 516 Database Systems

Distributed Computation Models

SCALABLE DATABASES. Sergio Bossa. From Relational Databases To Polyglot Persistence.

Redis to the Rescue? O Reilly MySQL Conference

PROGRESS OPENEDGE PRO2

Distributed Data Store

A short-term plan for Redis

Amazon AWS-Solution-Architect-Associate Exam

Managing IoT and Time Series Data with Amazon ElastiCache for Redis

CIT 668: System Architecture. Amazon Web Services

Accelerate MySQL for Demanding OLAP and OLTP Use Cases with Apache Ignite. Peter Zaitsev, Denis Magda Santa Clara, California April 25th, 2017

Introduction to Hadoop. High Availability Scaling Advantages and Challenges. Introduction to Big Data

A Survey Paper on NoSQL Databases: Key-Value Data Stores and Document Stores

DHRUBA BORTHAKUR, ROCKSET PRESENTED AT PERCONA-LIVE, APRIL 2017 ROCKSDB CLOUD

CSE 344 Final Review. August 16 th

CISC 7610 Lecture 2b The beginnings of NoSQL

Big Data Infrastructure CS 489/698 Big Data Infrastructure (Winter 2017)

Oracle Database 18c and Autonomous Database

L22: NoSQL. CS3200 Database design (sp18 s2) 4/5/2018 Several slides courtesy of Benny Kimelfeld

Rule 14 Use Databases Appropriately

Dr. Chuck Cartledge. 18 Mar. 2015

Hibernate Search Googling your persistence domain model. Emmanuel Bernard Doer JBoss, a division of Red Hat

Projected by: LUKA CECXLADZE BEQA CHELIDZE Superviser : Nodar Momtsemlidze

Apache Kudu. Zbigniew Baranowski

HBase vs Neo4j. Technical overview. Name: Vladan Jovičić CR09 Advanced Scalable Data (Fall, 2017) Ecolé Normale Superiuere de Lyon

/ Cloud Computing. Recitation 6 October 2 nd, 2018

MongoDB Architecture

Large-Scale Key-Value Stores Eventual Consistency Marco Serafini

Transcription:

CS-695 NoSQL Database Redis (part 2 of 2) Dr. Chuck Cartledge 3 Dec. 2015 1/14

Table of contents I 1 Miscellanea 2 DB comparisons 3 Assgn. #7 4 Misc. things 6 Course review 7 Conclusion 8 References 5 Summary 2/14

Corrections and additions since last lecture. Assignment #07 is over due by today 3/14

How different DBs compare to a RDBMS We have some terms to compare now[1] RDBMS K/V Columnar Doc. Graphic Redis DB. instance cluster cluster instance database namespace id table bucket table collection row key-value row document node id key-value rowid key id key col. col. fam. key schema database join DBRef INT rel. id 4/14

Words of explanation. The full text is available at: http://www.cs.odu.edu/~ccartled/teaching/2015-fall/nosql/assignments/07 In general terms: 1 Design the database, particularially the definition of a key 2 Parse data 3 Populate the database 4 Query the database using the keys 5 Manipulate the results (may be minimal based on how keys are defined) 6 Plot data 5/14

A collection of things that are nice to know Durability 1 By default, Redis is memory resident. Data can be snapshotted under user control Format: save seconds number keys Example: save 900 1 Example: save 60 10000 All write directives are maintained in an Append-Only File when server starts, the AOF file is re-executed All save directives are independent. 1 http://redis.io/topics/persistence 6/14

A collection of things that are nice to know Security Redis is designed to be accessed by trusted clients inside trusted environments. 2 Network security (trusted clients, ACL, etc.) Thin protection via AUTH commands Disabling of specific commands via obfuscation Snapshot files can be written anywhere, so they make all internal data vulnerable In general, Redis is not optimized for maximum security but for maximum performance and simplicity. 2 http://redis.io/topics/security 7/14

A collection of things that are nice to know Replication Slave has an exact copy of the master. Writes to master are propagated to the slave(s) Slaves are read-only by default When master is lost, slave can be promoted to master Image from [2]. Allows upgrades to master with minimal downtime (may be 0). 8/14

A collection of things that are nice to know Clustering via Redis Sentinel 3 Monitoring constantly checks if your master and slave instances are working as expected. Notification Sentinel can notify the system administrator, another computer programs, via an API, that something is wrong with one of the monitored Redis instances. Automatic fail over if a master is not working as expected, Sentinel can start a fail over process where a slave is promoted to master, the other additional slaves are reconfigured to use the new master, and the applications using the Redis server informed about the new address to use when connecting. Configuration provider Sentinel acts as a source of authority for clients service discovery: clients connect to Sentinels in order to ask for the address of the current Redis master responsible for a given service. If a fail over occurs, Sentinels will report the new address. 3 http://redis.io/topics/sentinel 9/14

Strengths and weaknesses Good and not so good Strengths: It is fast Supports interesting search capabilities and operations on keys and values The user controls when data is persisted It is memory resident Master-slave relationship supports eventual replication Lots of commands for interacting with keys and values Weaknesses: It is memory resident The user controls when data is persisted (data vulnerable if memory resident before persisted) Does not (deliberately) use virtual memory. Goal is speed. 10/14

Applicabilities Good for, and not so good for Good fit; Manipulating in memory data structures (leaderboards, order by user votes/time, unique N items, real-time analysis) Publisher/subscriber systems Queues All things cache related Not so good fit: Exotic data queries Redis is an in-memory data structure server. 11/14

Things that we covered Databases, queries, presentations We covered several database technologies (RDBMS, K/V, columnar, document, graphic, and data structure), their strengths and weaknesses, and where each is a good (or not so good) fit. We covered different data presentations (Sarah and Hasta), and some of the strengths and weaknesses of each. We added tools to our tool bag. 12/14

What have we covered? Reviewed assignment #07 Reviewed the course Next time: We will cover different topics. 13/14

References I [1] Eric Redmond and Jim R Wilson, Seven databases in seven weeks, Pragmatic Bookshelf, 2012. [2] Packt Staff, Implementing persistence in redis, 2015. 14/14