Cassandra- A Distributed Database

Size: px
Start display at page:

Download "Cassandra- A Distributed Database"

Transcription

1 Cassandra- A Distributed Database Tulika Gupta Department of Information Technology Poornima Institute of Engineering and Technology Jaipur, Rajasthan, India Abstract- A relational database is a traditional database which works on table based architecture. Due to relational system, there is no facility of scalability and also no concept of data replication is available. These problems in a relational database lead to the development of non relational database also called as NOSQL. This paper analyzes the need of NOSQL database and presents an architectural overview of Cassandra. It explains the merits of Cassandra i.e. how it is able to handle huge amount of data, which is always a big issue with relational database like MYSQL and ORACLE etc. Keywords- Cassandra, No SQL, RDBMS, Scalability I. Introduction Today we are living in the world of data. Data is present in each and every organization and it is very crucial to manage and preserve this data. Loss of single data entity can result in massive loss. If we talk of the social world, we can find out the ultimate data.the various social media sites like Facebook, twitter, etc have millions of crucial data to be stored and preserved and loss of even.05% data is not compensated. Also the data available at these data centres is in such a bulk that the access mechanism needs to be very efficient to handle this bulky and important data. We have our very common relational database which is popularly used all over the world to manage various kinds of data and information. Relational database management systems work on relational models which were introduced by Mr E.F CODD. It always works on tabular format of data where relationships are enforced within the tables. The major problem with this database management system is that it cannot handle scalability i.e. it cannot handle continuous growth of data at a single point of time and requires a lot of processing to scale bulk of data so as to retrieve data quickly and efficiently. Also many applications do not need data to be informed of related table that use SQL to perform any sort of applications on data. They recommend data to be stored in form of objects and documents that can be retrieved with the help of key. We can never think of RDBMS like DB2, ORACLE and MYSQL to handle data of social sites. So another type of database called NOSQL is present to solve the problems such as scalability, schema free and replication support etc. Cassandra is one of database model of NOSQL that supports all such features and is highly reliable. Apache Cassandra is an open source distributed database system that is designed for storing and managing large amount of data across multiple servers. It can serve as a real time operational data for store online transactional application as well as a read intensive database for a large scale business intelligence system. Apache Cassandra was developed at Facebook in the year 2008 based on Amazon s dynamo and Google s big table concept. It is written in java and support programming languages such as C#, C++, DOJURE, ERLANG, HASKELL, JAVA, JAVASCRIPT, PERL, PHP, PYTHON, RUBY and SCALA. Cassandra is one of the right choices when you need scalability and high availability without any compromise in performance. One of its best features is automatic replication facility. So there is no single point of failure. The data gets replicated across multiple data centres. This is a highly scalable database and a decentralized data sore which can be easily scaled up by adding hardware nodes to system to offer high fault tolerance. ISSN: Page 216

2 It is designed on the principle of peer to peer symmetric nodes to avoid single failure point unlike RDBMS which works on master and slave method. The master less ring design is elegant, easy to setup and thus is easy to maintain. Cassandra works on CQL(Cassandra query language) which is very similar to SQL with respect to syntax.cql is supported in the CQL command line client installed with Cassandra. Cassandra supported CQL (Cassandra Query Language) which is an efficient query language. B. Architecture Overview Cassandra is designed in such a way that it is able to offer continuous uptime. Figure1 shows the ring architecture of Cassandra. II. Apache Cassandra Cassandra is a new distributed data system which handles the complete data of Facebook. It is an open source database management system that provides continuous data availability, scalability, performance and distribution of data easily across multiple servers. Cassandra works on the ideology of peer to peer architecture. The data is automatically partitioned across multiple nodes with the use of consistent hashing. This preserves the database from the single point of failure. The goal of scalability is easily achievable by just adding more nodes o the cluster. Cassandra supports rich data structure and efficient query language. Fig.1.Cassandra s master less ring architecture Unlike RDBMS which supports master slave architecture, Cassandra has a ring architecture which is master less. It is easy to setup and maintain. Here all nodes play the same role and nodes communicate each other through a gossip protocol. C. Writing and Reading Data A. Key features and benefits Many numbers of key features and benefits are provided by Cassandra for using it as an efficient database for applications: It has a scalable architecture and supports a master less design i.e. all nodes have same position and there is no concept of master and slave. All nodes work actively so data can be written to and read from all nodes. Nodes can be easily added without any down time. The database is continuously available and there is automatic redundancy facility. All the modern data types are supported with fast reads and writes facility. Data can be compressed up to 80% without any overheads. Cassandra shows efficient performance in reading as well writing data. Data is written in a manner such that high durability and high performance can be gained. Firstly, data written on node is recorded on a disk called as commit log. It is then transferred to memory structure. It is called a memtable. When size of memtable is full, the data is written on an immutable file called as sstable. As the operation is sequential, megabytes of Input Output operations can be performed at a same time with no delay. Figure2 shows the right path of Cassandra ISSN: Page 217

3 Write data D. Data Distribution and Replication Relational databases required to replicate data manually across several machines. Cassandra distributes data automatically. Commit log Index SSTable It has an internal component known as partitoner. Partitoner decides the method of how to distribute data across nodes. It uses hashing table to replicate the data. Cassandra automatically maintains balance of data along cluster so that whenever a new node is added or existing is removed, the balance is maintained. Fig.2. Cassandra s Write Path For reading the data, many processes are initiated by Cassandra to increase the read response time for a read request, a memory data structure called bloom filter is used to check probability of SSTable. Bloom filter informs that data is available or not. If data is present, Cassandra moves to memory cache layer and retrieves the compressed data. If not found, then the next SSTable is searched for the data and the same process repeats again. III. Data Management Components This section explains Cassandra s data model and its attributes. A. Cassandra Data Model Cassandra works in the format of key value store. Data can be queried only by the help of keys and there is no support for joining queries. Column: It is the lowest unit of data. It contains a name, value and a timestamp. Column Name: byte[] Value: byte[] Clock: clock[] Read Request Fig.4. Column Structure Bloom Filter Compression Offset struct Column { 1: binary name, 2: binary value, 3: i64 timestamp, } Cache DATA Memory Here, name represents the name of column and the value represents its attributes and the timestamp shows the information about time. Row: It is a uniquely identifiable data which maintains integrity in the data. Each row possesses Return Result Fig.3. Cassandra s Read Path Column Family: It consists of keyed rows to together with the columns i.e. it acts as a container for all the columns present in a table. ISSN: Page 218

4 Row key 1 Column 1 Column 2 Column 3 Value 1 Value 2 Value 3 Row key 2 Column 1 Column 4 Value 1 Value 4 Fig.5. Column Family Key space: It is the container of column families. All the column families are configured within key space. Key space Column Family Column Family. B. Distributed Hash Tables For distributed, decentralized database, hash tables are used. Each key value pair is stored in the database and any node can retrieve the data with the help of keys. Hash tables can scale any number of available nodes and can handle the continuous arrival of new nodes as well as departure or failure of any nodes. IV. Cassandra Query Language The communication in Cassandra database is entertained with the help of the primary language called as Cassandra Query Language. With the help of CQL shell i.e. cqlsh, interaction with Cassandra can be made. With the help of cqlsh, the tables and the keyspaces can be created. It helps in creating the schema, insertion of data and execution of the query. It works same as SQL and has almost all the commands same as SQL query language. V. Comparison between Cassandra and Relational Databases Fig.6. Key space RDBS can handle moderate incoming data velocity whereas Cassandra can handle high incoming data velocity. ISSN: Page 219

5 In RDBMS, data arrives from one or few locations, and in Cassandra data can arrive from numerous locations. RDBMS can manage only the primary structured data and in comparison, Cassandra can manage any and all type of data. Due to master slave architecture, RDBMS has a single point of failure but unlike this Cassandra works on ring architecture and so there is no single failure point and database is constantly up. In RDBMS, the deployments are centralized whereas in Cassandra, the deployment is decentralized. Cassandra can support high data volumes but RDBMS can support only moderate data volumes. Nested and complex transactions are supported in RDBMS but Cassandra can work with only simple queries. In RDBMS, data is written at only one location, but unlike this in Cassandra the data can be written at multiple locations. The scalability is provided at only read level in RDBMS whereas in Cassandra both read and write scalability are provided. With so many merits over RDBMS, Cassandra can be considered to be more beneficial in many respects. VI. Conclusion This paper has provided an overview of Cassandra and the principles on which it works. Cassandra s complete architecture is being discussed i.e. how read and write operations are performed. Also, the contrast has been provided throughout the research paper between Cassandra and relational databases. From the entire discussion it can be easily concluded that Cassandra provides efficient scalability and high update with low latency and is widely used. VII. References [1] Misc. Authors Apache Cassandra 0.6.3Java Source Code Available from [2] F. Chang, J. Dean, S. Ghemawat, W. C. Hsieh, D. A. Wallach, M. Burrows, T. Chandra, A. Fikes, and R. E. Gruber, Bigtable: A Distributed Storage System for Structured Data OSDI 06: Seventh Symposium on Operating System Design and Implementation, 2006, Seattle, WA, [3] G. DeCandia, D. Hastorun, M. Jampani, G. Kakulapati, A. Lakshman, A. Pilchin, S. Sivasubramanian, P. Vosshall, and W. Vogels, Dynamo: Amazons Highly Available Keyvalue Store In Proceedings of twenty-first ACM SIGOPS symposium on Operating systems principles (2007), ACM Press New York, NY, USA, pp [4] A. Lakshman, P. Malik, Cassandra - A Decentralized Structured Storage System, Cornell, 2009 [5] M. Slee, A. Agarwal, M. Kwiatkowski, Thrift: Scalable Cross-Language Services Implementation Facebook, Palo Alto, CA, 2007 [6] R. Tavory, Hector a Java Cassandra ISSN: Page 220

A Review to the Approach for Transformation of Data from MySQL to NoSQL

A Review to the Approach for Transformation of Data from MySQL to NoSQL A Review to the Approach for Transformation of Data from MySQL to NoSQL Monika 1 and Ashok 2 1 M. Tech. Scholar, Department of Computer Science and Engineering, BITS College of Engineering, Bhiwani, Haryana

More information

L22: NoSQL. CS3200 Database design (sp18 s2) 4/5/2018 Several slides courtesy of Benny Kimelfeld

L22: NoSQL. CS3200 Database design (sp18 s2)   4/5/2018 Several slides courtesy of Benny Kimelfeld L22: NoSQL CS3200 Database design (sp18 s2) https://course.ccs.neu.edu/cs3200sp18s2/ 4/5/2018 Several slides courtesy of Benny Kimelfeld 2 Outline 3 Introduction Transaction Consistency 4 main data models

More information

A Cloud Storage Adaptable to Read-Intensive and Write-Intensive Workload

A Cloud Storage Adaptable to Read-Intensive and Write-Intensive Workload DEIM Forum 2011 C3-3 152-8552 2-12-1 E-mail: {nakamur6,shudo}@is.titech.ac.jp.,., MyCassandra, Cassandra MySQL, 41.4%, 49.4%.,, Abstract A Cloud Storage Adaptable to Read-Intensive and Write-Intensive

More information

CSE-E5430 Scalable Cloud Computing Lecture 9

CSE-E5430 Scalable Cloud Computing Lecture 9 CSE-E5430 Scalable Cloud Computing Lecture 9 Keijo Heljanko Department of Computer Science School of Science Aalto University keijo.heljanko@aalto.fi 15.11-2015 1/24 BigTable Described in the paper: Fay

More information

NOSQL DATABASE PERFORMANCE BENCHMARKING - A CASE STUDY

NOSQL DATABASE PERFORMANCE BENCHMARKING - A CASE STUDY STUDIA UNIV. BABEŞ BOLYAI, INFORMATICA, Volume LXIII, Number 1, 2018 DOI: 10.24193/subbi.2018.1.06 NOSQL DATABASE PERFORMANCE BENCHMARKING - A CASE STUDY CAMELIA-FLORINA ANDOR AND BAZIL PÂRV Abstract.

More information

Bigtable. Presenter: Yijun Hou, Yixiao Peng

Bigtable. Presenter: Yijun Hou, Yixiao Peng Bigtable Fay Chang, Jeffrey Dean, Sanjay Ghemawat, Wilson C. Hsieh, Deborah A. Wallach Mike Burrows, Tushar Chandra, Andrew Fikes, Robert E. Gruber Google, Inc. OSDI 06 Presenter: Yijun Hou, Yixiao Peng

More information

The material in this lecture is taken from Dynamo: Amazon s Highly Available Key-value Store, by G. DeCandia, D. Hastorun, M. Jampani, G.

The material in this lecture is taken from Dynamo: Amazon s Highly Available Key-value Store, by G. DeCandia, D. Hastorun, M. Jampani, G. The material in this lecture is taken from Dynamo: Amazon s Highly Available Key-value Store, by G. DeCandia, D. Hastorun, M. Jampani, G. Kakulapati, A. Lakshman, A. Pilchin, S. Sivasubramanian, P. Vosshall,

More information

DEMYSTIFYING BIG DATA WITH RIAK USE CASES. Martin Schneider Basho Technologies!

DEMYSTIFYING BIG DATA WITH RIAK USE CASES. Martin Schneider Basho Technologies! DEMYSTIFYING BIG DATA WITH RIAK USE CASES Martin Schneider Basho Technologies! Agenda Defining Big Data in Regards to Riak A Series of Trade-Offs Use Cases Q & A About Basho & Riak Basho Technologies is

More information

Column-Family Databases Cassandra and HBase

Column-Family Databases Cassandra and HBase Column-Family Databases Cassandra and HBase Kevin Swingler Google Big Table Google invented BigTableto store the massive amounts of semi-structured data it was generating Basic model stores items indexed

More information

Dynamo: Amazon s Highly Available Key-value Store

Dynamo: Amazon s Highly Available Key-value Store Dynamo: Amazon s Highly Available Key-value Store Giuseppe DeCandia, Deniz Hastorun, Madan Jampani, Gunavardhan Kakulapati, Avinash Lakshman, Alex Pilchin, Swaminathan Sivasubramanian, Peter Vosshall and

More information

CAP Theorem, BASE & DynamoDB

CAP Theorem, BASE & DynamoDB Indian Institute of Science Bangalore, India भ रत य व ज ञ न स स थ न ब गल र, भ रत DS256:Jan18 (3:1) Department of Computational and Data Sciences CAP Theorem, BASE & DynamoDB Yogesh Simmhan Yogesh Simmhan

More information

Cassandra Design Patterns

Cassandra Design Patterns Cassandra Design Patterns Sanjay Sharma Chapter No. 1 "An Overview of Architecture and Data Modeling in Cassandra" In this package, you will find: A Biography of the author of the book A preview chapter

More information

PROFESSIONAL. NoSQL. Shashank Tiwari WILEY. John Wiley & Sons, Inc.

PROFESSIONAL. NoSQL. Shashank Tiwari WILEY. John Wiley & Sons, Inc. PROFESSIONAL NoSQL Shashank Tiwari WILEY John Wiley & Sons, Inc. Examining CONTENTS INTRODUCTION xvil CHAPTER 1: NOSQL: WHAT IT IS AND WHY YOU NEED IT 3 Definition and Introduction 4 Context and a Bit

More information

ADVANCED DATABASES CIS 6930 Dr. Markus Schneider

ADVANCED DATABASES CIS 6930 Dr. Markus Schneider ADVANCED DATABASES CIS 6930 Dr. Markus Schneider Group 2 Archana Nagarajan, Krishna Ramesh, Raghav Ravishankar, Satish Parasaram Drawbacks of RDBMS Replication Lag Master Slave Vertical Scaling. ACID doesn

More information

Apache Cassandra-The Data Storage Framework for Hadoop

Apache Cassandra-The Data Storage Framework for Hadoop Apache Cassandra-The Data Storage Framework for Hadoop Sereena.M.V 1, Zahid Ansari 2 Student, Department of mputer Science and Engineering, P. A. llege of Engineering, Mangalore, India 1. Dean Research,

More information

Enhancing the Query Performance of NoSQL Datastores using Caching Framework

Enhancing the Query Performance of NoSQL Datastores using Caching Framework Enhancing the Query Performance of NoSQL Datastores using Caching Framework Ruchi Nanda #1, Swati V. Chande *2, K.S. Sharma #3 #1,# 3 Department of CS & IT, The IIS University, Jaipur, India *2 Department

More information

NOSQL EGCO321 DATABASE SYSTEMS KANAT POOLSAWASD DEPARTMENT OF COMPUTER ENGINEERING MAHIDOL UNIVERSITY

NOSQL EGCO321 DATABASE SYSTEMS KANAT POOLSAWASD DEPARTMENT OF COMPUTER ENGINEERING MAHIDOL UNIVERSITY NOSQL EGCO321 DATABASE SYSTEMS KANAT POOLSAWASD DEPARTMENT OF COMPUTER ENGINEERING MAHIDOL UNIVERSITY WHAT IS NOSQL? Stands for No-SQL or Not Only SQL. Class of non-relational data storage systems E.g.

More information

Cassandra, MongoDB, and HBase. Cassandra, MongoDB, and HBase. I have chosen these three due to their recent

Cassandra, MongoDB, and HBase. Cassandra, MongoDB, and HBase. I have chosen these three due to their recent Tanton Jeppson CS 401R Lab 3 Cassandra, MongoDB, and HBase Introduction For my report I have chosen to take a deeper look at 3 NoSQL database systems: Cassandra, MongoDB, and HBase. I have chosen these

More information

Introduction Data Model API Building Blocks SSTable Implementation Tablet Location Tablet Assingment Tablet Serving Compactions Refinements

Introduction Data Model API Building Blocks SSTable Implementation Tablet Location Tablet Assingment Tablet Serving Compactions Refinements Fay Chang, Jeffrey Dean, Sanjay Ghemawat, Wilson C. Hsieh, Deborah A. Wallach Mike Burrows, Tushar Chandra, Andrew Fikes, Robert E. Gruber Google, Inc. M. Burak ÖZTÜRK 1 Introduction Data Model API Building

More information

Dynamo: Amazon s Highly Available Key-value Store

Dynamo: Amazon s Highly Available Key-value Store Dynamo: Amazon s Highly Available Key-value Store Giuseppe DeCandia, Deniz Hastorun, Madan Jampani, Gunavardhan Kakulapati, Avinash Lakshman, Alex Pilchin, Swaminathan Sivasubramanian, Peter Vosshall and

More information

Goal of the presentation is to give an introduction of NoSQL databases, why they are there.

Goal of the presentation is to give an introduction of NoSQL databases, why they are there. 1 Goal of the presentation is to give an introduction of NoSQL databases, why they are there. We want to present "Why?" first to explain the need of something like "NoSQL" and then in "What?" we go in

More information

Performance Comparison of NOSQL Database Cassandra and SQL Server for Large Databases

Performance Comparison of NOSQL Database Cassandra and SQL Server for Large Databases Performance Comparison of NOSQL Database Cassandra and SQL Server for Large Databases Khalid Mahmood Shaheed Zulfiqar Ali Bhutto Institute of Science and Technology, Karachi Pakistan khalidmdar@yahoo.com

More information

CSE 444: Database Internals. Lectures 26 NoSQL: Extensible Record Stores

CSE 444: Database Internals. Lectures 26 NoSQL: Extensible Record Stores CSE 444: Database Internals Lectures 26 NoSQL: Extensible Record Stores CSE 444 - Spring 2014 1 References Scalable SQL and NoSQL Data Stores, Rick Cattell, SIGMOD Record, December 2010 (Vol. 39, No. 4)

More information

Scalable Storage: The drive for web-scale data management

Scalable Storage: The drive for web-scale data management Scalable Storage: The drive for web-scale data management Bryan Rosander University of Central Florida bryanrosander@gmail.com March 28, 2012 Abstract Data-intensive applications have become prevalent

More information

CIB Session 12th NoSQL Databases Structures

CIB Session 12th NoSQL Databases Structures CIB Session 12th NoSQL Databases Structures By: Shahab Safaee & Morteza Zahedi Software Engineering PhD Email: safaee.shx@gmail.com, morteza.zahedi.a@gmail.com cibtrc.ir cibtrc cibtrc 2 Agenda What is

More information

ΕΠΛ 602:Foundations of Internet Technologies. Cloud Computing

ΕΠΛ 602:Foundations of Internet Technologies. Cloud Computing ΕΠΛ 602:Foundations of Internet Technologies Cloud Computing 1 Outline Bigtable(data component of cloud) Web search basedonch13of thewebdatabook 2 What is Cloud Computing? ACloudis an infrastructure, transparent

More information

Tools for Social Networking Infrastructures

Tools for Social Networking Infrastructures Tools for Social Networking Infrastructures 1 Cassandra - a decentralised structured storage system Problem : Facebook Inbox Search hundreds of millions of users distributed infrastructure inbox changes

More information

CS 655 Advanced Topics in Distributed Systems

CS 655 Advanced Topics in Distributed Systems Presented by : Walid Budgaga CS 655 Advanced Topics in Distributed Systems Computer Science Department Colorado State University 1 Outline Problem Solution Approaches Comparison Conclusion 2 Problem 3

More information

Outline. Introduction Background Use Cases Data Model & Query Language Architecture Conclusion

Outline. Introduction Background Use Cases Data Model & Query Language Architecture Conclusion Outline Introduction Background Use Cases Data Model & Query Language Architecture Conclusion Cassandra Background What is Cassandra? Open-source database management system (DBMS) Several key features

More information

Apache Cassandra - A Decentralized Structured Storage System

Apache Cassandra - A Decentralized Structured Storage System Apache Cassandra - A Decentralized Structured Storage System Avinash Lakshman Prashant Malik from Facebook Presented by: Oded Naor Acknowledgments Some slides are based on material from: Idit Keidar, Topics

More information

Improving Logical Clocks in Riak with Dotted Version Vectors: A Case Study

Improving Logical Clocks in Riak with Dotted Version Vectors: A Case Study Improving Logical Clocks in Riak with Dotted Version Vectors: A Case Study Ricardo Gonçalves Universidade do Minho, Braga, Portugal, tome@di.uminho.pt Abstract. Major web applications need the partition-tolerance

More information

Introduction to Big Data. NoSQL Databases. Instituto Politécnico de Tomar. Ricardo Campos

Introduction to Big Data. NoSQL Databases. Instituto Politécnico de Tomar. Ricardo Campos Instituto Politécnico de Tomar Introduction to Big Data NoSQL Databases Ricardo Campos Mestrado EI-IC Análise e Processamento de Grandes Volumes de Dados Tomar, Portugal, 2016 Part of the slides used in

More information

CISC 7610 Lecture 2b The beginnings of NoSQL

CISC 7610 Lecture 2b The beginnings of NoSQL CISC 7610 Lecture 2b The beginnings of NoSQL Topics: Big Data Google s infrastructure Hadoop: open google infrastructure Scaling through sharding CAP theorem Amazon s Dynamo 5 V s of big data Everyone

More information

Extreme Computing. NoSQL.

Extreme Computing. NoSQL. Extreme Computing NoSQL PREVIOUSLY: BATCH Query most/all data Results Eventually NOW: ON DEMAND Single Data Points Latency Matters One problem, three ideas We want to keep track of mutable state in a scalable

More information

Big Data Development CASSANDRA NoSQL Training - Workshop. November 20 to (5 days) 9 am to 5 pm HOTEL DUBAI GRAND DUBAI

Big Data Development CASSANDRA NoSQL Training - Workshop. November 20 to (5 days) 9 am to 5 pm HOTEL DUBAI GRAND DUBAI Big Data Development CASSANDRA NoSQL Training - Workshop November 20 to 24 2016 (5 days) 9 am to 5 pm HOTEL DUBAI GRAND DUBAI ISIDUS TECH TEAM FZE PO Box 9798 Dubai UAE, email training-coordinator@isidusnet

More information

Enabling Distributed Key-Value Stores with Low Latency-Impact Snapshot Support

Enabling Distributed Key-Value Stores with Low Latency-Impact Snapshot Support Enabling Distributed Key-Value Stores with Low Latency-Impact Snapshot Support Jordà Polo, Yolanda Becerra, David Carrera, Jordi Torres and Eduard Ayguadé Barcelona Supercomputing Center (BSC) - Technical

More information

NOSQL Databases: The Need of Enterprises

NOSQL Databases: The Need of Enterprises International Journal of Allied Practice, Research and Review Website: www.ijaprr.com (ISSN 2350-1294) NOSQL Databases: The Need of Enterprises Basit Maqbool Mattu M-Tech CSE Student. (4 th semester).

More information

Evaluating Auto Scalable Application on Cloud

Evaluating Auto Scalable Application on Cloud Evaluating Auto Scalable Application on Cloud Takashi Okamoto Abstract Cloud computing enables dynamic scaling out of system resources, depending on workloads and data volume. In addition to the conventional

More information

Exploring Cassandra and HBase with BigTable Model

Exploring Cassandra and HBase with BigTable Model Exploring Cassandra and HBase with BigTable Model Hemanth Gokavarapu hemagoka@indiana.edu (Guidance of Prof. Judy Qiu) Department of Computer Science Indiana University Bloomington Abstract Cassandra is

More information

Bigtable: A Distributed Storage System for Structured Data By Fay Chang, et al. OSDI Presented by Xiang Gao

Bigtable: A Distributed Storage System for Structured Data By Fay Chang, et al. OSDI Presented by Xiang Gao Bigtable: A Distributed Storage System for Structured Data By Fay Chang, et al. OSDI 2006 Presented by Xiang Gao 2014-11-05 Outline Motivation Data Model APIs Building Blocks Implementation Refinement

More information

Intro Cassandra. Adelaide Big Data Meetup.

Intro Cassandra. Adelaide Big Data Meetup. Intro Cassandra Adelaide Big Data Meetup instaclustr.com @Instaclustr Who am I and what do I do? Alex Lourie Worked at Red Hat, Datastax and now Instaclustr We currently manage x10s nodes for various customers,

More information

Cassandra Database Security

Cassandra Database Security Cassandra Database Security Author: Mohit Bagria NoSQL Database A NoSQL database (sometimes called as Not Only SQL) is a database that provides a mechanism to store and retrieve data other than the tabular

More information

Comparing SQL and NOSQL databases

Comparing SQL and NOSQL databases COSC 6397 Big Data Analytics Data Formats (II) HBase Edgar Gabriel Spring 2014 Comparing SQL and NOSQL databases Types Development History Data Storage Model SQL One type (SQL database) with minor variations

More information

Chapter 24 NOSQL Databases and Big Data Storage Systems

Chapter 24 NOSQL Databases and Big Data Storage Systems Chapter 24 NOSQL Databases and Big Data Storage Systems - Large amounts of data such as social media, Web links, user profiles, marketing and sales, posts and tweets, road maps, spatial data, email - NOSQL

More information

Getting to know. by Michelle Darling August 2013

Getting to know. by Michelle Darling August 2013 Getting to know by Michelle Darling mdarlingcmt@gmail.com August 2013 Agenda: What is Cassandra? Installation, CQL3 Data Modelling Summary Only 15 min to cover these, so please hold questions til the end,

More information

Cassandra 1.0 and Beyond

Cassandra 1.0 and Beyond Cassandra 1.0 and Beyond Jake Luciani, DataStax jake@datastax.com, 11/11/11 1 About me http://twitter.com/tjake Cassandra Committer Thrift PMC Early DataStax employee Ex-Wall St. (happily) Job Trends from

More information

A NOVEL APPROACH FOR HOTEL MANAGEMENT SYSTEM USING CASSANDRA

A NOVEL APPROACH FOR HOTEL MANAGEMENT SYSTEM USING CASSANDRA A NOVEL APPROACH FOR HOTEL MANAGEMENT SYSTEM USING CASSANDRA Hima S 1, Varalakshmi P 2 and Surekha Mariam Varghese 3 Department of Computer Science and Engineering, M.A. College of Engineering, Kothamangalam,

More information

W b b 2.0. = = Data Ex E pl p o l s o io i n

W b b 2.0. = = Data Ex E pl p o l s o io i n Hypertable Doug Judd Zvents, Inc. Background Web 2.0 = Data Explosion Web 2.0 Mt. Web 2.0 Traditional Tools Don t Scale Well Designed for a single machine Typical scaling solutions ad-hoc manual/static

More information

Big Data Infrastructure CS 489/698 Big Data Infrastructure (Winter 2017)

Big Data Infrastructure CS 489/698 Big Data Infrastructure (Winter 2017) Big Data Infrastructure CS 489/698 Big Data Infrastructure (Winter 2017) Week 10: Mutable State (1/2) March 14, 2017 Jimmy Lin David R. Cheriton School of Computer Science University of Waterloo These

More information

An Efficient Distributed B-tree Index Method in Cloud Computing

An Efficient Distributed B-tree Index Method in Cloud Computing Send Orders for Reprints to reprints@benthamscience.ae The Open Cybernetics & Systemics Journal, 214, 8, 32-38 32 Open Access An Efficient Distributed B-tree Index Method in Cloud Computing Huang Bin 1,*

More information

Evaluating Cassandra as a Manager of Large File Sets

Evaluating Cassandra as a Manager of Large File Sets Evaluating Cassandra as a Manager of Large File Sets Leander Beernaert, Pedro Gomes, Miguel Matos, Ricardo Vilaça, Rui Oliveira High-Assurance Software Laboratory INESC TEC & Universidade do Minho Braga,

More information

Cassandra - A Decentralized Structured Storage System. Avinash Lakshman and Prashant Malik Facebook

Cassandra - A Decentralized Structured Storage System. Avinash Lakshman and Prashant Malik Facebook Cassandra - A Decentralized Structured Storage System Avinash Lakshman and Prashant Malik Facebook Agenda Outline Data Model System Architecture Implementation Experiments Outline Extension of Bigtable

More information

FAQs Snapshots and locks Vector Clock

FAQs Snapshots and locks Vector Clock //08 CS5 Introduction to Big - FALL 08 W.B.0.0 CS5 Introduction to Big //08 CS5 Introduction to Big - FALL 08 W.B. FAQs Snapshots and locks Vector Clock PART. LARGE SCALE DATA STORAGE SYSTEMS NO SQL DATA

More information

References. What is Bigtable? Bigtable Data Model. Outline. Key Features. CSE 444: Database Internals

References. What is Bigtable? Bigtable Data Model. Outline. Key Features. CSE 444: Database Internals References CSE 444: Database Internals Scalable SQL and NoSQL Data Stores, Rick Cattell, SIGMOD Record, December 2010 (Vol 39, No 4) Lectures 26 NoSQL: Extensible Record Stores Bigtable: A Distributed

More information

App Engine: Datastore Introduction

App Engine: Datastore Introduction App Engine: Datastore Introduction Part 1 Another very useful course: https://www.udacity.com/course/developing-scalableapps-in-java--ud859 1 Topics cover in this lesson What is Datastore? Datastore and

More information

Distributed Systems. 29. Distributed Caching Paul Krzyzanowski. Rutgers University. Fall 2014

Distributed Systems. 29. Distributed Caching Paul Krzyzanowski. Rutgers University. Fall 2014 Distributed Systems 29. Distributed Caching Paul Krzyzanowski Rutgers University Fall 2014 December 5, 2014 2013 Paul Krzyzanowski 1 Caching Purpose of a cache Temporary storage to increase data access

More information

We are ready to serve Latest Testing Trends, Are you ready to learn?? New Batches Info

We are ready to serve Latest Testing Trends, Are you ready to learn?? New Batches Info We are ready to serve Latest Testing Trends, Are you ready to learn?? New Batches Info START DATE : TIMINGS : DURATION : TYPE OF BATCH : FEE : FACULTY NAME : LAB TIMINGS : PH NO: 9963799240, 040-40025423

More information

Overview. * Some History. * What is NoSQL? * Why NoSQL? * RDBMS vs NoSQL. * NoSQL Taxonomy. *TowardsNewSQL

Overview. * Some History. * What is NoSQL? * Why NoSQL? * RDBMS vs NoSQL. * NoSQL Taxonomy. *TowardsNewSQL * Some History * What is NoSQL? * Why NoSQL? * RDBMS vs NoSQL * NoSQL Taxonomy * Towards NewSQL Overview * Some History * What is NoSQL? * Why NoSQL? * RDBMS vs NoSQL * NoSQL Taxonomy *TowardsNewSQL NoSQL

More information

ExaminingCassandra Constraints: Pragmatic. Eyes

ExaminingCassandra Constraints: Pragmatic. Eyes International Journal of Management, IT & Engineering Vol. 9 Issue 3, March 2019, ISSN: 2249-0558 Impact Factor: 7.119 Journal Homepage: Double-Blind Peer Reviewed Refereed Open Access International Journal

More information

. International Journal of Advance Research in Engineering, Science & Technology. Identifying Vulnerabilities in Apache Cassandra

. International Journal of Advance Research in Engineering, Science & Technology. Identifying Vulnerabilities in Apache Cassandra Impact Factor (SJIF): 4.542. International Journal of Advance Research in Engineering, Science & Technology e-issn: 2393-9877, p-issn: 2394-2444 Volume 4, Issue 4, April-2017 Identifying Vulnerabilities

More information

Migrating Oracle Databases To Cassandra

Migrating Oracle Databases To Cassandra BY UMAIR MANSOOB Why Cassandra Lower Cost of ownership makes it #1 choice for Big Data OLTP Applications. Unlike Oracle, Cassandra can store structured, semi-structured, and unstructured data. Cassandra

More information

Introduction to store data in Redis, a persistent and fast key-value database

Introduction to store data in Redis, a persistent and fast key-value database AMICT 2010-2011. pp. 39 49 39 Introduction to store data in Redis, a persistent and fast key-value database Matti Paksula Department of Computer Science, University of Helsinki P.O.Box 68, FI-00014 University

More information

NoSQL Databases MongoDB vs Cassandra. Kenny Huynh, Andre Chik, Kevin Vu

NoSQL Databases MongoDB vs Cassandra. Kenny Huynh, Andre Chik, Kevin Vu NoSQL Databases MongoDB vs Cassandra Kenny Huynh, Andre Chik, Kevin Vu Introduction - Relational database model - Concept developed in 1970 - Inefficient - NoSQL - Concept introduced in 1980 - Related

More information

8/24/2017 Week 1-B Instructor: Sangmi Lee Pallickara

8/24/2017 Week 1-B Instructor: Sangmi Lee Pallickara Week 1-B-0 Week 1-B-1 CS535 BIG DATA FAQs Slides are available on the course web Wait list Term project topics PART 0. INTRODUCTION 2. DATA PROCESSING PARADIGMS FOR BIG DATA Sangmi Lee Pallickara Computer

More information

Reprise: Stability under churn (Tapestry) A Simple lookup Test. Churn (Optional Bamboo paper last time)

Reprise: Stability under churn (Tapestry) A Simple lookup Test. Churn (Optional Bamboo paper last time) EECS 262a Advanced Topics in Computer Systems Lecture 22 Reprise: Stability under churn (Tapestry) P2P Storage: Dynamo November 20 th, 2013 John Kubiatowicz and Anthony D. Joseph Electrical Engineering

More information

CS-580K/480K Advanced Topics in Cloud Computing. NoSQL Database

CS-580K/480K Advanced Topics in Cloud Computing. NoSQL Database CS-580K/480K dvanced Topics in Cloud Computing NoSQL Database 1 1 Where are we? Cloud latforms 2 VM1 VM2 VM3 3 Operating System 4 1 2 3 Operating System 4 1 2 Virtualization Layer 3 Operating System 4

More information

NoSQL systems. Lecture 21 (optional) Instructor: Sudeepa Roy. CompSci 516 Data Intensive Computing Systems

NoSQL systems. Lecture 21 (optional) Instructor: Sudeepa Roy. CompSci 516 Data Intensive Computing Systems CompSci 516 Data Intensive Computing Systems Lecture 21 (optional) NoSQL systems Instructor: Sudeepa Roy Duke CS, Spring 2016 CompSci 516: Data Intensive Computing Systems 1 Key- Value Stores Duke CS,

More information

Rule 14 Use Databases Appropriately

Rule 14 Use Databases Appropriately Rule 14 Use Databases Appropriately Rule 14: What, When, How, and Why What: Use relational databases when you need ACID properties to maintain relationships between your data. For other data storage needs

More information

A Proxy-based Query Aggregation Method for Distributed Key-Value Stores

A Proxy-based Query Aggregation Method for Distributed Key-Value Stores A Proxy-based Query Aggregation Method for Distributed Key-Value Stores Daichi Kawanami, Masanari Kamoshita, Ryota Kawashima and Hiroshi Matsuo Nagoya Institute of Technology, in Nagoya, Aichi, 466-8555,

More information

Big Data Infrastructure CS 489/698 Big Data Infrastructure (Winter 2016)

Big Data Infrastructure CS 489/698 Big Data Infrastructure (Winter 2016) Big Data Infrastructure CS 489/698 Big Data Infrastructure (Winter 2016) Week 10: Mutable State (1/2) March 15, 2016 Jimmy Lin David R. Cheriton School of Computer Science University of Waterloo These

More information

CS November 2018

CS November 2018 Bigtable Highly available distributed storage Distributed Systems 19. Bigtable Built with semi-structured data in mind URLs: content, metadata, links, anchors, page rank User data: preferences, account

More information

10. Replication. Motivation

10. Replication. Motivation 10. Replication Page 1 10. Replication Motivation Reliable and high-performance computation on a single instance of a data object is prone to failure. Replicate data to overcome single points of failure

More information

Cassandra. JOEL BOHMAN and JOHAN HILDING

Cassandra. JOEL BOHMAN and JOHAN HILDING Cassandra JOEL BOHMAN and JOHAN HILDING Bachelor of Science Thesis Stockholm, Sweden 2010 Cassandra JOEL BOHMAN and JOHAN HILDING Bachelor s Thesis in Computer Science (15 ECTS credits) at the School of

More information

Big Data Hadoop Course Content

Big Data Hadoop Course Content Big Data Hadoop Course Content Topics covered in the training Introduction to Linux and Big Data Virtual Machine ( VM) Introduction/ Installation of VirtualBox and the Big Data VM Introduction to Linux

More information

CS November 2017

CS November 2017 Bigtable Highly available distributed storage Distributed Systems 18. Bigtable Built with semi-structured data in mind URLs: content, metadata, links, anchors, page rank User data: preferences, account

More information

CSE-E5430 Scalable Cloud Computing Lecture 10

CSE-E5430 Scalable Cloud Computing Lecture 10 CSE-E5430 Scalable Cloud Computing Lecture 10 Keijo Heljanko Department of Computer Science School of Science Aalto University keijo.heljanko@aalto.fi 23.11-2015 1/29 Exam Registering for the exam is obligatory,

More information

BigTable. CSE-291 (Cloud Computing) Fall 2016

BigTable. CSE-291 (Cloud Computing) Fall 2016 BigTable CSE-291 (Cloud Computing) Fall 2016 Data Model Sparse, distributed persistent, multi-dimensional sorted map Indexed by a row key, column key, and timestamp Values are uninterpreted arrays of bytes

More information

SQL Query Optimization on Cross Nodes for Distributed System

SQL Query Optimization on Cross Nodes for Distributed System 2016 International Conference on Power, Energy Engineering and Management (PEEM 2016) ISBN: 978-1-60595-324-3 SQL Query Optimization on Cross Nodes for Distributed System Feng ZHAO 1, Qiao SUN 1, Yan-bin

More information

Distributed Data Store

Distributed Data Store Distributed Data Store Large-Scale Distributed le system Q: What if we have too much data to store in a single machine? Q: How can we create one big filesystem over a cluster of machines, whose data is

More information

Certified Apache Cassandra Professional VS-1046

Certified Apache Cassandra Professional VS-1046 Certified Apache Cassandra Professional VS-1046 Certified Apache Cassandra Professional Certification Code VS-1046 Vskills certification for Apache Cassandra Professional assesses the candidate for skills

More information

Ashok Kumar P S, Md Ateeq Ur Rahman Department of CSE, JNTU/ SCET, Hyderabad, Andra Pradesh, India

Ashok Kumar P S, Md Ateeq Ur Rahman Department of CSE, JNTU/ SCET, Hyderabad, Andra Pradesh, India International Journal of Scientific Research in Computer Science, Engineering and Information Technology 2017 IJSRCSEIT Volume 2 Issue 5 ISSN : 2456-3307 Implications of NoSQL Transaction Model in Cloud

More information

The MapReduce Framework

The MapReduce Framework The MapReduce Framework In Partial fulfilment of the requirements for course CMPT 816 Presented by: Ahmed Abdel Moamen Agents Lab Overview MapReduce was firstly introduced by Google on 2004. MapReduce

More information

Non-Relational Databases. Pelle Jakovits

Non-Relational Databases. Pelle Jakovits Non-Relational Databases Pelle Jakovits 25 October 2017 Outline Background Relational model Database scaling The NoSQL Movement CAP Theorem Non-relational data models Key-value Document-oriented Column

More information

Scaling Up HBase. Duen Horng (Polo) Chau Assistant Professor Associate Director, MS Analytics Georgia Tech. CSE6242 / CX4242: Data & Visual Analytics

Scaling Up HBase. Duen Horng (Polo) Chau Assistant Professor Associate Director, MS Analytics Georgia Tech. CSE6242 / CX4242: Data & Visual Analytics http://poloclub.gatech.edu/cse6242 CSE6242 / CX4242: Data & Visual Analytics Scaling Up HBase Duen Horng (Polo) Chau Assistant Professor Associate Director, MS Analytics Georgia Tech Partly based on materials

More information

A Survey Paper on NoSQL Databases: Key-Value Data Stores and Document Stores

A Survey Paper on NoSQL Databases: Key-Value Data Stores and Document Stores A Survey Paper on NoSQL Databases: Key-Value Data Stores and Document Stores Nikhil Dasharath Karande 1 Department of CSE, Sanjay Ghodawat Institutes, Atigre nikhilkarande18@gmail.com Abstract- This paper

More information

Column Stores and HBase. Rui LIU, Maksim Hrytsenia

Column Stores and HBase. Rui LIU, Maksim Hrytsenia Column Stores and HBase Rui LIU, Maksim Hrytsenia December 2017 Contents 1 Hadoop 2 1.1 Creation................................ 2 2 HBase 3 2.1 Column Store Database....................... 3 2.2 HBase

More information

CSE 544 Principles of Database Management Systems. Magdalena Balazinska Winter 2015 Lecture 14 NoSQL

CSE 544 Principles of Database Management Systems. Magdalena Balazinska Winter 2015 Lecture 14 NoSQL CSE 544 Principles of Database Management Systems Magdalena Balazinska Winter 2015 Lecture 14 NoSQL References Scalable SQL and NoSQL Data Stores, Rick Cattell, SIGMOD Record, December 2010 (Vol. 39, No.

More information

Axway API Management 7.5.x Cassandra Best practices. #axway

Axway API Management 7.5.x Cassandra Best practices. #axway Axway API Management 7.5.x Cassandra Best practices #axway Axway API Management 7.5.x Cassandra Best practices Agenda Apache Cassandra - Overview Apache Cassandra - Focus on consistency level Apache Cassandra

More information

CS555: Distributed Systems [Fall 2017] Dept. Of Computer Science, Colorado State University

CS555: Distributed Systems [Fall 2017] Dept. Of Computer Science, Colorado State University CS 555: DISTRIBUTED SYSTEMS [REPLICATION & CONSISTENCY] Frequently asked questions from the previous class survey Shrideep Pallickara Computer Science Colorado State University L25.1 L25.2 Topics covered

More information

Database Evolution. DB NoSQL Linked Open Data. L. Vigliano

Database Evolution. DB NoSQL Linked Open Data. L. Vigliano Database Evolution DB NoSQL Linked Open Data Requirements and features Large volumes of data..increasing No regular data structure to manage Relatively homogeneous elements among them (no correlation between

More information

CS555: Distributed Systems [Fall 2017] Dept. Of Computer Science, Colorado State University

CS555: Distributed Systems [Fall 2017] Dept. Of Computer Science, Colorado State University CS 555: DISTRIBUTED SYSTEMS [DYNAMO & GOOGLE FILE SYSTEM] Frequently asked questions from the previous class survey What s the typical size of an inconsistency window in most production settings? Dynamo?

More information

NoSQL and Database as a Service

NoSQL and Database as a Service NoSQL and Database as a Service Prof. Dr. Marcel Graf TSM-ClComp-EN Cloud Computing (C) 2017 HEIG-VD Databases Historical overview Prehistory : Hierarchical or network databases 1980 Ascent of relational

More information

Leveraging High-Performance In-Memory Key-Value Data Stores to Accelerate Data Intensive Tasks

Leveraging High-Performance In-Memory Key-Value Data Stores to Accelerate Data Intensive Tasks Leveraging High-Performance In-Memory Key-Value Data Stores to Accelerate Data Intensive Tasks Nesrine Khouzami, Jordà Polo and David Carrera Technical Report UPC-DAC-RR-CAP-2015-19 Department of Computer

More information

Bigtable: A Distributed Storage System for Structured Data by Google SUNNIE CHUNG CIS 612

Bigtable: A Distributed Storage System for Structured Data by Google SUNNIE CHUNG CIS 612 Bigtable: A Distributed Storage System for Structured Data by Google SUNNIE CHUNG CIS 612 Google Bigtable 2 A distributed storage system for managing structured data that is designed to scale to a very

More information

Analysis of HBase Read/Write

Analysis of HBase Read/Write Analysis of HBase Read/Write Arvind Dwarakanath School of Informatics and Computing, Indiana University adwaraka@indiana.edu Vaibhav Nachankar School of Informatics and Computing, Indiana University vmnachan@indiana.edu

More information

MONGODB INTERVIEW QUESTIONS

MONGODB INTERVIEW QUESTIONS MONGODB INTERVIEW QUESTIONS http://www.tutorialspoint.com/mongodb/mongodb_interview_questions.htm Copyright tutorialspoint.com Dear readers, these MongoDB Interview Questions have been designed specially

More information

Introduction to NoSQL

Introduction to NoSQL Introduction to NoSQL Agenda History What is NoSQL Types of NoSQL The CAP theorem History - RDBMS Relational DataBase Management Systems were invented in the 1970s. E. F. Codd, "Relational Model of Data

More information

Migrating to Cassandra in the Cloud, the Netflix Way

Migrating to Cassandra in the Cloud, the Netflix Way Migrating to Cassandra in the Cloud, the Netflix Way Jason Brown - @jasobrown Senior Software Engineer, Netflix Tech History, 1998-2008 In the beginning, there was the webapp and a single database in a

More information

Defining Weakly Consistent Byzantine Fault-Tolerant Services

Defining Weakly Consistent Byzantine Fault-Tolerant Services Defining Weakly Consistent Byzantine Fault-Tolerant Services Atul Singh, Pedro Fonseca, Petr Kuznetsov,, Rodrigo Rodrigues, Petros Maniatis MPI-SWS, Rice University, TU Berlin/DT Labs, Intel Research Berkeley

More information

Advanced Data Management Technologies

Advanced Data Management Technologies ADMT 2017/18 Unit 15 J. Gamper 1/44 Advanced Data Management Technologies Unit 15 Introduction to NoSQL J. Gamper Free University of Bozen-Bolzano Faculty of Computer Science IDSE ADMT 2017/18 Unit 15

More information