NoSQL OLTP Benchmarking: A Survey
|
|
|
- Ross Butler
- 5 years ago
- Views:
Transcription
1 NoSQL OLTP Benchmarking: A Survey DMC 2014 Steffen Friedrich, Wolfram Wingerath, Felix Gessert, Norbert Ritter University of Hamburg Department of Informatics Databases and Information Systems September 22 nd, 2014 Friedrich, Wingerath, Gessert, Ritter NoSQL OLTP Benchmarking: A Survey 1/24
2 1 Introduction 2 Existing Benchmarks 3 NoSQLMark 4 Future Prospects 5 References 6 Discussion Friedrich, Wingerath, Gessert, Ritter NoSQL OLTP Benchmarking: A Survey 2/24
3 How to Compare Databases by specification docs are incomplete docs are wrong design? performance Through Benchmarking general-purpose: widely applicable application-specific: arguably more meaningful Friedrich, Wingerath, Gessert, Ritter NoSQL OLTP Benchmarking: A Survey 3/24
![Workload Executor DB Interface Layer YCSB [CST + 10] A Solid Foundation Command line properties DB to use Workload to use Target throughput Number of threads.](/docs-images/94/120850467/images/4-3.jpg ".. Workload file Read /write mix Record size Popularity distribution.")
4 Workload Executor DB Interface Layer YCSB [CST + 10] A Solid Foundation Command line properties DB to use Workload to use Target throughput Number of threads... Workload file Read /write mix Record size Popularity distribution... YCSB Client Client Threads Stats Create Read Update Delete Friedrich, Wingerath, Gessert, Ritter NoSQL OLTP Benchmarking: A Survey 4/24
5 Dimensions of Interest latency and throughput availability direct steady-state consistency staleness (version-based, time-based) ordering guarantees durability transactions Friedrich, Wingerath, Gessert, Ritter NoSQL OLTP Benchmarking: A Survey 5/24
6 Consistency Staleness [RGA + 12] χ 1 w(x 0 ) r(x 0 ) W(X 1 ) r(x 1 ) w(x 2 ) χ 2 time max inconsistency window Δ= max(χ 1, χ 2 ) Friedrich, Wingerath, Gessert, Ritter NoSQL OLTP Benchmarking: A Survey 6/24
7 Consistency Ordering Guarantees data-centric linearisability eventual consistency causal consistency... client-centric monotonic read monotonic write write follows read read your writes... Friedrich, Wingerath, Gessert, Ritter NoSQL OLTP Benchmarking: A Survey 7/24
8 Existing Benchmarks 2 Existing Benchmarks Wada et al. [WFZ + 11] Bermbach et al. [BT11, BT14, Ber14] [PPR + 11] Wrap-Up Friedrich, Wingerath, Gessert, Ritter NoSQL OLTP Benchmarking: A Survey 8/24
9 Wada et al. [WFZ + 11] Simple Consistency Measurement Reader read tw=2, tr=5 Friedrich, Wingerath, Gessert, Ritter NoSQL OLTP Benchmarking: A Survey 9/24
10 Wada et al. [WFZ + 11] Simple Consistency Measurement Reader read tw=2, tr=5 read tw=3, tr=6 Friedrich, Wingerath, Gessert, Ritter NoSQL OLTP Benchmarking: A Survey 9/24
11 Wada et al. [WFZ + 11] Simple Consistency Measurement Reader read tw=2, tr=5 read tw=3, tr=6 staleness => 5 3 = 2 Friedrich, Wingerath, Gessert, Ritter NoSQL OLTP Benchmarking: A Survey 9/24
12 Wada et al. [WFZ + 11] Simple Consistency Measurement Reader read tw=2, tr=5 read tw=3, tr=6 only one node => sticky sessions two nodes => clock drift simplistic workload! Friedrich, Wingerath, Gessert, Ritter NoSQL OLTP Benchmarking: A Survey 9/24
13 Bermbach et al. [BT11, BT14, Ber14] Distributed Readers Reader 1 YCSB Reader 2 Friedrich, Wingerath, Gessert, Ritter NoSQL OLTP Benchmarking: A Survey 10/24
14 Bermbach et al. [BT11, BT14, Ber14] Distributed Readers Reader 1 YCSB Reader 2 Friedrich, Wingerath, Gessert, Ritter NoSQL OLTP Benchmarking: A Survey 10/24
15 Bermbach et al. [BT11, BT14, Ber14] Distributed Readers Reader 1 YCSB Reader 2 Friedrich, Wingerath, Gessert, Ritter NoSQL OLTP Benchmarking: A Survey 10/24
16 Bermbach et al. [BT11, BT14, Ber14] Distributed Readers Reader 1 YCSB Reader 2 Friedrich, Wingerath, Gessert, Ritter NoSQL OLTP Benchmarking: A Survey 10/24
17 Bermbach et al. [BT11, BT14, Ber14] Distributed Readers Reader 1 YCSB Reader 2 Friedrich, Wingerath, Gessert, Ritter NoSQL OLTP Benchmarking: A Survey 10/24
18 Bermbach et al. [BT11, BT14, Ber14] Distributed Readers Reader 1 YCSB Reader 2 Friedrich, Wingerath, Gessert, Ritter NoSQL OLTP Benchmarking: A Survey 10/24
19 Bermbach et al. [BT11, BT14, Ber14] Distributed Readers Reader 1 YCSB Reader 2 Friedrich, Wingerath, Gessert, Ritter NoSQL OLTP Benchmarking: A Survey 10/24
20 Bermbach et al. [BT11, BT14, Ber14] Distributed Readers Reader 1 YCSB Reader 2 staleness: 8 3 = 5 Friedrich, Wingerath, Gessert, Ritter NoSQL OLTP Benchmarking: A Survey 10/24
21 Bermbach et al. [BT11, BT14, Ber14] Distributed Readers Reader 1 YCSB staleness: 16 3 = 13 clock drift = 10 Reader 2 Friedrich, Wingerath, Gessert, Ritter NoSQL OLTP Benchmarking: A Survey 10/24
22 Bermbach et al. [BT11, BT14, Ber14] Distributed Readers disrupted YCSB workload Reader 1 YCSB staleness: 16 3 = 13 clock drift = 10 Reader 2 Friedrich, Wingerath, Gessert, Ritter NoSQL OLTP Benchmarking: A Survey 10/24
23 [PPR + 11] Zookeeper x Reader Friedrich, Wingerath, Gessert, Ritter NoSQL OLTP Benchmarking: A Survey 11/24
24 [PPR + 11] Zookeeper x Reader Friedrich, Wingerath, Gessert, Ritter NoSQL OLTP Benchmarking: A Survey 11/24
25 [PPR + 11] Zookeeper x Reader Friedrich, Wingerath, Gessert, Ritter NoSQL OLTP Benchmarking: A Survey 11/24
26 [PPR + 11] Zookeeper x Reader Friedrich, Wingerath, Gessert, Ritter NoSQL OLTP Benchmarking: A Survey 11/24
27 [PPR + 11] Zookeeper x Reader Friedrich, Wingerath, Gessert, Ritter NoSQL OLTP Benchmarking: A Survey 11/24
28 [PPR + 11] Zookeeper x Reader possibly consistent between 7 and 10 but lower bound: 6 5 = 1 Friedrich, Wingerath, Gessert, Ritter NoSQL OLTP Benchmarking: A Survey 11/24
29 [PPR + 11] Zookeeper x Reader possibly consistent between 7 and 10 but lower bound: 6 5 = 1 (no lower/upper bound): 11-5 = 6 Friedrich, Wingerath, Gessert, Ritter NoSQL OLTP Benchmarking: A Survey 11/24
30 [PPR + 11] network latency, even if writer and reader on same node Zookeeper x Reader runs normal workload only inserts possibly consistent between 7 and 10 but lower bound: 6 5 = 1 (no lower/upper bound): 11-5 = 6 disrupted YCSB workload Friedrich, Wingerath, Gessert, Ritter NoSQL OLTP Benchmarking: A Survey 11/24
31 [PPR + 11] Possible Improvements Zookeeper x Reader Friedrich, Wingerath, Gessert, Ritter NoSQL OLTP Benchmarking: A Survey 11/24
32 [PPR + 11] Possible Improvements 1. subscribe for x Reader Friedrich, Wingerath, Gessert, Ritter NoSQL OLTP Benchmarking: A Survey 11/24
33 [PPR + 11] Possible Improvements 1. subscribe for x Reader Friedrich, Wingerath, Gessert, Ritter NoSQL OLTP Benchmarking: A Survey 11/24
34 [PPR + 11] Possible Improvements 1. subscribe for x Reader lower bound: 6 5 = 1 upper bound: 13-2 = 11 Friedrich, Wingerath, Gessert, Ritter NoSQL OLTP Benchmarking: A Survey 11/24
35 Wrap-Up Difficulties in Comparing NoSQL Datastores distribution of both tested system and test environment what time is it? system state?... apples and oranges sweet spots consistency models durability guarantees sharding and replication strategies... Measurement schemes metrics? when and where? observer effect: disruptive workloads precision draw conclusions Friedrich, Wingerath, Gessert, Ritter NoSQL OLTP Benchmarking: A Survey 12/24
36 NoSQLMark embedded pub-sub: reduced network communication configurable disruption: proportion, frequency etc. of consistency reads are tunable unified workload: no separation between workload and consistency measurement operations lower and upper bounds for staleness experimental verification through a single-node datastore featuring controllable anomalies (to-be-published separately) Friedrich, Wingerath, Gessert, Ritter NoSQL OLTP Benchmarking: A Survey 13/24
37 Future Prospects 4 Future Prospects Robustness & Availability Specificity Staleness Prediction Friedrich, Wingerath, Gessert, Ritter NoSQL OLTP Benchmarking: A Survey 14/24
38 Robustness & Availability Fasten Your Seat Belts! system performance and availability under node, network and other failures Under Pressure Benchmark (UPB) [FMA + 13] Thumbtack YCSB [NE13, Eng13] additional failure scenarios such as partitions MUST READ: Jepsen blog series ( Friedrich, Wingerath, Gessert, Ritter NoSQL OLTP Benchmarking: A Survey 15/24
39 Specificity account for richer data models application-specific workloads BG Benchmark [BG13] less disruptive workloads HP Labs [RGA + 12, GLS11] additional features such as bulk loading or multi-key transactions YCSB+T [DFNR14]) Friedrich, Wingerath, Gessert, Ritter NoSQL OLTP Benchmarking: A Survey 16/24
40 Staleness Prediction Probabilistically Bounded Staleness (PBS) [BVF + 12] Dynamo-style systems only version- and time-based staleness monotonic read consistency... coming soon: probabilistic staleness prediction of arbitrary caching strategies on top of arbitrary database topologies with YMCA (YCSB Monte Carlo Caching Simulator) Friedrich, Wingerath, Gessert, Ritter NoSQL OLTP Benchmarking: A Survey 17/24
41 References I Bermbach, David: Benchmarking Eventually Consistent Distributed Storage Systems. Karlsruhe, KIT, Fakultät für Wirtschaftswissenschaften, Phdthesis, 2014 Barahmand, Sumita ; Ghandeharizadeh, Shahram: BG: A Benchmark to Evaluate Interactive Social Networking Actions. In: CIDR, 2013 Bermbach, David ; Tai, Stefan: Eventual Consistency: How Soon is Eventual? An Evaluation of Amazon S3 s Consistency Behavior. In: Proceedings of the 6th Workshop on Middleware for Service Oriented Computing. New York, NY, USA : ACM, 2011 (MW4SOC 11). ISBN , 1:1 1:6 Bermbach, David ; Tai, Stefan: Benchmarking Eventual Consistency: Lessons Learned from Long-Term Experimental Studies. In: Proceedings of the 2nd IEEE International Conference on Cloud Engineering (IC2E), IEEE, Best Paper Runner Up Award Friedrich, Wingerath, Gessert, Ritter NoSQL OLTP Benchmarking: A Survey 18/24
42 References II Bailis, Peter ; Venkataraman, Shivaram ; Franklin, Michael J. ; Hellerstein, Joseph M. ; Stoica, Ion: Probabilistically bounded staleness for practical partial quorums. In: Proc. VLDB Endow. 5 (2012), April, Nr. 8, ISSN Cooper, Brian F. ; Silberstein, Adam ; Tam, Erwin ; Ramakrishnan, Raghu ; Sears, Russell: Benchmarking cloud serving systems with YCSB. In: Proceedings of the 1st ACM symposium on Cloud computing. New York, NY, USA : ACM, 2010 (SoCC 10). ISBN , Dey, Akon ; Fekete, Alan ; Nambiar, Raghunath ; Röhm, Uwe: YCSB+T: Benchmarking Web-scale Transactional Databases. In: Proceedings of International Workshop on Cloud Data Management (CloudDB 14). Chicago, USA, 2014 Friedrich, Wingerath, Gessert, Ritter NoSQL OLTP Benchmarking: A Survey 19/24
43 References III Engber, Ben: How to Compare NoSQL Databases: Determining True Performance and Recoverability Metrics For Real-World Use Cases. Presentation at NoSQL matters Version: 2013 Fior, Alessandro G. ; Meira, Jorge A. ; Almeida, Eduardo C. ; Coelho, Ricardo G. ; Fabro, Marcos Didonet D. ; Traon, Yves L.: Under Pressure Benchmark for DDBMS Availability. In: JIDM 4 (2013), Nr. 3, Golab, Wojciech ; Li, Xiaozhou ; Shah, Mehul A.: Analyzing Consistency Properties for Fun and Profit. In: Proceedings of the 30th Annual ACM SIGACT-SIGOPS Symposium on Principles of Distributed Computing. New York, NY, USA : ACM, 2011 (PODC 11). ISBN , Nelubin, Denis ; Engber, Ben: NoSQL Failover Characteristics: Aerospike, Cassandra, Couchbase, MongoDB. (2013) Friedrich, Wingerath, Gessert, Ritter NoSQL OLTP Benchmarking: A Survey 20/24
44 References IV Patil, Swapnil ; Polte, Milo ; Ren, Kai ; Tantisiriroj, Wittawat ; Xiao, Lin ; López, Julio ; Gibson, Garth ; Fuchs, Adam ; Rinaldi, Billie: : benchmarking and performance debugging advanced features in scalable table stores. In: Proceedings of the 2nd ACM Symposium on Cloud Computing. New York, NY, USA : ACM, 2011 (SOCC 11). ISBN , 9:1 9:14 Rahman, Muntasir R. ; Golab, Wojciech ; AuYoung, Alvin ; Keeton, Kimberly ; Wylie, Jay J.: Toward a Principled Framework for Benchmarking Consistency. In: Proceedings of the Eighth USENIX Conference on Hot Topics in System Dependability. Berkeley, CA, USA : USENIX Association, 2012 (HotDep 12), 8 8 Shute, Jeff ; Vingralek, Radek ; Samwel, Bart ; Handy, Ben ; Whipkey, Chad ; Rollins, Eric ; Oancea, Mircea ; Littlefield, Kyle ; Menestrina, David ; Ellner, Stephan ; Cieslewicz, John ; Rae, Ian ; Stancescu, Traian ; Apte, Himani: F1: A Distributed SQL Database That Scales. In: VLDB, 2013 Friedrich, Wingerath, Gessert, Ritter NoSQL OLTP Benchmarking: A Survey 21/24
45 References V Wada, Hiroshi ; Fekete, Alan ; Zhao, Liang ; Lee, Kevin ; Liu, Anna: Data Consistency Properties and the Trade-offs in Commercial Cloud Storage: the Consumers Perspective. In: CIDR 11, 2011, S Friedrich, Wingerath, Gessert, Ritter NoSQL OLTP Benchmarking: A Survey 22/24
46 Questions? Friedrich, Wingerath, Gessert, Ritter NoSQL OLTP Benchmarking: A Survey 23/24
47 Friedrich, Wingerath, Gessert, Ritter NoSQL OLTP Benchmarking: A Survey 24/24
YCSB++ Benchmarking Tool Performance Debugging Advanced Features of Scalable Table Stores
YCSB++ Benchmarking Tool Performance Debugging Advanced Features of Scalable Table Stores Swapnil Patil Milo Polte, Wittawat Tantisiriroj, Kai Ren, Lin Xiao, Julio Lopez, Garth Gibson, Adam Fuchs *, Billie
Benchmarking Cloud Serving Systems with YCSB 詹剑锋 2012 年 6 月 27 日
Benchmarking Cloud Serving Systems with YCSB 詹剑锋 2012 年 6 月 27 日 Motivation There are many cloud DB and nosql systems out there PNUTS BigTable HBase, Hypertable, HTable Megastore Azure Cassandra Amazon
@ Twitter Peter Shivaram Venkataraman, Mike Franklin, Joe Hellerstein, Ion Stoica. UC Berkeley
PBS @ Twitter 6.22.12 Peter Bailis @pbailis Shivaram Venkataraman, Mike Franklin, Joe Hellerstein, Ion Stoica UC Berkeley PBS Probabilistically Bounded Staleness 1. Fast 2. Scalable 3. Available solution:
YCSB++ benchmarking tool Performance debugging advanced features of scalable table stores
YCSB++ benchmarking tool Performance debugging advanced features of scalable table stores Swapnil Patil M. Polte, W. Tantisiriroj, K. Ren, L.Xiao, J. Lopez, G.Gibson, A. Fuchs *, B. Rinaldi * Carnegie
arxiv: v3 [cs.dc] 1 Oct 2015
![arxiv: v3 [cs.dc] 1 Oct 2015](/thumbs/85/92926801.jpg "arxiv: v3 [cs.dc] 1 Oct 2015")
Continuous Partial Quorums for Consistency-Latency Tuning in Distributed NoSQL Storage Systems [Please refer to the proceedings of SCDM 15 for the extended version of this manuscript.] Marlon McKenzie
Qing Zheng Lin Xiao, Kai Ren, Garth Gibson
Qing Zheng Lin Xiao, Kai Ren, Garth Gibson File System Architecture APP APP APP APP APP APP APP APP metadata operations Metadata Service I/O operations [flat namespace] Low-level Storage Infrastructure
How Eventual is Eventual Consistency?
Probabilistically Bounded Staleness How Eventual is Eventual Consistency? Peter Bailis, Shivaram Venkataraman, Michael J. Franklin, Joseph M. Hellerstein, Ion Stoica (UC Berkeley) BashoChats 002, 28 February
Improving NoSQL Database Benchmarking
Improving NoSQL Database Benchmarking Lessons Learned Steffen Friedrich University of Hamburg Department of Informatics Databases and Information Systems friedrich@informatik.uni-hamburg.de March 23, 2017
Adaptive Hybrid Quorums in Practical Settings
Adaptive Hybrid Quorums in Practical Settings Aaron Davidson, Aviad Rubinstein, Anirudh Todi, Peter Bailis, and Shivaram Venkataraman December 17, 2012 Abstract A series of recent works explore the trade-o
Coordinated Omission in NoSQL Database Benchmarking
B. Mitschang et al. (Hrsg.): BTW 017 Workshopband, Lecture Notes in Informatics (LNI), Gesellschaft füreinreichung Informatik, Bonn für: SCDM 017 017, 1 Geplant als Veröffentlichung innerhalb der Lecture
Trade- Offs in Cloud Storage Architecture. Stefan Tai
Trade- Offs in Cloud Storage Architecture Stefan Tai Cloud computing is about providing and consuming resources as services There are five essential characteristics of cloud services [NIST] [NIST]: http://csrc.nist.gov/groups/sns/cloud-
Data Store Consistency. Alan Fekete
Data Store Consistency Alan Fekete Outline Overview Consistency Properties - Research paper: Wada et al, CIDR 11 Transaction Techniques - Research paper: Bailis et al, HotOS 13, VLDB 14 Each data item
Towards an Extensible Middleware for Database Benchmarking
Towards an Extensible Middleware for Database Benchmarking David Bermbach 1, Jörn Kuhlenkamp 2, Akon Dey 3, Sherif Sakr 4, and Raghunath Nambiar 5 1 TU Berlin, Information Systems Engineering Group david.bermbach@tu-berlin.de,
Experiment-Driven Evaluation of Cloud-based Distributed Systems
Experiment-Driven Evaluation of Cloud-based Distributed Systems Markus Klems,, TU Berlin 11th Symposium and Summer School On Service-Oriented Computing Agenda Introduction Experiments Experiment Automation
Fine-tuning the Consistency-Latency Trade-off in Quorum-Replicated Distributed Storage Systems
Fine-tuning the Consistency-Latency Trade-off in Quorum-Replicated Distributed Storage Systems Marlon McKenzie Electrical and Computer Engineering University of Waterloo, Canada m2mckenzie@uwaterloo.ca
Eventual Consistency 1
Eventual Consistency 1 Readings Werner Vogels ACM Queue paper http://queue.acm.org/detail.cfm?id=1466448 Dynamo paper http://www.allthingsdistributed.com/files/ amazon-dynamo-sosp2007.pdf Apache Cassandra
BENCHMARK: PRELIMINARY RESULTS! JUNE 25, 2014!
BENCHMARK: PRELIMINARY RESULTS JUNE 25, 2014 Our latest benchmark test results are in. The detailed report will be published early next month, but after 6 weeks of designing and running these tests we
NOSQL DATABASE SYSTEMS: DECISION GUIDANCE AND TRENDS. Big Data Technologies: NoSQL DBMS (Decision Guidance) - SoSe
NOSQL DATABASE SYSTEMS: DECISION GUIDANCE AND TRENDS h_da Prof. Dr. Uta Störl Big Data Technologies: NoSQL DBMS (Decision Guidance) - SoSe 2017 163 Performance / Benchmarks Traditional database benchmarks
Application-Managed Database Replication on Virtualized Cloud Environments
Application-Managed Database Replication on Virtualized Cloud Environments Liang Zhao, Sherif Sakr, Alan Fekete, Hiroshi Wada, Anna Liu National ICT Australia (NICTA) School of Computer Science and Engineering
Consumer-view of consistency properties: definition, measurement, and exploitation
Consumer-view of consistency properties: definition, measurement, and exploitation Alan Fekete (University of Sydney) Alan.Fekete@sydney.edu.au PaPoC, London, April 2016 Limitations of this talk Discuss
A Cloud Storage Adaptable to Read-Intensive and Write-Intensive Workload
DEIM Forum 2011 C3-3 152-8552 2-12-1 E-mail: {nakamur6,shudo}@is.titech.ac.jp.,., MyCassandra, Cassandra MySQL, 41.4%, 49.4%.,, Abstract A Cloud Storage Adaptable to Read-Intensive and Write-Intensive
Performance Evaluation of NoSQL Databases
Performance Evaluation of NoSQL Databases A Case Study - John Klein, Ian Gorton, Neil Ernst, Patrick Donohoe, Kim Pham, Chrisjan Matser February 2015 PABS '15: Proceedings of the 1st Workshop on Performance
Harmony: Towards Automated Self-Adaptive Consistency in Cloud Storage
Harmony: Towards Automated Self-Adaptive Consistency in Cloud Storage Houssem-Eddine Chihoub, Shadi Ibrahim, Gabriel Antoniu INRIA Rennes-Bretagne Atlantique Rennes, France {houssem-eddine.chihoub, shadi.ibrahim,
class 20 updates 2.0 prof. Stratos Idreos
class 20 updates 2.0 prof. Stratos Idreos HTTP://DASLAB.SEAS.HARVARD.EDU/CLASSES/CS165/ UPDATE table_name SET column1=value1,column2=value2,... WHERE some_column=some_value INSERT INTO table_name VALUES
class 17 updates prof. Stratos Idreos
class 17 updates prof. Stratos Idreos HTTP://DASLAB.SEAS.HARVARD.EDU/CLASSES/CS165/ UPDATE table_name SET column1=value1,column2=value2,... WHERE some_column=some_value INSERT INTO table_name VALUES (value1,value2,value3,...)
Advances in Data Management - NoSQL, NewSQL and Big Data A.Poulovassilis
Advances in Data Management - NoSQL, NewSQL and Big Data A.Poulovassilis 1 NoSQL So-called NoSQL systems offer reduced functionalities compared to traditional Relational DBMS, with the aim of achieving
YCSB+T: Bench-marking Web-Scale Transactional Databases
YCSB+T: Bench-marking Web-Scale Transactional Databases Varun Razdan 1, Rahul Jobanputra 2, Aman Modi 3, Shruti Dumbare 4 1234Student, Dept. Of CE, Sinhgad Institute of Technology, Maharashtra, India Abstract-
Benchmarking Replication and Consistency Strategies in Cloud Serving Databases: HBase and Cassandra
Benchmarking Replication and Consistency Strategies in Cloud Serving Databases: HBase and Cassandra Huajin Wang 1,2, Jianhui Li 1(&), Haiming Zhang 1, and Yuanchun Zhou 1 1 Computer Network Information
Quantitative Analysis of Consistency in NoSQL Key-value Stores
Quantitative Analysis of Consistency in NoSQL Key-value Stores Si Liu, Son Nguyen, Jatin Ganhotra, Muntasir Raihan Rahman Indranil Gupta, and José Meseguer February 206 NoSQL Systems Growing quickly $3.4B
Distributed Databases: SQL vs NoSQL
Distributed Databases: SQL vs NoSQL Seda Unal, Yuchen Zheng April 23, 2017 1 Introduction Distributed databases have become increasingly popular in the era of big data because of their advantages over
D-Zipfian: A Decentralized Implementation of Zipfian
D-Zipfian: A Decentralized Implementation of Zipfian Sumita Barahmand, Shahram Ghandeharizadeh Computer Science Department University of Southern California Los Angeles, California {barahman,shahram}@usc.edu
A Practical Scalable Distributed B-Tree
A Practical Scalable Distributed B-Tree CS 848 Paper Presentation Marcos K. Aguilera, Wojciech Golab, Mehul A. Shah PVLDB 08 March 8, 2010 Presenter: Evguenia (Elmi) Eflov Presentation Outline 1 Background
Review on Consistency as a Service: Auditing Cloud Consistency (CAAS Model)
International Journal of scientific research and management (IJSRM) Volume 3 Issue 5 Pages 2807-2811 2015 \ Website: www.ijsrm.in ISSN (e): 2321-3418 Review on Consistency as a Service: Auditing Cloud
THE NOSQL MOUVEMENT (2)
THE NOSQL MOUVEMENT (2) GENOVEVA VARGAS SOLAR FRENCH COUNCIL OF SCIENTIFIC RESEARCH, LIG-LAFMIA, FRANCE Genoveva.Vargas@imag.fr http://www.vargas-solar.com/bigdata-managment Data model Consistency Storage
Advances in Data Management - NoSQL, NewSQL and Big Data A.Poulovassilis
Advances in Data Management - NoSQL, NewSQL and Big Data A.Poulovassilis 1 NoSQL So-called NoSQL systems offer reduced functionalities compared to traditional Relational DBMSs, with the aim of achieving
Inherent Replica Inconsistency in Cassandra
Inherent Replica Inconsistency in Cassandra Xiangdong Huang, Jianmin Wang, Jian Bai, Guiguang Ding, Mingsheng Long School of Software, Tsinghua University, Beijing China {huangxd2,baij2,longmc}@mails.tsinghua.edu.cn,
VoltDB vs. Redis Benchmark
Volt vs. Redis Benchmark Motivation and Goals of this Evaluation Compare the performance of several distributed databases that can be used for state storage in some of our applications Low latency is expected
Extensions of BG for Testing and Benchmarking Alternative Implementations of Feed Following
Extensions of BG for Testing and Benchmarking Alternative Implementations of Feed Following Sumita Barahmand, Shahram Ghandeharizadeh and Dobromir Montauk Database Laboratory Technical Report 2014-01 Computer
Quantitative Analysis of Consistency in NoSQL Key-Value Stores
Quantitative Analysis of Consistency in NoSQL Key-Value Stores Si Liu (B), Son Nguyen, Jatin Ganhotra, Muntasir Raihan Rahman, Indranil Gupta, and José Meseguer Department of Computer Science, University
MINING OF LARGE SCALE DATA USING BESTPEER++ STRATEGY
MINING OF LARGE SCALE DATA USING BESTPEER++ STRATEGY *S. ANUSUYA,*R.B. ARUNA,*V. DEEPASRI,**DR.T. AMITHA *UG Students, **Professor Department Of Computer Science and Engineering Dhanalakshmi College of
Causal Consistency for Data Stores and Applications as They are
[DOI: 10.2197/ipsjjip.25.775] Regular Paper Causal Consistency for Data Stores and Applications as They are Kazuyuki Shudo 1,a) Takashi Yaguchi 1, 1 Received: November 3, 2016, Accepted: May 16, 2017 Abstract:
NOSQL DATABASE PERFORMANCE BENCHMARKING - A CASE STUDY
STUDIA UNIV. BABEŞ BOLYAI, INFORMATICA, Volume LXIII, Number 1, 2018 DOI: 10.24193/subbi.2018.1.06 NOSQL DATABASE PERFORMANCE BENCHMARKING - A CASE STUDY CAMELIA-FLORINA ANDOR AND BAZIL PÂRV Abstract.
II. METHODS AND MATERIAL
International Journal of Scientific Research in Computer Science, Engineering and Information Technology 2017 IJSRCSEIT Volume 2 Issue 5 ISSN : 2456-3307 Recovering Data Stability Service for Preserving
A Survey Paper on NoSQL Databases: Key-Value Data Stores and Document Stores
A Survey Paper on NoSQL Databases: Key-Value Data Stores and Document Stores Nikhil Dasharath Karande 1 Department of CSE, Sanjay Ghodawat Institutes, Atigre nikhilkarande18@gmail.com Abstract- This paper
Failover Characteristics of leading NoSQL databases: Aerospike, Cassandra, Couchbase and MongoDB
Failover Characteristics of leading NoSQL databases: Aerospike, Cassandra, Couchbase and MongoDB Denis Nelubin, Director of Technology, Thumbtack Technology Ben Engber, CEO, Thumbtack Technology Overview
10. Replication. Motivation
10. Replication Page 1 10. Replication Motivation Reliable and high-performance computation on a single instance of a data object is prone to failure. Replicate data to overcome single points of failure
Eventual Consistency Today: Limitations, Extensions and Beyond
Eventual Consistency Today: Limitations, Extensions and Beyond Peter Bailis and Ali Ghodsi, UC Berkeley - Nomchin Banga Outline Eventual Consistency: History and Concepts How eventual is eventual consistency?
A Queueing Network Model for Performance Prediction of Apache Cassandra
A Queueing Network Model for Performance Prediction of Apache Cassandra Salvatore Dipietro Imperial College London, UK s.dipietro@imperial.ac.uk Giuliano Casale Imperial College London, UK g.casale@imperial.ac.uk
Scalable Data Analysis (CIS )
Scalable Data Analysis (CIS 602-02) Databases Dr. David Koop Relational Database Architecture [Hellerstein et al., Architecture of a Database System] 2 Relational Databases: One size fits all? Lots of
NoSQL Databases MongoDB vs Cassandra. Kenny Huynh, Andre Chik, Kevin Vu
NoSQL Databases MongoDB vs Cassandra Kenny Huynh, Andre Chik, Kevin Vu Introduction - Relational database model - Concept developed in 1970 - Inefficient - NoSQL - Concept introduced in 1980 - Related
Strong Consistency & CAP Theorem
Strong Consistency & CAP Theorem CS 240: Computing Systems and Concurrency Lecture 15 Marco Canini Credits: Michael Freedman and Kyle Jamieson developed much of the original material. Consistency models
Data Consistency Properties and the Trade offs in Commercial Cloud Storages: the Consumers Perspective
Data Consistency Properties and the Trade offs in Commercial Cloud Storages: the Consumers Perspective Hiroshi Wada, Alan Fekete, Liang Zhao, Kevin Lee and Anna Liu National ICT Australia NICTA School
Ashok Kumar P S, Md Ateeq Ur Rahman Department of CSE, JNTU/ SCET, Hyderabad, Andra Pradesh, India
International Journal of Scientific Research in Computer Science, Engineering and Information Technology 2017 IJSRCSEIT Volume 2 Issue 5 ISSN : 2456-3307 Implications of NoSQL Transaction Model in Cloud
Ch06. NoSQL Part III.
Ch06. NoSQL Part III. Joonho Kwon Data Science Laboratory, PNU 2017. Spring Adapted from Dr.-Ing. Sebastian Michel s slides Recap: Configurations R/W Configuration Kind ofconsistency W=N and R=1 Read optimized
New Oracle NoSQL Database APIs that Speed Insertion and Retrieval
New Oracle NoSQL Database APIs that Speed Insertion and Retrieval O R A C L E W H I T E P A P E R F E B R U A R Y 2 0 1 6 1 NEW ORACLE NoSQL DATABASE APIs that SPEED INSERTION AND RETRIEVAL Introduction
Final Exam Logistics. CS 133: Databases. Goals for Today. Some References Used. Final exam take-home. Same resources as midterm
Final Exam Logistics CS 133: Databases Fall 2018 Lec 25 12/06 NoSQL Final exam take-home Available: Friday December 14 th, 4:00pm in Olin Due: Monday December 17 th, 5:15pm Same resources as midterm Except
SCALABLE CONSISTENCY AND TRANSACTION MODELS
Data Management in the Cloud SCALABLE CONSISTENCY AND TRANSACTION MODELS 69 Brewer s Conjecture Three properties that are desirable and expected from realworld shared-data systems C: data consistency A:
Performance and Forgiveness. June 23, 2008 Margo Seltzer Harvard University School of Engineering and Applied Sciences
Performance and Forgiveness June 23, 2008 Margo Seltzer Harvard University School of Engineering and Applied Sciences Margo Seltzer Architect Outline A consistency primer Techniques and costs of consistency
Eventual Consistency Today: Limitations, Extensions and Beyond
Eventual Consistency Today: Limitations, Extensions and Beyond Peter Bailis and Ali Ghodsi, UC Berkeley Presenter: Yifei Teng Part of slides are cited from Nomchin Banga Road Map Eventual Consistency:
Leader or Majority: Why have one when you can have both? Improving Read Scalability in Raft-like consensus protocols
Leader or Majority: Why have one when you can have both? Improving Read Scalability in Raft-like consensus protocols Vaibhav Arora, Tanuj Mittal, Divyakant Agrawal, Amr El Abbadi * and Xun Xue, Zhiyanan,
CSE 544 Principles of Database Management Systems. Magdalena Balazinska Winter 2015 Lecture 14 NoSQL
CSE 544 Principles of Database Management Systems Magdalena Balazinska Winter 2015 Lecture 14 NoSQL References Scalable SQL and NoSQL Data Stores, Rick Cattell, SIGMOD Record, December 2010 (Vol. 39, No.
Trading latency for freshness in storage systems
Trading latency for freshness in storage systems James Cipar September 27, 2012 Abstract Many storage systems have to provide extremely high throughput updates and low latency read queries. In practice,
F1: A Distributed SQL Database That Scales
F1: A Distributed SQL Database That Scales Jeff Shute Radek Vingralek Bart Samwel Ben Handy Chad Whipkey Eric Rollins Mircea Oancea Kyle Littlefield David Menestrina Stephan Ellner John Cieslewicz Ian
Challenges for Data Driven Systems
Challenges for Data Driven Systems Eiko Yoneki University of Cambridge Computer Laboratory Data Centric Systems and Networking Emergence of Big Data Shift of Communication Paradigm From end-to-end to data
Faster Concurrent Range Queries with Contention Adapting Search Trees Using Immutable Data
Faster Concurrent Range Queries with Contention Adapting Search Trees Using Immutable Data Kjell Winblad Department of Information Technology, Uppsala University, Sweden kjell.winblad@it.uu.se Abstract
Introduction to store data in Redis, a persistent and fast key-value database
AMICT 2010-2011. pp. 39 49 39 Introduction to store data in Redis, a persistent and fast key-value database Matti Paksula Department of Computer Science, University of Helsinki P.O.Box 68, FI-00014 University
LazyBase: Trading freshness and performance in a scalable database
LazyBase: Trading freshness and performance in a scalable database (EuroSys 2012) Jim Cipar, Greg Ganger, *Kimberly Keeton, *Craig A. N. Soules, *Brad Morrey, *Alistair Veitch PARALLEL DATA LABORATORY
Design and Validation of Distributed Data Stores using Formal Methods
Design and Validation of Distributed Data Stores using Formal Methods Peter Ölveczky University of Oslo University of Illinois at Urbana-Champaign Based on joint work with Jon Grov, Indranil Gupta, Si
Evaluating Auto Scalable Application on Cloud
Evaluating Auto Scalable Application on Cloud Takashi Okamoto Abstract Cloud computing enables dynamic scaling out of system resources, depending on workloads and data volume. In addition to the conventional
Active Cloud DB: A Database-Agnostic HTTP API to Key-Value Datastores
Active Cloud DB: A Database-Agnostic HTTP API to Key-Value Datastores Chris Bunch Jonathan Kupferman Chandra Krintz Computer Science Department University of California, Santa Barbara April 26, 2010 UCSB
Facebook Tao Distributed Data Store for the Social Graph
L. Lancia, G. Salillari Cloud Computing Master Degree in Data Science Sapienza Università di Roma Facebook Tao Distributed Data Store for the Social Graph L. Lancia & G. Salillari 1 / 40 Table of Contents
Improving Logical Clocks in Riak with Dotted Version Vectors: A Case Study
Improving Logical Clocks in Riak with Dotted Version Vectors: A Case Study Ricardo Gonçalves Universidade do Minho, Braga, Portugal, tome@di.uminho.pt Abstract. Major web applications need the partition-tolerance
Overloaded! A Model-based Approach to Database Stress Testing
Overloaded! A Model-based Approach to Database Stress Testing Jorge Augusto Meira 1,2, Eduardo Cunha de Almeida 1, Dongsun Kim 2, Edson Ramiro Lucas Filho 1, and Yves Le Traon 2 1 UFPR{jmeira,eduardo,erlfilho}@inf.ufpr.br
The mixed workload CH-BenCHmark. Hybrid y OLTP&OLAP Database Systems Real-Time Business Intelligence Analytical information at your fingertips
The mixed workload CH-BenCHmark Hybrid y OLTP&OLAP Database Systems Real-Time Business Intelligence Analytical information at your fingertips Richard Cole (ParAccel), Florian Funke (TU München), Leo Giakoumakis
On Scalability of Two NoSQL Data Stores for Processing. Interactive Social Networking Actions
On Scalability of Two NoSQL Data Stores for Processing Interactive Social Networking Actions Sumita Barahmand, Shahram Ghandeharizadeh, and Jia Li Database Laboratory Technical Report 2014-11 Computer
10.0 Towards the Cloud
10.0 Towards the Cloud Distributed Data Management Wolf-Tilo Balke Christoph Lofi Institut für Informationssysteme Technische Universität Braunschweig http://www.ifis.cs.tu-bs.de 10.0 Special Purpose Database
CIB Session 12th NoSQL Databases Structures
CIB Session 12th NoSQL Databases Structures By: Shahab Safaee & Morteza Zahedi Software Engineering PhD Email: safaee.shx@gmail.com, morteza.zahedi.a@gmail.com cibtrc.ir cibtrc cibtrc 2 Agenda What is
A Graphical Interactive Debugger for Distributed Systems
A Graphical Interactive Debugger for Distributed Systems Doug Woos March 23, 2018 1 Introduction Developing correct distributed systems is difficult. Such systems are nondeterministic, since the network
Probabilistically Bounded Staleness for Practical Partial Quorums
Probabilistically Bounded Staleness for Practical Partial Quorums Peter Bailis Shivaram Venkataraman Joseph M. Hellerstein Michael Franklin Ion Stoica Electrical Engineering and Computer Sciences University
5 th TPC Technology Conference on Performance Evaluation and Benchmarking TPCTC 2013
5 th TPC Technology Conference on Performance Evaluation and Benchmarking TPCTC 2013 Raghunath Nambiar General Chair Member of TPC Steering Committee and Public Relations Distinguished Engineer, Datacenter
Design and Analysis of High Performance Crypt-NoSQL
Design and Analysis of High Performance Crypt-NoSQL Ming-Hung Shih and J. Morris Chang Abstract NoSQL databases have become popular with enterprises due to their scalable and flexible storage management
CIS 601 Graduate Seminar. Dr. Sunnie S. Chung Dhruv Patel ( ) Kalpesh Sharma ( )
Guide: CIS 601 Graduate Seminar Presented By: Dr. Sunnie S. Chung Dhruv Patel (2652790) Kalpesh Sharma (2660576) Introduction Background Parallel Data Warehouse (PDW) Hive MongoDB Client-side Shared SQL
CS555: Distributed Systems [Fall 2017] Dept. Of Computer Science, Colorado State University
![CS555: Distributed Systems [Fall 2017] Dept. Of Computer Science, Colorado State University](/thumbs/89/98876845.jpg "CS555: Distributed Systems [Fall 2017] Dept. Of Computer Science, Colorado State University")
CS 555: DISTRIBUTED SYSTEMS [REPLICATION & CONSISTENCY] Frequently asked questions from the previous class survey Shrideep Pallickara Computer Science Colorado State University L25.1 L25.2 Topics covered
/ Cloud Computing. Recitation 9 March 17th and 19th, 2015
15-319 / 15-619 Cloud Computing Recitation 9 March 17th and 19th, 2015 Overview Administrative issues Tagging, 15619Project Last week s reflection Project 3.2 This week s schedule Project 3.3 Unit 4 -
Replicated Data Consistency Explained Baseball
doi:10.1145/2500500 A broader class of consistency guarantees can, and perhaps should, be offered to clients that read shared data. By Doug Terry Replicated Data Consistency Explained Through Baseball
CS6450: Distributed Systems Lecture 15. Ryan Stutsman
Strong Consistency CS6450: Distributed Systems Lecture 15 Ryan Stutsman Material taken/derived from Princeton COS-418 materials created by Michael Freedman and Kyle Jamieson at Princeton University. Licensed
Data Processing in Cloud with AVL Structure and Bootstrap Access Control
Available Online at www.ijcsmc.com International Journal of Computer Science and Mobile Computing A Monthly Journal of Computer Science and Information Technology ISSN 2320 088X IMPACT FACTOR: 5.258 IJCSMC,
NoSQL systems: sharding, replication and consistency. Riccardo Torlone Università Roma Tre
NoSQL systems: sharding, replication and consistency Riccardo Torlone Università Roma Tre Data distribution NoSQL systems: data distributed over large clusters Aggregate is a natural unit to use for data
Database Availability and Integrity in NoSQL. Fahri Firdausillah [M ]
![Database Availability and Integrity in NoSQL. Fahri Firdausillah [M ]](/thumbs/83/88388270.jpg "Database Availability and Integrity in NoSQL. Fahri Firdausillah [M ]")
Database Availability and Integrity in NoSQL Fahri Firdausillah [M031010012] What is NoSQL Stands for Not Only SQL Mostly addressing some of the points: nonrelational, distributed, horizontal scalable,
Migrating Oracle Databases To Cassandra
BY UMAIR MANSOOB Why Cassandra Lower Cost of ownership makes it #1 choice for Big Data OLTP Applications. Unlike Oracle, Cassandra can store structured, semi-structured, and unstructured data. Cassandra
When, Where & Why to Use NoSQL?
When, Where & Why to Use NoSQL? 1 Big data is becoming a big challenge for enterprises. Many organizations have built environments for transactional data with Relational Database Management Systems (RDBMS),
Topics. History. Architecture. MongoDB, Mongoose - RDBMS - SQL. - NoSQL
Databases Topics History - RDBMS - SQL Architecture - SQL - NoSQL MongoDB, Mongoose Persistent Data Storage What features do we want in a persistent data storage system? We have been using text files to
Towards the Prediction of the Performance and Energy Efficiency of Distributed Data Management Systems
Towards the Prediction of the Performance and Energy Efficiency of Distributed Data Management Systems Raik Niemann Institute of Information Systems University of Applied Science Hof, Germany raik.niemann@iisys.de
A Mid-Flight Synopsis of the BG Social Networking Benchmark
A Mid-Flight Synopsis of the BG Social Networking Benchmark Shahram Ghandeharizadeh and Sumita Barahmand Database Laboratory Technical Report 2013-03 Computer Science Department, USC Los Angeles, California
Adaptation in distributed NoSQL data stores
Adaptation in distributed NoSQL data stores Kostas Magoutis Department of Computer Science and Engineering University of Ioannina, Greece Institute of Computer Science (ICS) Foundation for Research and
SCALABLE DATABASES. Sergio Bossa. From Relational Databases To Polyglot Persistence.
SCALABLE DATABASES From Relational Databases To Polyglot Persistence Sergio Bossa sergio.bossa@gmail.com http://twitter.com/sbtourist About Me Software architect and engineer Gioco Digitale (online gambling
CISC 7610 Lecture 2b The beginnings of NoSQL
CISC 7610 Lecture 2b The beginnings of NoSQL Topics: Big Data Google s infrastructure Hadoop: open google infrastructure Scaling through sharding CAP theorem Amazon s Dynamo 5 V s of big data Everyone
Crescando: Predictable Performance for Unpredictable Workloads
Crescando: Predictable Performance for Unpredictable Workloads G. Alonso, D. Fauser, G. Giannikis, D. Kossmann, J. Meyer, P. Unterbrunner Amadeus S.A. ETH Zurich, Systems Group (Funded by Enterprise Computing
A Transaction Model for Management for Replicated Data with Multiple Consistency Levels
A Transaction Model for Management for Replicated Data with Multiple Consistency Levels Anand Tripathi Department of Computer Science & Engineering University of Minnesota, Minneapolis, Minnesota, 55455
Horizontal or vertical scalability? Horizontal scaling is challenging. Today. Scaling Out Key-Value Storage
Horizontal or vertical scalability? Scaling Out Key-Value Storage COS 418: Distributed Systems Lecture 8 Kyle Jamieson Vertical Scaling Horizontal Scaling [Selected content adapted from M. Freedman, B.