CS / Cloud Computing. Recitation 8 October 14 th and 16 th, 2014
|
|
|
- Job Cox
- 5 years ago
- Views:
Transcription
1 CS / Cloud Computing Recitation 8 October 14 th and 16 th, 2014
2 Announcements Encounter a general bug: Post on Piazza Encounter a grading bug: Post Privately on Piazza Don t ask if my answer is correct Search before posting Post feedback on OLI OLI does not show timer for Quiz! You have to maintain your own timer!
3 Module to Read UNIT 4: Cloud Storage Module 12: Cloud Storage Module 13: Case Studies: Distributed File Systems Module 14: Case Studies: NoSQL Databases Module 15: Case Studies: Cloud Object Storage Quiz 4: Cloud Storage
4 Project 3 Files vs. Databases File vs. Database Vertical Scaling in Databases Vertical Scaling Horizontal Scaling in Databases Horizontal Scaling Sharding Databases Provisioned Databases
5 Our Scenario User has to open a photo on his local machine Us er Us er VS HDD SSD
6 Our Scenario Which storage resource offers an improvement in performance and for what type of applications? Why? Which one would you utilize/receommend?
7 Brief overview of Project 3.2 Vertical scaling in storage technologies Compare between EBS Magnetic disks, and Solid State Drive Measure performance for three distinct scenarios FileIO MySQL Database HBase cluster Aim is to understand the benefits of employing faster storage systems.
8 Different Types of Storage Virtual Machine (Instances) Physical Machine (Server) Switches / Routers External Storage (Storage Subsystem) Elastic Block Store (EBS) EBS Remote copy Asynchronous Synchronous Copy Availability Zone Region CPU Mem HDD Memory Internal HDD (RAID?) RAM Disk Ephemeral Disk Virtual Machines Physical Resources Disaster Recovery
9 Different Types of Storage Memory - RAM Disk Inside the server Usually from several Gigabytes to several hundreds of Gigabytes Internal HDD (Hard Disk Drive) Mechanical Disk Usually from 100s Gigabytes to several Terabytes Work best with large files
10 Different Types of Storage Internal SSD (Solid State Drive) Data is stored on chips Much faster access Storage capacity is not as high as HDD, but it is slowly catching up
11 Different Types of Storage External Storage Subsystems Outside of the server Connected by cables via switches, routers, directors (Ethernet, Fiber ) Provide extra functionalities (Copy services, concurrent volume accesses, grouping, caching ) Shared by multiple servers Almost always employs RAID Capacity range from dozens of TB to 100s of TB
12 Different Types of Storage External Storage Subsystems IBM DS TB RAW 129TB useable w/raid 5 SYSTEM STORAGE On ebay: US $899, EMC SYMITRIX VMAX 40K
13 Project 3 : Upcoming Deadlines Unit 4: UNIT 4: Cloud Storage Module 12: Cloud Storage Module 13: Case Studies: Distributed File Systems
14 Disk Operations Commands mount/umount attach the file system found on some device to the big file tree dd Copy and convert file mkfs.ext4 Create an ext4 file system
15 Potential roadblocks Read the Vertical scaling section first and use Common disk operations in Linux Before running sysbench, bind your volume to /var/lib/mysql
16 Project 2 : Scaling Oh, no Not this again!!!
17 Motivations behind P Importance of warm-up Rapid scaling Identifying traffic pattern using CW Scaling too frequently (oscillating) Measurements More warmup = More dead instances Scale down!!! Heterogeneous resources Failure detection and handling Trade-offs
18 twitter ANALYTICS: THE 619 PROJECT
19 Congratulations Team FDU Building a performant web server is nontrivial Building a performant web server that gets huge amounts of data from MySQL is hard Building a performant web server that gets huge amounts of data from HBase is harder START NOW!!!
20 START NOW
21 Q1 : Semiprime Factorization Easy to implement? Can you optimize? How much impact does the calculation have on throughput? Semiprime factorization used in: RSA Blum-Blum-Shlub
22 Q2A : Naïve Sentiment Analysis Amazingly, despite the nice,cloudy weather, the BEST Hope for us to enjoy is to study CLOUD COMPUTING.Cloud is supper interesting. amazing 4 interesting 3 best 3 enjoy 1 nice 2 super 7 hope 2 study -100
23 Q2A : Naïve Sentiment Analysis Amazingly, despite the nice,cloudy weather, the BEST Hope for us to enjoy is to study CLOUD COMPUTING.Cloud is supper-interesting. amazing 4 interesting 3 best 3 enjoy 1 nice 2 super 7 hope 2 study -100
24 Q2B : Text Censorship Amazingly, despite the nice,cloudy weather, the BEST Hope for us to enjoy is to study CLOUD COMPUTING.Cloud is supper-interesting. Banned words pybhq vagrerfgvat
25 Q2B : Text Censorship Amazingly, despite the nice,cloudy weather, the BEST Hope for us to enjoy is to study CLOUD COMPUTING.Cloud is supper-interesting. Banned words cloud interesting
26 Guess the output Amazingly, despite the nice,cloudy weather, the BEST Hope for us to enjoy is to study CLOUD COMPUTING.Cloud is supper-interesting. Amazingly, despite the nice,cloudy? weather, the BEST Hope for us to enjoy is to study C***D COMPUTING.C***d is supper-i*********g. a b c cloudy c***dy c****y d
27 Guess the output Amazingly, despite the nice,cloudy weather, the BEST Hope for us to enjoy is to study CLOUD COMPUTING.Cloud is supper-interesting. Amazingly, despite the nice,cloudy weather, the BEST Hope for us to enjoy is to study C***D? COMPUTING.C***d is supper-i*********g. a b c d CLOUD C***D cloud c***d
28 Guess the output Amazingly, despite the nice,cloudy weather, the BEST Hope for us to enjoy is to study CLOUD COMPUTING.Cloud is supper-interesting. Amazingly, despite the nice,cloudy weather, the BEST Hope for us to enjoy is to study C***D COMPUTING.C***d? is supper-i*********g. a b c d Cloud C***D cloud C***d
29 Guess the output Amazingly, despite the nice,cloudy weather, the BEST Hope for us to enjoy is to study CLOUD COMPUTING.Cloud is supper-interesting. Amazingly, despite the nice,cloudy weather, the BEST Hope for us to enjoy is to study C***D COMPUTING.C***d is supper-i*********g.? a b c d s*******************g supper-i*********g supper-interesting supper-i**********g
30 Guess the output الحوسبة السحابیة ब दल क य ट ग 云计算クラウドコンピューティング ಕ ಪ וואָלקן קאַמפּיוטינ облачныхвычисленийג
31 This is the output n \الحوسبة السحابیة: :0 ब दल क य ट ग\n 云计算 \n クラウドコ \n ンピューティング \n ಕ ಪ \n קאַמפּיוטינ n \וואָלקן облачныхвычислений\nג \n
32 Tagging All instances used for 619 work should be tagged with: 15619project and value phase1. All instances in your HBase cluster should be tagged with: 15619backend and value hbase. All instances with MySQL installed should be tagged with: 15619backend and value mysql.
33 @1326
34 Questions?
CS / Cloud Compu1ng. Recita1on 8 March 4 th and 6 th, 2014
CS15-319 / 15-619 Cloud Compu1ng Recita1on 8 March 4 th and 6 th, 2014 Announcements Encounter a general bug: Post on Piazza Encounter a grading bug: Post Privately on Piazza Don t ask if my answer is
/ Cloud Computing. Recitation 8 March 1 st, 2016
15-319 / 15-619 Cloud Computing Recitation 8 March 1 st, 2016 1 Overview Administrative issues Office Hours, Piazza guidelines Last week s reflection Project 3.1, OLI Unit 3, Module 13, Quiz 6 This week
/ Cloud Computing. Recitation 8 October 18, 2016
15-319 / 15-619 Cloud Computing Recitation 8 October 18, 2016 1 Overview Administrative issues Office Hours, Piazza guidelines Last week s reflection Project 3.2, OLI Unit 3, Module 13, Quiz 6 This week
CS / Cloud Computing. Recitation 9 October 22 nd and 25 th, 2013
CS15-319 / 15-619 Cloud Computing Recitation 9 October 22 nd and 25 th, 2013 Announcements Encounter a general bug: Post on Piazza Encounter a grading bug: Post Privately on Piazza Don t ask if my answer
CS / Cloud Computing. Recitation 11 November 5 th and Nov 8 th, 2013
CS15-319 / 15-619 Cloud Computing Recitation 11 November 5 th and Nov 8 th, 2013 Announcements Encounter a general bug: Post on Piazza Encounter a grading bug: Post Privately on Piazza Don t ask if my
/ Cloud Computing. Recitation 7 February 24th & 26th, 2015
15-319 / 15-619 Cloud Computing Recitation 7 February 24th & 26th, 2015 1 Overview Administrative issues Office Hours, Piazza guidelines Last week s reflection Project 2.3, OLI unit 3 module 8 This week
/ Cloud Computing. Recitation 10 March 22nd, 2016
15-319 / 15-619 Cloud Computing Recitation 10 March 22nd, 2016 Overview Administrative issues Office Hours, Piazza guidelines Last week s reflection Project 3.3, OLI Unit 4, Module 15, Quiz 8 This week
/ Cloud Computing. Recitation 6 October 2 nd, 2018
15-319 / 15-619 Cloud Computing Recitation 6 October 2 nd, 2018 1 Overview Announcements for administrative issues Last week s reflection OLI unit 3 module 7, 8 and 9 Quiz 4 Project 2.3 This week s schedule
CS / Cloud Computing. Recitation 7 October 7 th and 9 th, 2014
CS15-319 / 15-619 Cloud Computing Recitation 7 October 7 th and 9 th, 2014 15-619 Project Students enrolled in 15-619 Since 12 units, an extra project worth 3-units Project will be released this week Team
/ Cloud Computing. Recitation 7 October 10, 2017
15-319 / 15-619 Cloud Computing Recitation 7 October 10, 2017 Overview Last week s reflection Project 3.1 OLI Unit 3 - Module 10, 11, 12 Quiz 5 This week s schedule OLI Unit 3 - Module 13 Quiz 6 Project
/ Cloud Computing. Recitation 5 September 26 th, 2017
15-319 / 15-619 Cloud Computing Recitation 5 September 26 th, 2017 1 Overview Administrative issues Office Hours, Piazza guidelines Last week s reflection Project 2.1, OLI Unit 2 modules 5 and 6 This week
/ Cloud Computing. Recitation 9 March 15th, 2016
15-319 / 15-619 Cloud Computing Recitation 9 March 15th, 2016 Overview Administrative issues Office Hours, Piazza guidelines Last week s reflection Project 3.2, OLI Unit 4, Module 14, Quiz 7 This week
/ Cloud Computing. Recitation 5 February 14th, 2017
15-319 / 15-619 Cloud Computing Recitation 5 February 14th, 2017 1 Overview Administrative issues Office Hours, Piazza guidelines Last week s reflection Project 2.1, OLI Unit 2 modules 5 and 6 This week
1
1 3 4 6 7 8 9 Link to Storage Benchmarking Primer Running sysbench and preparing data Use the prepare option to generate the data. Experiments Run sysbench with different storage systems and instance
/ Cloud Computing. Recitation 5 September 27 th, 2016
15-319 / 15-619 Cloud Computing Recitation 5 September 27 th, 2016 1 Overview Administrative issues Office Hours, Piazza guidelines Last week s reflection Project 2.1, OLI Unit 2 modules 5 and 6 This week
CS / Cloud Computing. Recitation 3 September 9 th & 11 th, 2014
CS15-319 / 15-619 Cloud Computing Recitation 3 September 9 th & 11 th, 2014 Overview Last Week s Reflection --Project 1.1, Quiz 1, Unit 1 This Week s Schedule --Unit2 (module 3 & 4), Project 1.2 Questions
/ Cloud Computing. Recitation 13 April 12 th 2016
15-319 / 15-619 Cloud Computing Recitation 13 April 12 th 2016 Overview Last week s reflection Project 4.1 Quiz 11 Budget issues Tagging, 15619Project This week s schedule Unit 5 - Modules 21 Project 4.2
Database Architecture 2 & Storage. Instructor: Matei Zaharia cs245.stanford.edu
Database Architecture 2 & Storage Instructor: Matei Zaharia cs245.stanford.edu Summary from Last Time System R mostly matched the architecture of a modern RDBMS» SQL» Many storage & access methods» Cost-based
HOW TO PLAN & EXECUTE A SUCCESSFUL CLOUD MIGRATION
HOW TO PLAN & EXECUTE A SUCCESSFUL CLOUD MIGRATION Steve Bertoldi, Solutions Director, MarkLogic Agenda Cloud computing and on premise issues Comparison of traditional vs cloud architecture Review of use
Aurora, RDS, or On-Prem, Which is right for you
Aurora, RDS, or On-Prem, Which is right for you Kathy Gibbs Database Specialist TAM Katgibbs@amazon.com Santa Clara, California April 23th 25th, 2018 Agenda RDS Aurora EC2 On-Premise Wrap-up/Recommendation
Discover the all-new CacheMount
Discover the all-new CacheMount 1 2 3 4 5 Why CacheMount and what are its problem solving abilities Cache function makes the hybrid cloud more efficient The key of CacheMount: Cache Volume User manual
CIT 668: System Architecture. Amazon Web Services
CIT 668: System Architecture Amazon Web Services Topics 1. AWS Global Infrastructure 2. Foundation Services 1. Compute 2. Storage 3. Database 4. Network 3. AWS Economics Amazon Services Architecture Regions
IBM IBM Open Systems Storage Solutions Version 4. Download Full Version :
IBM 000-742 IBM Open Systems Storage Solutions Version 4 Download Full Version : https://killexams.com/pass4sure/exam-detail/000-742 Answer: B QUESTION: 156 Given the configuration shown, which of the
Introduction to Database Services
Introduction to Database Services Shaun Pearce AWS Solutions Architect 2015, Amazon Web Services, Inc. or its affiliates. All rights reserved Today s agenda Why managed database services? A non-relational
1
1 2 3 6 7 8 9 10 Storage & IO Benchmarking Primer Running sysbench and preparing data Use the prepare option to generate the data. Experiments Run sysbench with different storage systems and instance
Mellanox InfiniBand Solutions Accelerate Oracle s Data Center and Cloud Solutions
Mellanox InfiniBand Solutions Accelerate Oracle s Data Center and Cloud Solutions Providing Superior Server and Storage Performance, Efficiency and Return on Investment As Announced and Demonstrated at
Topics. Big Data Analytics What is and Why Hadoop? Comparison to other technologies Hadoop architecture Hadoop ecosystem Hadoop usage examples
Hadoop Introduction 1 Topics Big Data Analytics What is and Why Hadoop? Comparison to other technologies Hadoop architecture Hadoop ecosystem Hadoop usage examples 2 Big Data Analytics What is Big Data?
Abstract /10/$26.00 c 2010 IEEE
Abstract Clustering solutions are frequently used in large enterprise and mission critical applications with high performance and availability requirements. This is achieved by deploying multiple servers
/ Cloud Computing. Recitation 13 April 14 th 2015
15-319 / 15-619 Cloud Computing Recitation 13 April 14 th 2015 Overview Last week s reflection Project 4.1 Budget issues Tagging, 15619Project This week s schedule Unit 5 - Modules 18 Project 4.2 Demo
Optimizing Server Designs for Speed
Optimizing Server Designs for Speed Optimizing Server Designs for Speed We will discuss the latest in server hardware, virtualization, and disk storage that boosts Skyward s performance. We will also discuss
EMC XTREMCACHE ACCELERATES VIRTUALIZED ORACLE
White Paper EMC XTREMCACHE ACCELERATES VIRTUALIZED ORACLE EMC XtremSF, EMC XtremCache, EMC Symmetrix VMAX and Symmetrix VMAX 10K, XtremSF and XtremCache dramatically improve Oracle performance Symmetrix
Benchmarking Cloud Serving Systems with YCSB 詹剑锋 2012 年 6 月 27 日
Benchmarking Cloud Serving Systems with YCSB 詹剑锋 2012 年 6 月 27 日 Motivation There are many cloud DB and nosql systems out there PNUTS BigTable HBase, Hypertable, HTable Megastore Azure Cassandra Amazon
Isilon: Raising The Bar On Performance & Archive Use Cases. John Har Solutions Product Manager Unstructured Data Storage Team
Isilon: Raising The Bar On Performance & Archive Use Cases John Har Solutions Product Manager Unstructured Data Storage Team What we ll cover in this session Isilon Overview Streaming workflows High ops/s
/ Cloud Computing. Recitation 9 March 17th and 19th, 2015
15-319 / 15-619 Cloud Computing Recitation 9 March 17th and 19th, 2015 Overview Administrative issues Tagging, 15619Project Last week s reflection Project 3.2 This week s schedule Project 3.3 Unit 4 -
Design a Remote-Office or Branch-Office Data Center with Cisco UCS Mini
White Paper Design a Remote-Office or Branch-Office Data Center with Cisco UCS Mini February 2015 2015 Cisco and/or its affiliates. All rights reserved. This document is Cisco Public. Page 1 of 9 Contents
Conceptual Modeling on Tencent s Distributed Database Systems. Pan Anqun, Wang Xiaoyu, Li Haixiang Tencent Inc.
Conceptual Modeling on Tencent s Distributed Database Systems Pan Anqun, Wang Xiaoyu, Li Haixiang Tencent Inc. Outline Introduction System overview of TDSQL Conceptual Modeling on TDSQL Applications Conclusion
DATABASE SCALE WITHOUT LIMITS ON AWS
The move to cloud computing is changing the face of the computer industry, and at the heart of this change is elastic computing. Modern applications now have diverse and demanding requirements that leverage
CHAPTER 11: IMPLEMENTING FILE SYSTEMS (COMPACT) By I-Chen Lin Textbook: Operating System Concepts 9th Ed.
CHAPTER 11: IMPLEMENTING FILE SYSTEMS (COMPACT) By I-Chen Lin Textbook: Operating System Concepts 9th Ed. File-System Structure File structure Logical storage unit Collection of related information File
The Cloud's Cutting Edge: ArcGIS for Server Use Cases for Amazon Web Services. David Cordes David McGuire Jim Herries Sridhar Karra
The Cloud's Cutting Edge: ArcGIS for Server Use Cases for Amazon Web Services David Cordes David McGuire Jim Herries Sridhar Karra Atlas Maps Jim Herries Atlas sample application The Esri Thematic Atlas
IBM MQ Appliance HA and DR Performance Report Model: M2001 Version 3.0 September 2018
IBM MQ Appliance HA and DR Performance Report Model: M2001 Version 3.0 September 2018 Sam Massey IBM MQ Performance IBM UK Laboratories Hursley Park Winchester Hampshire 1 Notices Please take Note! Before
AWS Solutions Architect Associate (SAA-C01) Sample Exam Questions
1) A company is storing an access key (access key ID and secret access key) in a text file on a custom AMI. The company uses the access key to access DynamoDB tables from instances created from the AMI.
THE DEFINITIVE GUIDE FOR AWS CLOUD EC2 FAMILIES
THE DEFINITIVE GUIDE FOR AWS CLOUD EC2 FAMILIES Introduction Amazon Web Services (AWS), which was officially launched in 2006, offers you varying cloud services that are not only cost effective but scalable
Achieving Horizontal Scalability. Alain Houf Sales Engineer
Achieving Horizontal Scalability Alain Houf Sales Engineer Scale Matters InterSystems IRIS Database Platform lets you: Scale up and scale out Scale users and scale data Mix and match a variety of approaches
OPERATING SYSTEM. Chapter 12: File System Implementation
OPERATING SYSTEM Chapter 12: File System Implementation Chapter 12: File System Implementation File-System Structure File-System Implementation Directory Implementation Allocation Methods Free-Space Management
Advanced Database Systems
Lecture II Storage Layer Kyumars Sheykh Esmaili Course s Syllabus Core Topics Storage Layer Query Processing and Optimization Transaction Management and Recovery Advanced Topics Cloud Computing and Web
2013 AWS Worldwide Public Sector Summit Washington, D.C.
2013 AWS Worldwide Public Sector Summit Washington, D.C. EMR for Fun and for Profit Ben Butler Sr. Manager, Big Data butlerb@amazon.com @bensbutler Overview 1. What is big data? 2. What is AWS Elastic
Choosing Hardware and Operating Systems for MySQL. Apr 15, 2009 O'Reilly MySQL Conference and Expo Santa Clara,CA by Peter Zaitsev, Percona Inc
Choosing Hardware and Operating Systems for MySQL Apr 15, 2009 O'Reilly MySQL Conference and Expo Santa Clara,CA by Peter Zaitsev, Percona Inc -2- We will speak about Choosing Hardware Choosing Operating
A GPFS Primer October 2005
A Primer October 2005 Overview This paper describes (General Parallel File System) Version 2, Release 3 for AIX 5L and Linux. It provides an overview of key concepts which should be understood by those
COMP 273 Winter physical vs. virtual mem Mar. 15, 2012
Virtual Memory The model of MIPS Memory that we have been working with is as follows. There is your MIPS program, including various functions and data used by this program, and there are some kernel programs
Accelerate Database Performance and Reduce Response Times in MongoDB Humongous Environments with the LSI Nytro MegaRAID Flash Accelerator Card
Accelerate Database Performance and Reduce Response Times in MongoDB Humongous Environments with the LSI Nytro MegaRAID Flash Accelerator Card The Rise of MongoDB Summary One of today s growing database
Using MySQL in a Virtualized Environment. Scott Seighman Systems Engineer Sun Microsystems
Using MySQL in a Virtualized Environment Scott Seighman Systems Engineer Sun Microsystems 1 Agenda Virtualization Overview > Why Use Virtualization > Options > Considerations MySQL & Virtualization Best
VoltDB vs. Redis Benchmark
Volt vs. Redis Benchmark Motivation and Goals of this Evaluation Compare the performance of several distributed databases that can be used for state storage in some of our applications Low latency is expected
Decentralized Distributed Storage System for Big Data
Decentralized Distributed Storage System for Big Presenter: Wei Xie -Intensive Scalable Computing Laboratory(DISCL) Computer Science Department Texas Tech University Outline Trends in Big and Cloud Storage
White Paper Amazon Aurora A Fast, Affordable and Powerful RDBMS
White Paper Amazon Aurora A Fast, Affordable and Powerful RDBMS TABLE OF CONTENTS Introduction 3 Multi-Tenant Logging and Storage Layer with Service-Oriented Architecture 3 High Availability with Self-Healing
IBM MQ Appliance HA and DR Performance Report Version July 2016
IBM MQ Appliance HA and DR Performance Report Version 2. - July 216 Sam Massey IBM MQ Performance IBM UK Laboratories Hursley Park Winchester Hampshire 1 Notices Please take Note! Before using this report,
NEC M100 Frequently Asked Questions September, 2011
What RAID levels are supported in the M100? 1,5,6,10,50,60,Triple Mirror What is the power consumption of M100 vs. D4? The M100 consumes 26% less energy. The D4-30 Base Unit (w/ 3.5" SAS15K x 12) consumes
745: Advanced Database Systems
745: Advanced Database Systems Yanlei Diao University of Massachusetts Amherst Outline Overview of course topics Course requirements Database Management Systems 1. Online Analytical Processing (OLAP) vs.
Extremely Fast Distributed Storage for Cloud Service Providers
Solution brief Intel Storage Builders StorPool Storage Intel SSD DC S3510 Series Intel Xeon Processor E3 and E5 Families Intel Ethernet Converged Network Adapter X710 Family Extremely Fast Distributed
RACKSPACE ONMETAL I/O V2 OUTPERFORMS AMAZON EC2 BY UP TO 2X IN BENCHMARK TESTING
RACKSPACE ONMETAL I/O V2 OUTPERFORMS AMAZON EC2 BY UP TO 2X IN BENCHMARK TESTING EXECUTIVE SUMMARY Today, businesses are increasingly turning to cloud services for rapid deployment of apps and services.
MySQL Database Scalability
MySQL Database Scalability Nextcloud Conference 2016 TU Berlin Oli Sennhauser Senior MySQL Consultant at FromDual GmbH oli.sennhauser@fromdual.com 1 / 14 About FromDual GmbH Support Consulting remote-dba
HPC File Systems and Storage. Irena Johnson University of Notre Dame Center for Research Computing
HPC File Systems and Storage Irena Johnson University of Notre Dame Center for Research Computing HPC (High Performance Computing) Aggregating computer power for higher performance than that of a typical
Take Risks But Don t Be Stupid! Patrick Eaton, PhD
Take Risks But Don t Be Stupid! Patrick Eaton, PhD preaton@google.com Take Risks But Don t Be Stupid! Patrick R. Eaton, PhD patrick@stackdriver.com Stackdriver A hosted service providing intelligent monitoring
Scaling Internet TV Content Delivery ALEX GUTARIN DIRECTOR OF ENGINEERING, NETFLIX
Scaling Internet TV Content Delivery ALEX GUTARIN DIRECTOR OF ENGINEERING, NETFLIX Inventing Internet TV Available in more than 190 countries 104+ million subscribers Lots of Streaming == Lots of Traffic
IBM Spectrum NAS, IBM Spectrum Scale and IBM Cloud Object Storage
IBM Spectrum NAS, IBM Spectrum Scale and IBM Cloud Object Storage Silverton Consulting, Inc. StorInt Briefing 2017 SILVERTON CONSULTING, INC. ALL RIGHTS RESERVED Page 2 Introduction Unstructured data has
Aerospike Scales with Google Cloud Platform
Aerospike Scales with Google Cloud Platform PERFORMANCE TEST SHOW AEROSPIKE SCALES ON GOOGLE CLOUD Aerospike is an In-Memory NoSQL database and a fast Key Value Store commonly used for caching and by real-time
The Oracle Database Appliance I/O and Performance Architecture
Simple Reliable Affordable The Oracle Database Appliance I/O and Performance Architecture Tammy Bednar, Sr. Principal Product Manager, ODA 1 Copyright 2012, Oracle and/or its affiliates. All rights reserved.
Accelerating Big Data: Using SanDisk SSDs for Apache HBase Workloads
WHITE PAPER Accelerating Big Data: Using SanDisk SSDs for Apache HBase Workloads December 2014 Western Digital Technologies, Inc. 951 SanDisk Drive, Milpitas, CA 95035 www.sandisk.com Table of Contents
The Lion of storage systems
The Lion of storage systems Rakuten. Inc, Yosuke Hara Mar 21, 2013 1 The Lion of storage systems http://www.leofs.org LeoFS v0.14.0 was released! 2 Table of Contents 1. Motivation 2. Overview & Inside
Paperspace. Architecture Overview. 20 Jay St. Suite 312 Brooklyn, NY Technical Whitepaper
Architecture Overview Copyright 2016 Paperspace, Co. All Rights Reserved June - 1-2017 Technical Whitepaper Paperspace Whitepaper: Architecture Overview Content 1. Overview 3 2. Virtualization 3 Xen Hypervisor
Massive Scalability With InterSystems IRIS Data Platform
Massive Scalability With InterSystems IRIS Data Platform Introduction Faced with the enormous and ever-growing amounts of data being generated in the world today, software architects need to pay special
Price Performance Analysis of NxtGen Vs. Amazon EC2 and Rackspace Cloud.
Price Performance Analysis of Vs. EC2 and Cloud. Performance Report: ECS Performance Analysis of Virtual Machines on ECS and Competitive IaaS Offerings An Examination of Web Server and Database Workloads
Improving System. Performance: Caches
Improving System Performance: Caches December 04 CSC201 Section 002 Fall, 2000 A Motivating Example Application: making a (mechanical) clock dozens of tools and pages of instructions, hundreds of parts
Chapter 11: Implementing File Systems
Chapter 11: Implementing File Systems Operating System Concepts 99h Edition DM510-14 Chapter 11: Implementing File Systems File-System Structure File-System Implementation Directory Implementation Allocation
PracticeTorrent. Latest study torrent with verified answers will facilitate your actual test
PracticeTorrent http://www.practicetorrent.com Latest study torrent with verified answers will facilitate your actual test Exam : C9020-668 Title : IBM Storage Technical V1 Vendor : IBM Version : DEMO
ThoughtSpot on AWS Quick Start Guide
ThoughtSpot on AWS Quick Start Guide Version 4.2 February 2017 Table of Contents Contents Chapter 1: Welcome to ThoughtSpot...3 Contact ThoughtSpot... 4 Chapter 2: Introduction... 6 About AWS...7 Chapter
RETI LOGICHE. Sito del corso:
RETI LOGICHE Sito del corso: http://vision.unipv.it/reti-logiche/ Design of Integrated Digital Systems System Level Register Transfer Level Gate Level Transistor Level Layout Level Mask Level 2 System
Chapter 11: Implementing File
Chapter 11: Implementing File Systems Chapter 11: Implementing File Systems File-System Structure File-System Implementation Directory Implementation Allocation Methods Free-Space Management Efficiency
Practical MySQL Performance Optimization. Peter Zaitsev, CEO, Percona July 02, 2015 Percona Technical Webinars
Practical MySQL Performance Optimization Peter Zaitsev, CEO, Percona July 02, 2015 Percona Technical Webinars In This Presentation We ll Look at how to approach Performance Optimization Discuss Practical
EMC VMAX 400K SPC-2 Proven Performance. Silverton Consulting, Inc. StorInt Briefing
EMC VMAX 400K SPC-2 Proven Performance Silverton Consulting, Inc. StorInt Briefing EMC VMAX 400K SPC-2 PROVEN PERFORMANCE PAGE 2 OF 10 Introduction In this paper, we analyze all- flash EMC VMAX 400K storage
Technology Insight Series
IBM ProtecTIER Deduplication for z/os John Webster March 04, 2010 Technology Insight Series Evaluator Group Copyright 2010 Evaluator Group, Inc. All rights reserved. Announcement Summary The many data
Software Engineering at VMware Dan Scales May 2008
Software Engineering at VMware Dan Scales May 2008 Eng_BC_Mod 1.Product Overview v091806 The Challenge Suppose that you have a very popular software platform: that includes hardware-level and OS code that
RA-GRS, 130 replication support, ZRS, 130
Index A, B Agile approach advantages, 168 continuous software delivery, 167 definition, 167 disadvantages, 169 sprints, 167 168 Amazon Web Services (AWS) failure, 88 CloudTrail Service, 21 CloudWatch Service,
Chapter 11: Implementing File Systems. Operating System Concepts 9 9h Edition
Chapter 11: Implementing File Systems Operating System Concepts 9 9h Edition Silberschatz, Galvin and Gagne 2013 Chapter 11: Implementing File Systems File-System Structure File-System Implementation Directory
Welcome! Considering a Warm Disaster Recovery Site?
Welcome! Considering a Warm Disaster Recovery Site? Today s Moderator: Chris Riley Director 410-771-5544 x4331 criley@syssrc.com Today s Presenter: Rich Glenn Director 410-771-5544 x4420 rglenn@syssrc.com
THE HYBRID CLOUD DATA STRATEGY
TITLE REDEFINING ALL CAPS VMAX INTERNAL, DENIS VILFORT, DARK CHIEF BACKGROUND EVANGELIST EMC 1 Data Business Value THE HYBRID CLOUD DATA STRATEGY 100% 90% 80% 70% 60% 50% 40% 30% PRIVATE CLOUD PUBLIC CLOUD
Storage Systems. Storage Systems
Storage Systems Storage Systems We already know about four levels of storage: Registers Cache Memory Disk But we've been a little vague on how these devices are interconnected In this unit, we study Input/output
Deterministic Storage Performance
Deterministic Storage Performance 'The AWS way' for Capacity Based QoS with OpenStack and Ceph Federico Lucifredi - Product Management Director, Ceph, Red Hat Sean Cohen - A. Manager, Product Management,
Cloud Storage with AWS: EFS vs EBS vs S3 AHMAD KARAWASH
Cloud Storage with AWS: EFS vs EBS vs S3 AHMAD KARAWASH Cloud Storage with AWS Cloud storage is a critical component of cloud computing, holding the information used by applications. Big data analytics,
Design a Remote-Office or Branch-Office Data Center with Cisco UCS Mini
White Paper Design a Remote-Office or Branch-Office Data Center with Cisco UCS Mini June 2016 2016 Cisco and/or its affiliates. All rights reserved. This document is Cisco Public. Page 1 of 9 Contents
Principal Solutions Architect. Architecting in the Cloud
Matt Tavis Principal Solutions Architect Architecting in the Cloud Cloud Best Practices Whitepaper Prescriptive guidance to Cloud Architects Just Search for Cloud Best Practices to find the link ttp://media.amazonwebservices.co
A New Key-value Data Store For Heterogeneous Storage Architecture Intel APAC R&D Ltd.
A New Key-value Data Store For Heterogeneous Storage Architecture Intel APAC R&D Ltd. 1 Agenda Introduction Background and Motivation Hybrid Key-Value Data Store Architecture Overview Design details Performance
PostgreSQL on Amazon. Christophe Pettus PostgreSQL Experts, Inc.
PostgreSQL on Amazon Christophe Pettus PostgreSQL Experts, Inc. christophe.pettus@pgexperts.com Selection bias. Cops mostly meet criminals. Doctors mostly meet sick people. Database consultants mostly
RUNNING PETABYTE-SIZED CLUSTERS
1 RUNNING PETABYTE-SIZED CLUSTERS CASE STUDIES FROM THE REAL WORLD 2 GROWTH OF UNSTRUCTURED DATA 80% 74% 67% 2013 2015 2017 37 EB Total Capacity Shipped, Worldwide 71 EB 133 EB Source: IDC Unstructured
How CloudEndure Disaster Recovery Works
How CloudEndure Disaster Recovery Works Technical White Paper How CloudEndure Disaster Recovery Works THE TECHNOLOGY BEHIND CLOUDENDURE S ENTERPRISE-GRADE DISASTER RECOVERY SOLUTION Introduction CloudEndure
HPE SimpliVity. The new powerhouse in hyperconvergence. Boštjan Dolinar HPE. Maribor Lancom
HPE SimpliVity The new powerhouse in hyperconvergence Boštjan Dolinar HPE Maribor Lancom 2.2.2018 Changing requirements drive the need for Hybrid IT Application explosion Hybrid growth 2014 5,500 2015
I/O. Disclaimer: some slides are adopted from book authors slides with permission 1
I/O Disclaimer: some slides are adopted from book authors slides with permission 1 Thrashing Recap A processes is busy swapping pages in and out Memory-mapped I/O map a file on disk onto the memory space
Storage Optimization with Oracle Database 11g
Storage Optimization with Oracle Database 11g Terabytes of Data Reduce Storage Costs by Factor of 10x Data Growth Continues to Outpace Budget Growth Rate of Database Growth 1000 800 600 400 200 1998 2000
CS3210: Crash consistency
CS3210: Crash consistency Kyle Harrigan 1 / 45 Administrivia Lab 4 Part C Due Tomorrow Quiz #2. Lab3-4, Ch 3-6 (read "xv6 book") Open laptop/book, no Internet 2 / 45 Summary of cs3210 Power-on -> BIOS
IBM Europe Announcement ZG , dated October 23, 2007
IBM Europe Announcement ZG07-0718, dated October 23, 2007 IBM System Storage DS4000 series enriched with RAID 6 support, and new upgrade features for FlashCopy, Enhanced Remote Mirroring, and storage partitioning
RAMCloud. Scalable High-Performance Storage Entirely in DRAM. by John Ousterhout et al. Stanford University. presented by Slavik Derevyanko
RAMCloud Scalable High-Performance Storage Entirely in DRAM 2009 by John Ousterhout et al. Stanford University presented by Slavik Derevyanko Outline RAMCloud project overview Motivation for RAMCloud storage: