Cross-layer Optimization for Virtual Machine Resource Management
|
|
- Julian Lucas
- 5 years ago
- Views:
Transcription
1 Cross-layer Optimization for Virtual Machine Resource Management Ming Zhao, Arizona State University Lixi Wang, Amazon Yun Lv, Beihang Universituy Jing Xu, Google Virtualized Infrastructures, Systems, & Applications QoS in Clouds No support for QoS by existing cloud service providers Users have to pay for capacity, not performance But ultimately, users care about only performance Amazon EC2 Service Level Agreement Monthly Uptime Percentage Service Credit <99.95% but 99.% 1% <99.% 3% Instance Type vcpu Memory (GB) Storage (GB) Clock Speed (GHz) t2.micro 1 1 EBS Only 2.5 t2.small 1 2 EBS Only 2.5 t2.medium 2 4 EBS Only
2 Challenges to QoS Guarantees 6 Dynamic VM workloads and dynamic resource contention But existing resource management treats VMs as black boxes Dynamic workloads VMM HOST Request Rate VMs Time Dynamic contention Rack Cluster Zone o Unable to adapt applications according to changing resource availability STORAGE 3 Motivations Many applications need to be tuned according to resource availability, e.g., o A web server s number of concurrent threads o A database s query cost estimation o A search engine s crawling, indexing, or searching strategy o A simulator s modeling resolution o o Only need to tuned once on physical machines But when they are virtualized, they are stuck with their initial configurations o VM-level resource contention is hidden to the applications 4 2
3 Motivating Examples When the database VM s resource allocation changes, different query optimization leads to different performance o E.g., sequential_page_cost and random_page_cost (seq:rand) Execution Time(s) seq:rand=1:8 seq:rand=1: I/O Allocation (KB/s) Varying VM disk bandwidth for TPC-H Q8 Execution Time (s) Memory(MB) seq:rand=1:8 seq:rand=1:4 Varying VM memory allocation for TPC-H Q8 5 Motivating Examples When the map service VM s resource allocation changes, different map configuration decides response time o E.g., JPEG compression quality (JCQ) Response Time (ms) QoS Target JCQ = 8 JCQ = Network Allocation(Mb/s) 6 3
4 Typical VM Resource Management VMs managed as blackboxes Applications unware of VM resource variability Application & VM Sensors W(t), R(t) P(t) Performance Model Modeling Real time Monitoring R(t+1) Prediction Application 1 VM 1 Virtual Machines Dynamic Resource Allocation Resource Allocator W(t): Workload characteristics R(t): VM resource usages P(t): Query performance Physical Machine 7 Solution: Cross-layer Optimization Shares VM resource availability with the guests Adapts application configurations accordingly Application & VM Sensors W(t), R(t) P(t) Performance Model Modeling Real time Monitoring R(t+1) Prediction adaptation Application 1 R * (t+1) Dynamic Resource Allocation Resource Allocator VM 1 Virtual Machines W(t): Workload characteristics R(t): VM resource usages P(t): Query performance Physical Machine 8 4
5 Outline Introduction Approach Results Conclusions 9 Research Questions How to pass VM resource info from host to guest? o Through middleware running host and guests o No change to applications or VM systems How to adapt applications accordingly? o What configuration parameters to tune? Based on application knowledge Using machine learning methods (e.g., PCA) Not the focus of this study o How to tune the parameters according to the VM resource availability? 1 5
6 General Approach Goal: find the optimal configuration C i_opt for application i that maximizes its performance P i for a given VM resource allocation R i Method: o Create a model C i P i for different resource allocations R i E.g., using regression analysis o Use this mapping to find C i_opt for any given resource allocation R i 11 Dynamic Application Adaptation Application & VM Sensors W(t), R(t) P(t) Performance Model Modeling Real time Monitoring R(t+1) Prediction Adaptation using C i_opt Application 1 R * (t+1) Dynamic Resource Allocation Resource Allocator VM 1 Virtual Machines W(t): Workload characteristics R(t): VM resource usages P(t): Query performance Physical Machine Host-layer resource adjustment at fine time granularity (e.g., every 1s) Guest-layer adaptation at coarse time granularity (e.g., every minute) Performance model can be quickly updated (e.g., using fuzzy modeling) 12 6
7 Case Study: Virtualized Databases Databases represent applications with sophisticated internal optimizations o Query optimizer automatically evaluates the cost of different query execution plans and chooses the most efficient one Cross-layer optimization for virtualized databases o Adapts the query cost estimation and find the optimal query plan for its current resource availability o E.g., Adapts sequential_page_cost to random_page_cost ratio 13 Database C i P i Model Run a simple query that reads a large table with either sequential- or index-scan methods Iterate with different I/O allocations Measure performance impact for each scanning method Build mapping between I/O allocations and the rand:seq Normalized value rand seq seq:rand I/O Allocation (MB/s) 14 7
8 Evaluation Hardware: a server with 2 six-core Xeon processors, 32GB RAM, and 5GB SAS disk VM environment: o Xen with Ubuntu Linux Benchmark: o TPC-H queries 15 TPC-H Dynamic: dynamically adjust seq:rand based on VM s current resource availability Static: seq:rand fixed to 1:4 Dynamic improves performance by 33.5% 16 8
9 Case Study: Virtualized Map Services Map services represent applications that can tune their QoS based on resource availability o E.g., JCQ affects response time and image quality o Higher JCQ better map resolution, but more data transfer 22ms QoS 17ms QoS Optimal JCQ Workload Intensity (# of clients) 15 Network Bandwidth(Mbps) 17 Evaluation Hardware: a server with 2 six-core Xeon processors, 32GB RAM, and 5GB SAS disk VM environment: o Microsoft Hyper-V 6.2 with Windows Server Benchmark: o Terrafly: a production web-based map system 18 9
10 TerraFly with a Competing VM 25 Network bandwidth variation due to a competing FTP workload Network Bandwidth Allocation(Mbps) 15 5 Dynamic vs. static JCQ settings Dynamic always meets SLO; improves image quality by 4% JCQ Time (s) Dynamic JCQ Static (JCQ = 8) 4 Static (JCQ =3) Time (s) Static (JCQ = 3) 17 Static (JCQ = 8) 16 Dynamic JCQ QoS Target Time(s) 19 Response Time(ms) TerraFly with Varying Workload Real workload variation Dynamic vs. static JCQ settings Dynamic always meets SLO; improves image quality by 26.3% Client Session JCQ Response Time(ms) Time(hr) Dynamic JCQ Static (JCQ = 8) Static (JCQ = 3) Time(hr) Dynamic JCQ Static (JCQ = 8) Static (JCQ = 3) QoS Target Time(hr) 2 1
11 Conclusions Cloud is dynamic o It is important to enable applications to adapt to changing resource availability in the cloud A systematic solution with cross-layer optimization o 33.5% improvement in performance for TPC-H o 4% in image quality for TerraFly Future work o Distributed/parallel applications o Integration with VM migrations 21 Acknowledgement Sponsors o National Science Foundation: CAREER award CNS , CNS , IIS , and CMMI VISA Research Lab o Thanks! Questions? 22 11
Cross-layer Optimization for Virtual Machine Resource Management
Cross-layer Optimization for Virtual Machine Resource Management Ming Zhao Arizona State University Tempe, AZ, USA mingzhao@asu.edu Lixi Wang Amazon.com Seattle, WA, USA lwang7fiu@gmail.com Yun Lv Beihang
More informationApplication-aware Cross-layer Virtual Machine Resource Management
Application-aware Cross-layer Virtual Machine Resource Management Lixi Wang Jing Xu Ming Zhao School of Computing and Information Sciences Florida International University, Miami, FL, USA {lwang007,jxu,ming}@cs.fiu.edu
More informationAutomated Control for Elastic Storage Harold Lim, Shivnath Babu, Jeff Chase Duke University
D u k e S y s t e m s Automated Control for Elastic Storage Harold Lim, Shivnath Babu, Jeff Chase Duke University Motivation We address challenges for controlling elastic applications, specifically storage.
More informationQuantifying Load Imbalance on Virtualized Enterprise Servers
Quantifying Load Imbalance on Virtualized Enterprise Servers Emmanuel Arzuaga and David Kaeli Department of Electrical and Computer Engineering Northeastern University Boston MA 1 Traditional Data Centers
More informationTHE DEFINITIVE GUIDE FOR AWS CLOUD EC2 FAMILIES
THE DEFINITIVE GUIDE FOR AWS CLOUD EC2 FAMILIES Introduction Amazon Web Services (AWS), which was officially launched in 2006, offers you varying cloud services that are not only cost effective but scalable
More informationMATE-EC2: A Middleware for Processing Data with Amazon Web Services
MATE-EC2: A Middleware for Processing Data with Amazon Web Services Tekin Bicer David Chiu* and Gagan Agrawal Department of Compute Science and Engineering Ohio State University * School of Engineering
More informationAutonomic Resource Management for Virtualized Database Hosting Systems
Autonomic Resource Management for Virtualized Database Hosting Systems Technical Report 29-7-1 July, 29 School of Computing and Information Sciences (SCIS) Florida International University (FIU) Miami,
More informationModeling VM Performance Interference with Fuzzy MIMO Model
Modeling VM Performance Interference with Fuzzy MIMO Model ABSTRACT Virtual machines (VM) can be a powerful platform for multiplexing resources for applications workloads on demand in datacenters and cloud
More informationExperimental Study of Virtual Machine Migration in Support of Reservation of Cluster Resources
Experimental Study of Virtual Machine Migration in Support of Reservation of Cluster Resources Ming Zhao, Renato J. Figueiredo Advanced Computing and Information Systems (ACIS) Electrical and Computer
More informationso Mechanism for Internet Services
Twinkle: A Fast Resource Provisioning so Mechanism for Internet Services Professor Zhen Xiao Dept. of Computer Science Peking University xiaozhen@pku.edu.cn Joint work with Jun Zhu and Zhefu Jiang Motivation
More informationCloud Programming. Programming Environment Oct 29, 2015 Osamu Tatebe
Cloud Programming Programming Environment Oct 29, 2015 Osamu Tatebe Cloud Computing Only required amount of CPU and storage can be used anytime from anywhere via network Availability, throughput, reliability
More informationThe Fusion Distributed File System
Slide 1 / 44 The Fusion Distributed File System Dongfang Zhao February 2015 Slide 2 / 44 Outline Introduction FusionFS System Architecture Metadata Management Data Movement Implementation Details Unique
More informationAmazon EC2 Deep Dive. Michael #awssummit
Berlin Amazon EC2 Deep Dive Michael Hanisch @hanimic #awssummit Let s get started Amazon EC2 instances AMIs & Virtualization Types EBS-backed AMIs AMI instance Physical host server New root volume snapshot
More informationNested Virtualization and Server Consolidation
Nested Virtualization and Server Consolidation Vara Varavithya Department of Electrical Engineering, KMUTNB varavithya@gmail.com 1 Outline Virtualization & Background Nested Virtualization Hybrid-Nested
More informationSANDPIPER: BLACK-BOX AND GRAY-BOX STRATEGIES FOR VIRTUAL MACHINE MIGRATION
SANDPIPER: BLACK-BOX AND GRAY-BOX STRATEGIES FOR VIRTUAL MACHINE MIGRATION Timothy Wood, Prashant Shenoy, Arun Venkataramani, and Mazin Yousif * University of Massachusetts Amherst * Intel, Portland Data
More informationWEBSITE & CLOUD PERFORMANCE ANALYSIS. Evaluating Cloud Performance for Web Site Hosting Requirements
WEBSITE & CLOUD PERFORMANCE ANALYSIS Evaluating Cloud Performance for Web Site Hosting Requirements WHY LOOK AT PERFORMANCE? There are many options for Web site hosting services, with most vendors seemingly
More informationEmpirical Evaluation of Latency-Sensitive Application Performance in the Cloud
Empirical Evaluation of Latency-Sensitive Application Performance in the Cloud Sean Barker and Prashant Shenoy University of Massachusetts Amherst Department of Computer Science Cloud Computing! Cloud
More informationBig Data solution benchmark
Big Data solution benchmark Introduction In the last few years, Big Data Analytics have gained a very fair amount of success. The trend is expected to grow rapidly with further advancement in the coming
More informationSRM-Buffer: An OS Buffer Management SRM-Buffer: An OS Buffer Management Technique toprevent Last Level Cache from Thrashing in Multicores
SRM-Buffer: An OS Buffer Management SRM-Buffer: An OS Buffer Management Technique toprevent Last Level Cache from Thrashing in Multicores Xiaoning Ding The Ohio State University dingxn@cse.ohiostate.edu
More informationReal-time scheduling for virtual machines in SK Telecom
Real-time scheduling for virtual machines in SK Telecom Eunkyu Byun Cloud Computing Lab., SK Telecom Sponsored by: & & Cloud by Virtualization in SKT Provide virtualized ICT infra to customers like Amazon
More informationOptimizing VM Checkpointing for Restore Performance in VMware ESXi
Optimizing VM Checkpointing for Restore Performance in VMware ESXi Irene Zhang University of Washington Tyler Denniston MIT CSAIL Yury Baskakov VMware Alex Garthwaite CloudPhysics Abstract Cloud providers
More informationData Centers and Cloud Computing
Data Centers and Cloud Computing CS677 Guest Lecture Tim Wood 1 Data Centers Large server and storage farms 1000s of servers Many TBs or PBs of data Used by Enterprises for server applications Internet
More informationVamsidhar Thummala. Joint work with Shivnath Babu, Songyun Duan, Nedyalkov Borisov, and Herodotous Herodotou Duke University 20 th May 2009
Vamsidhar Thummala Joint work with Shivnath Babu, Songyun Duan, Nedyalkov Borisov, and Herodotous Herodotou Duke University 20 th May 2009 Claim: Current techniques for managing systems have limitations
More informationPaperspace. Architecture Overview. 20 Jay St. Suite 312 Brooklyn, NY Technical Whitepaper
Architecture Overview Copyright 2016 Paperspace, Co. All Rights Reserved June - 1-2017 Technical Whitepaper Paperspace Whitepaper: Architecture Overview Content 1. Overview 3 2. Virtualization 3 Xen Hypervisor
More informationHPC in Cloud. Presenter: Naresh K. Sehgal Contributors: Billy Cox, John M. Acken, Sohum Sohoni
HPC in Cloud Presenter: Naresh K. Sehgal Contributors: Billy Cox, John M. Acken, Sohum Sohoni 2 Agenda What is HPC? Problem Statement(s) Cloud Workload Characterization Translation from High Level Issues
More informationResource and Performance Distribution Prediction for Large Scale Analytics Queries
Resource and Performance Distribution Prediction for Large Scale Analytics Queries Prof. Rajiv Ranjan, SMIEEE School of Computing Science, Newcastle University, UK Visiting Scientist, Data61, CSIRO, Australia
More informationI/O Characterization of Commercial Workloads
I/O Characterization of Commercial Workloads Kimberly Keeton, Alistair Veitch, Doug Obal, and John Wilkes Storage Systems Program Hewlett-Packard Laboratories www.hpl.hp.com/research/itc/csl/ssp kkeeton@hpl.hp.com
More informationPARDA: Proportional Allocation of Resources for Distributed Storage Access
PARDA: Proportional Allocation of Resources for Distributed Storage Access Ajay Gulati, Irfan Ahmad, Carl Waldspurger Resource Management Team VMware Inc. USENIX FAST 09 Conference February 26, 2009 The
More informationCost and Performance benefits of Dell Compellent Automated Tiered Storage for Oracle OLAP Workloads
Cost and Performance benefits of Dell Compellent Automated Tiered Storage for Oracle OLAP This Dell technical white paper discusses performance and cost benefits achieved with Dell Compellent Automated
More informationSmartMD: A High Performance Deduplication Engine with Mixed Pages
SmartMD: A High Performance Deduplication Engine with Mixed Pages Fan Guo 1, Yongkun Li 1, Yinlong Xu 1, Song Jiang 2, John C. S. Lui 3 1 University of Science and Technology of China 2 University of Texas,
More informationReference Architectures for designing and deploying Microsoft SQL Server Databases in Active System800 Platform
Reference Architectures for designing and deploying Microsoft SQL Server Databases in Active System800 Platform Discuss database workload classification for designing and deploying SQL server databases
More informationTypical scenario in shared infrastructures
Got control? AutoControl: Automated Control of MultipleVirtualized Resources Pradeep Padala, Karen Hou, Xiaoyun Zhu*, Mustfa Uysal, Zhikui Wang, Sharad Singhal, Arif Merchant, Kang G. Shin University of
More informationData Centers and Cloud Computing. Data Centers
Data Centers and Cloud Computing Slides courtesy of Tim Wood 1 Data Centers Large server and storage farms 1000s of servers Many TBs or PBs of data Used by Enterprises for server applications Internet
More informationHardware & System Requirements
Safend Data Protection Suite Hardware & System Requirements System Requirements Hardware & Software Minimum Requirements: Safend Data Protection Agent Requirements Console Safend Data Access Utility Operating
More informationNext-Generation Cloud Platform
Next-Generation Cloud Platform Jangwoo Kim Jun 24, 2013 E-mail: jangwoo@postech.ac.kr High Performance Computing Lab Department of Computer Science & Engineering Pohang University of Science and Technology
More informationEvaluation Report: HP StoreFabric SN1000E 16Gb Fibre Channel HBA
Evaluation Report: HP StoreFabric SN1000E 16Gb Fibre Channel HBA Evaluation report prepared under contract with HP Executive Summary The computing industry is experiencing an increasing demand for storage
More informationIBM Emulex 16Gb Fibre Channel HBA Evaluation
IBM Emulex 16Gb Fibre Channel HBA Evaluation Evaluation report prepared under contract with Emulex Executive Summary The computing industry is experiencing an increasing demand for storage performance
More informationHigh-performance aspects in virtualized infrastructures
SVM 21 High-performance aspects in virtualized infrastructures Vitalian Danciu, Nils gentschen Felde, Dieter Kranzlmüller, Tobias Lindinger SVM 21 - HPC aspects in virtualized infrastructures 1/29/21 Niagara
More informationEvaluating CPU utilization in a Cloud Environment
Evaluating CPU utilization in a Cloud Environment Presenter MSCS, KFUPM Thesis Committee Members Dr. Farag Azzedin (Advisor) Dr. Mahmood Khan Naizi Dr. Salahdin Adam ICS Department, KFUPM 6/9/2017 2 of
More informationTPC-E testing of Microsoft SQL Server 2016 on Dell EMC PowerEdge R830 Server and Dell EMC SC9000 Storage
TPC-E testing of Microsoft SQL Server 2016 on Dell EMC PowerEdge R830 Server and Dell EMC SC9000 Storage Performance Study of Microsoft SQL Server 2016 Dell Engineering February 2017 Table of contents
More informationDifference Engine: Harnessing Memory Redundancy in Virtual Machines (D. Gupta et all) Presented by: Konrad Go uchowski
Difference Engine: Harnessing Memory Redundancy in Virtual Machines (D. Gupta et all) Presented by: Konrad Go uchowski What is Virtual machine monitor (VMM)? Guest OS Guest OS Guest OS Virtual machine
More informationAcceleration of Virtual Machine Live Migration on QEMU/KVM by Reusing VM Memory
Acceleration of Virtual Machine Live Migration on QEMU/KVM by Reusing VM Memory Soramichi Akiyama Department of Creative Informatics Graduate School of Information Science and Technology The University
More informationIdentifying Performance Bottlenecks with Real- World Applications and Flash-Based Storage
Identifying Performance Bottlenecks with Real- World Applications and Flash-Based Storage TechTarget Dennis Martin 1 Agenda About Demartek Enterprise Data Center Environments Storage Performance Metrics
More informationSE Memory Consumption
Page 1 of 5 SE Memory Consumption view online Calculating the utilization of memory within a Service Engine is useful to estimate the number of concurrent connections or the amount of memory that may be
More informationData Centers and Cloud Computing. Slides courtesy of Tim Wood
Data Centers and Cloud Computing Slides courtesy of Tim Wood 1 Data Centers Large server and storage farms 1000s of servers Many TBs or PBs of data Used by Enterprises for server applications Internet
More informationBuilding Adaptive Performance Models for Dynamic Resource Allocation in Cloud Data Centers
Building Adaptive Performance Models for Dynamic Resource Allocation in Cloud Data Centers Jin Chen University of Toronto Joint work with Gokul Soundararajan and Prof. Cristiana Amza. Today s Cloud Pay
More informationSE Memory Consumption
Page 1 of 5 view online Overview Calculating the utilization of memory within a Service Engine (SE) is useful to estimate the number of concurrent connections or the amount of memory that may be allocated
More informationGoverlan Reach Server Hardware & Operating System Guidelines
www.goverlan.com Goverlan Reach Server Hardware & Operating System Guidelines System Requirements General Guidelines The system requirement for a Goverlan Reach Server is calculated based on its potential
More informationOutline 1 Motivation 2 Theory of a non-blocking benchmark 3 The benchmark and results 4 Future work
Using Non-blocking Operations in HPC to Reduce Execution Times David Buettner, Julian Kunkel, Thomas Ludwig Euro PVM/MPI September 8th, 2009 Outline 1 Motivation 2 Theory of a non-blocking benchmark 3
More informationPreserving I/O Prioritization in Virtualized OSes
Preserving I/O Prioritization in Virtualized OSes Kun Suo 1, Yong Zhao 1, Jia Rao 1, Luwei Cheng 2, Xiaobo Zhou 3, Francis C. M. Lau 4 The University of Texas at Arlington 1, Facebook 2, University of
More informationOracle VM 3.3. Planning and Implementing
Oracle VM 3.3 Planning and Implementing Agenda 1. Introduction 2. What are we doing 3. Why did we want to virtualize 4. Building the case for virtualization 5. Hardware sizing for Oracle VM 6. Oracle VM
More informationMixApart: Decoupled Analytics for Shared Storage Systems. Madalin Mihailescu, Gokul Soundararajan, Cristiana Amza University of Toronto and NetApp
MixApart: Decoupled Analytics for Shared Storage Systems Madalin Mihailescu, Gokul Soundararajan, Cristiana Amza University of Toronto and NetApp Hadoop Pig, Hive Hadoop + Enterprise storage?! Shared storage
More informationComputer Science Section. Computational and Information Systems Laboratory National Center for Atmospheric Research
Computer Science Section Computational and Information Systems Laboratory National Center for Atmospheric Research My work in the context of TDD/CSS/ReSET Polynya new research computing environment Polynya
More informationInitial Results on Provisioning Variation in Cloud Services
Initial Results on Provisioning ariation in Cloud Services. Suhail Rehman Research Analyst Cloud Computing Lab Carnegie ellon University in Qatar Collaborators: Prof. ajd F. Sakr, Jim Gargani Carnegie
More informationRACKSPACE ONMETAL I/O V2 OUTPERFORMS AMAZON EC2 BY UP TO 2X IN BENCHMARK TESTING
RACKSPACE ONMETAL I/O V2 OUTPERFORMS AMAZON EC2 BY UP TO 2X IN BENCHMARK TESTING EXECUTIVE SUMMARY Today, businesses are increasingly turning to cloud services for rapid deployment of apps and services.
More informationGLUSTER CAN DO THAT! Architecting and Performance Tuning Efficient Gluster Storage Pools
GLUSTER CAN DO THAT! Architecting and Performance Tuning Efficient Gluster Storage Pools Dustin Black Senior Architect, Software-Defined Storage @dustinlblack 2017-05-02 Ben Turner Principal Quality Engineer
More informationUpgrade to Microsoft SQL Server 2016 with Dell EMC Infrastructure
Upgrade to Microsoft SQL Server 2016 with Dell EMC Infrastructure Generational Comparison Study of Microsoft SQL Server Dell Engineering February 2017 Revisions Date Description February 2017 Version 1.0
More informationPOSTGRESQL ON AWS: TIPS & TRICKS (AND HORROR STORIES) ALEXANDER KUKUSHKIN. PostgresConf US
POSTGRESQL ON AWS: TIPS & TRICKS (AND HORROR STORIES) ALEXANDER KUKUSHKIN PostgresConf US 2018 2018-04-20 ABOUT ME Alexander Kukushkin Database Engineer @ZalandoTech Email: alexander.kukushkin@zalando.de
More informationE-Store: Fine-Grained Elastic Partitioning for Distributed Transaction Processing Systems
E-Store: Fine-Grained Elastic Partitioning for Distributed Transaction Processing Systems Rebecca Taft, Essam Mansour, Marco Serafini, Jennie Duggan, Aaron J. Elmore, Ashraf Aboulnaga, Andrew Pavlo, Michael
More informationLicensing Oracle on Amazon EC2, RDS and Microsoft Azure now twice as expensive!
Licensing Oracle on Amazon EC2, RDS and Microsoft Azure now twice as expensive! Authors: Adrian Cristache and Andra Tarata This whitepaper provides an overview of the changes in Licensing Oracle Software
More informationFalling Out of the Clouds: When Your Big Data Needs a New Home
Falling Out of the Clouds: When Your Big Data Needs a New Home Executive Summary Today s public cloud computing infrastructures are not architected to support truly large Big Data applications. While it
More informationJanus: A-Cross-Layer Soft Real- Time Architecture for Virtualization
Janus: A-Cross-Layer Soft Real- Time Architecture for Virtualization Raoul Rivas, Ahsan Arefin, Klara Nahrstedt UPCRC, University of Illinois at Urbana-Champaign Video Sharing, Internet TV and Teleimmersive
More informationDistributed caching for cloud computing
Distributed caching for cloud computing Maxime Lorrillere, Julien Sopena, Sébastien Monnet et Pierre Sens February 11, 2013 Maxime Lorrillere (LIP6/UPMC/CNRS) February 11, 2013 1 / 16 Introduction Context
More informationHadoop/MapReduce Computing Paradigm
Hadoop/Reduce Computing Paradigm 1 Large-Scale Data Analytics Reduce computing paradigm (E.g., Hadoop) vs. Traditional database systems vs. Database Many enterprises are turning to Hadoop Especially applications
More informationModel-Driven Geo-Elasticity In Database Clouds
Model-Driven Geo-Elasticity In Database Clouds Tian Guo, Prashant Shenoy College of Information and Computer Sciences University of Massachusetts, Amherst This work is supported by NSF grant 1345300, 1229059
More informationdavidklee.net gplus.to/kleegeek linked.com/a/davidaklee
@kleegeek davidklee.net gplus.to/kleegeek linked.com/a/davidaklee Specialties / Focus Areas / Passions: Performance Tuning & Troubleshooting Virtualization Cloud Enablement Infrastructure Architecture
More informationEECS750: Advanced Operating Systems. 2/24/2014 Heechul Yun
EECS750: Advanced Operating Systems 2/24/2014 Heechul Yun 1 Administrative Project Feedback of your proposal will be sent by Wednesday Midterm report due on Apr. 2 3 pages: include intro, related work,
More informationThis presentation is for informational purposes only and may not be incorporated into a contract or agreement.
This presentation is for informational purposes only and may not be incorporated into a contract or agreement. The following is intended to outline our general product direction. It is intended for information
More informationBenchmark Study: A Performance Comparison Between RHEL 5 and RHEL 6 on System z
Benchmark Study: A Performance Comparison Between RHEL 5 and RHEL 6 on System z 1 Lab Environment Setup Hardware and z/vm Environment z10 EC, 4 IFLs used (non concurrent tests) Separate LPARs for RHEL
More informationBoosting GPU Virtualization Performance with Hybrid Shadow Page Tables
Boosting GPU Virtualization Performance with Hybrid Shadow Page Tables Yaozu Dong Mochi Xue Xiao Zheng Jiajun Wang Zhengwei Qi Haibing Guan Shanghai Jiao Tong University Intel Corporation GPU Usage Gaming
More informationEMC Virtual Infrastructure for Microsoft Applications Data Center Solution
EMC Virtual Infrastructure for Microsoft Applications Data Center Solution Enabled by EMC Symmetrix V-Max and Reference Architecture EMC Global Solutions Copyright and Trademark Information Copyright 2009
More informationA framework for Experiment-driven System Management
D u k e S y s t e m s A framework for Experiment-driven System Management Vamsidhar Thummala Duke University Joint work with Shivnath Babu and Jeff Chase 1 Day-to-day System Management Tasks Performance
More informationUsing Transparent Compression to Improve SSD-based I/O Caches
Using Transparent Compression to Improve SSD-based I/O Caches Thanos Makatos, Yannis Klonatos, Manolis Marazakis, Michail D. Flouris, and Angelos Bilas {mcatos,klonatos,maraz,flouris,bilas}@ics.forth.gr
More informationApplication-Specific Configuration Selection in the Cloud: Impact of Provider Policy and Potential of Systematic Testing
Application-Specific Configuration Selection in the Cloud: Impact of Provider Policy and Potential of Systematic Testing Mohammad Hajjat +, Ruiqi Liu*, Yiyang Chang +, T.S. Eugene Ng*, Sanjay Rao + + Purdue
More informationScaling DreamFactory
Scaling DreamFactory This white paper is designed to provide information to enterprise customers about how to scale a DreamFactory Instance. The sections below talk about horizontal, vertical, and cloud
More informationPOSTGRESQL ON AWS: TIPS & TRICKS (AND HORROR STORIES) ALEXANDER KUKUSHKIN
POSTGRESQL ON AWS: TIPS & TRICKS (AND HORROR STORIES) ALEXANDER KUKUSHKIN 07-07-2017 ABOUT ME Alexander Kukushkin Database Engineer @ZalandoTech Email: alexander.kukushkin@zalando.de Twitter: @cyberdemn
More informationHigh-density Grid storage system optimization at ASGC. Shu-Ting Liao ASGC Operation team ISGC 2011
High-density Grid storage system optimization at ASGC Shu-Ting Liao ASGC Operation team ISGC 211 Outline Introduction to ASGC Grid storage system Storage status and issues in 21 Storage optimization Summary
More informationXPU A Programmable FPGA Accelerator for Diverse Workloads
XPU A Programmable FPGA Accelerator for Diverse Workloads Jian Ouyang, 1 (ouyangjian@baidu.com) Ephrem Wu, 2 Jing Wang, 1 Yupeng Li, 1 Hanlin Xie 1 1 Baidu, Inc. 2 Xilinx Outlines Background - FPGA for
More informationMultiLanes: Providing Virtualized Storage for OS-level Virtualization on Many Cores
MultiLanes: Providing Virtualized Storage for OS-level Virtualization on Many Cores Junbin Kang, Benlong Zhang, Tianyu Wo, Chunming Hu, and Jinpeng Huai Beihang University 夏飞 20140904 1 Outline Background
More informationLATEST INTEL TECHNOLOGIES POWER NEW PERFORMANCE LEVELS ON VMWARE VSAN
LATEST INTEL TECHNOLOGIES POWER NEW PERFORMANCE LEVELS ON VMWARE VSAN Russ Fellows Enabling you to make the best technology decisions November 2017 EXECUTIVE OVERVIEW* The new Intel Xeon Scalable platform
More informationAnastasia Ailamaki. Performance and energy analysis using transactional workloads
Performance and energy analysis using transactional workloads Anastasia Ailamaki EPFL and RAW Labs SA students: Danica Porobic, Utku Sirin, and Pinar Tozun Online Transaction Processing $2B+ industry Characteristics:
More informationNEC Express5800 A2040b 22TB Data Warehouse Fast Track. Reference Architecture with SW mirrored HGST FlashMAX III
NEC Express5800 A2040b 22TB Data Warehouse Fast Track Reference Architecture with SW mirrored HGST FlashMAX III Based on Microsoft SQL Server 2014 Data Warehouse Fast Track (DWFT) Reference Architecture
More informationAMD Opteron Processors In the Cloud
AMD Opteron Processors In the Cloud Pat Patla Vice President Product Marketing AMD DID YOU KNOW? By 2020, every byte of data will pass through the cloud *Source IDC 2 AMD Opteron In The Cloud October,
More informationPocket: Elastic Ephemeral Storage for Serverless Analytics
Pocket: Elastic Ephemeral Storage for Serverless Analytics Ana Klimovic*, Yawen Wang*, Patrick Stuedi +, Animesh Trivedi +, Jonas Pfefferle +, Christos Kozyrakis* *Stanford University, + IBM Research 1
More informationOASIS: Self-tuning Storage for Applications
OASIS: Self-tuning Storage for Applications Kostas Magoutis, Prasenjit Sarkar, Gauri Shah 14 th NASA Goddard- 23 rd IEEE Mass Storage Systems Technologies, College Park, MD, May 17, 2006 Outline Motivation
More informationPerformance & Scalability Testing in Virtual Environment Hemant Gaidhani, Senior Technical Marketing Manager, VMware
Performance & Scalability Testing in Virtual Environment Hemant Gaidhani, Senior Technical Marketing Manager, VMware 2010 VMware Inc. All rights reserved About the Speaker Hemant Gaidhani Senior Technical
More informationEsgynDB Enterprise 2.0 Platform Reference Architecture
EsgynDB Enterprise 2.0 Platform Reference Architecture This document outlines a Platform Reference Architecture for EsgynDB Enterprise, built on Apache Trafodion (Incubating) implementation with licensed
More informationDistributed Systems COMP 212. Lecture 18 Othon Michail
Distributed Systems COMP 212 Lecture 18 Othon Michail Virtualisation & Cloud Computing 2/27 Protection rings It s all about protection rings in modern processors Hardware mechanism to protect data and
More informationAdapting Mixed Workloads to Meet SLOs in Autonomic DBMSs
Adapting Mixed Workloads to Meet SLOs in Autonomic DBMSs Baoning Niu, Patrick Martin, Wendy Powley School of Computing, Queen s University Kingston, Ontario, Canada, K7L 3N6 {niu martin wendy}@cs.queensu.ca
More informationManaging Performance Variance of Applications Using Storage I/O Control
Performance Study Managing Performance Variance of Applications Using Storage I/O Control VMware vsphere 4.1 Application performance can be impacted when servers contend for I/O resources in a shared storage
More informationCopyright 2012 EMC Corporation. All rights reserved.
1 TRANSFORMING MICROSOFT APPLICATIONS TO THE CLOUD Louaye Rachidi Technology Consultant 2 22x Partner Of Year 19+ Gold And Silver Microsoft Competencies 2,700+ Consultants Worldwide Cooperative Support
More informationOpenNebula on VMware: Cloud Reference Architecture
OpenNebula on VMware: Cloud Reference Architecture Version 1.2, October 2016 Abstract The OpenNebula Cloud Reference Architecture is a blueprint to guide IT architects, consultants, administrators and
More informationHPC In The Cloud? Michael Kleber. July 2, Department of Computer Sciences University of Salzburg, Austria
HPC In The Cloud? Michael Kleber Department of Computer Sciences University of Salzburg, Austria July 2, 2012 Content 1 2 3 MUSCLE NASA 4 5 Motivation wide spread availability of cloud services easy access
More informationNEXGEN N5 PERFORMANCE IN A VIRTUALIZED ENVIRONMENT
NEXGEN N5 PERFORMANCE IN A VIRTUALIZED ENVIRONMENT White Paper: NexGen N5 Performance in a Virtualized Environment January 2015 Contents Introduction... 2 Objective... 2 Audience... 2 NexGen N5... 2 Test
More informationImproving Virtual Machine Scheduling in NUMA Multicore Systems
Improving Virtual Machine Scheduling in NUMA Multicore Systems Jia Rao, Xiaobo Zhou University of Colorado, Colorado Springs Kun Wang, Cheng-Zhong Xu Wayne State University http://cs.uccs.edu/~jrao/ Multicore
More informationNoSQL Databases MongoDB vs Cassandra. Kenny Huynh, Andre Chik, Kevin Vu
NoSQL Databases MongoDB vs Cassandra Kenny Huynh, Andre Chik, Kevin Vu Introduction - Relational database model - Concept developed in 1970 - Inefficient - NoSQL - Concept introduced in 1980 - Related
More informationWhite Paper. IBM PowerVM Virtualization Technology on IBM POWER7 Systems
89 Fifth Avenue, 7th Floor New York, NY 10003 www.theedison.com 212.367.7400 White Paper IBM PowerVM Virtualization Technology on IBM POWER7 Systems A Comparison of PowerVM and VMware vsphere 4.1 update
More informationVirtual SQL Servers. Actual Performance. 2016
@kleegeek davidklee.net heraflux.com linkedin.com/in/davidaklee Specialties / Focus Areas / Passions: Performance Tuning & Troubleshooting Virtualization Cloud Enablement Infrastructure Architecture Health
More informationEMC XTREMCACHE ACCELERATES VIRTUALIZED ORACLE
White Paper EMC XTREMCACHE ACCELERATES VIRTUALIZED ORACLE EMC XtremSF, EMC XtremCache, EMC Symmetrix VMAX and Symmetrix VMAX 10K, XtremSF and XtremCache dramatically improve Oracle performance Symmetrix
More informationDynamic Vertical Memory Scalability for OpenJDK Cloud Applications
Dynamic Vertical Memory Scalability for OpenJDK Cloud Applications Rodrigo Bruno, Paulo Ferreira: INESC-ID / Instituto Superior Técnico, University of Lisbon Ruslan Synytsky, Tetiana Fydorenchyk: Jelastic
More information