Improving efficiency of Twitter Infrastructure using Chargeback
|
|
- Violet Wright
- 6 years ago
- Views:
Transcription
1 Improving efficiency of Twitter Infrastructure
2 AGENDA Brief History Problem Chargeback Engineering Challenges The product Impact Future
3 Getty Images from
4 Getty Images from
5 3283 Tweets Per Sec (TPS) Getty Images from
6 3283 Tweets Per Sec (TPS) 5X increase on avg. TPS Getty Images from
7 The Simpsons
8
9 MONOLITH SERVICES
10 FENCING & OWNERSHIP Clear isolation of services & its ownership. RELIABILITY Failure isolation and graceful degradation (Micro) Services Oriented Model SCALABILITY & EFFICIENCY Scale independently ensuring efficient use of infrastructure DEVELOPER PRODUCTIVITY Make it simple for engineers to build and launch services quickly and easily
11 2013
12 August 2 at 7:21:50 PDT
13 143,199 Tweets Per Sec (TPS) August 2 at 7:21:50 PDT
14 143,199 Tweets Per Sec (TPS) 28X increase on avg. TPS August 2 at 7:21:50 PDT
15 Hundreds and thousands of #events at any given instant
16 Most Retweeted Tweet in History
17 RELIABILITY DEVELOPER AGILITY SCALABILITY EFFICIENCY
18 Do More with Less
19 Fast forward to 2016
20 MANAGEMENT TOOLS SELF SERVE MONITORING AND ALERTING CACHE MESSAGING & QUEUES SOCIAL GRAPH USERS WORKFLOW MANAGEMENT INTERACTIVE QUERY FRAMEWORK/ LIBRARIES FINAGLE (RPC) SERVICE DIRECTORY SEARCH TWEETS DATA DISCOVERY SCALDING (Map Reduce in Scala) CHARGEBACK REVERSE PROXY PLATFORM SERVICES CORE APPLICATION SERVICES DATA & ANALYTICS PLATFORM JVM DEPLOY (Workflows) CONFIG INFRASTRUCTURE SERVICES C O M P U T E AURORA (Scheduler) HADOOP (Map-Reduce) MESOS (Cluster Manager) S T O R A G E MANHATTAN (Key-Val Store) HDFS (File System) BLOBSTORE GRAPH STORE HERON (Streaming Compute) INFRASTRUCTURE AND DATACENTER MANAGEMENT
21 MANAGEMENT TOOLS SELF SERVE MONITORING AND ALERTING CACHE MESSAGING & QUEUES SOCIAL GRAPH USERS WORKFLOW MANAGEMENT INTERACTIVE QUERY FRAMEWORK/ LIBRARIES FINAGLE (RPC) SERVICE DIRECTORY SEARCH TWEETS DATA DISCOVERY SCALDING (Map Reduce in Scala) CHARGEBACK REVERSE PROXY PLATFORM SERVICES CORE APPLICATION SERVICES DATA & ANALYTICS PLATFORM JVM DEPLOY (Workflows) CONFIG INFRASTRUCTURE SERVICES C O M P U T E AURORA (Scheduler) HADOOP (Map-Reduce) MESOS (Cluster Manager) S T O R A G E MANHATTAN (Key-Val Store) HDFS (File System) BLOBSTORE GRAPH STORE HERON (Streaming Compute) INFRASTRUCTURE AND DATACENTER MANAGEMENT
22 MANAGEMENT TOOLS SELF SERVE MONITORING AND ALERTING CACHE MESSAGING & QUEUES SOCIAL GRAPH USERS WORKFLOW MANAGEMENT INTERACTIVE QUERY FRAMEWORK/ LIBRARIES FINAGLE (RPC) SERVICE DIRECTORY SEARCH TWEETS DATA DISCOVERY SCALDING (Map Reduce in Scala) CHARGEBACK REVERSE PROXY PLATFORM SERVICES CORE APPLICATION SERVICES DATA & ANALYTICS PLATFORM JVM DEPLOY (Workflows) CONFIG INFRASTRUCTURE SERVICES C O M P U T E AURORA (Scheduler) HADOOP (Map-Reduce) MESOS (Cluster Manager) S T O R A G E MANHATTAN (Key-Val Store) HDFS (File System) BLOBSTORE GRAPH STORE HERON (Streaming Compute) INFRASTRUCTURE AND DATACENTER MANAGEMENT
23 MANAGEMENT TOOLS SELF SERVE MONITORING AND ALERTING CACHE MESSAGING & QUEUES SOCIAL GRAPH USERS WORKFLOW MANAGEMENT INTERACTIVE QUERY FRAMEWORK/ LIBRARIES FINAGLE (RPC) SERVICE DIRECTORY SEARCH TWEETS DATA DISCOVERY SCALDING (Map Reduce in Scala) CHARGEBACK REVERSE PROXY PLATFORM SERVICES CORE APPLICATION SERVICES DATA & ANALYTICS PLATFORM JVM DEPLOY (Workflows) CONFIG INFRASTRUCTURE SERVICES C O M P U T E AURORA (Scheduler) HADOOP (Map-Reduce) MESOS (Cluster Manager) S T O R A G E MANHATTAN (Key-Val Store) HDFS (File System) BLOBSTORE GRAPH STORE HERON (Streaming Compute) INFRASTRUCTURE AND DATACENTER MANAGEMENT
24 MANAGEMENT TOOLS SELF SERVE MONITORING AND ALERTING CACHE MESSAGING & QUEUES SOCIAL GRAPH USERS WORKFLOW MANAGEMENT INTERACTIVE QUERY FRAMEWORK/ LIBRARIES FINAGLE (RPC) SERVICE DIRECTORY SEARCH TWEETS DATA DISCOVERY SCALDING (Map Reduce in Scala) CHARGEBACK REVERSE PROXY PLATFORM SERVICES CORE APPLICATION SERVICES DATA & ANALYTICS PLATFORM JVM DEPLOY (Workflows) CONFIG INFRASTRUCTURE SERVICES C O M P U T E AURORA (Scheduler) HADOOP (Map-Reduce) MESOS (Cluster Manager) S T O R A G E MANHATTAN (Key-Val Store) HDFS (File System) BLOBSTORE GRAPH STORE HERON (Streaming Compute) INFRASTRUCTURE AND DATACENTER MANAGEMENT
25 THOUSANDS OF SERVICES HUNDREDS OF TEAMS
26 What is the overall use of infrastructure & platform resources across Twitter s services?
27 What is the overall use of infrastructure & platform resources across Twitter s services? How to attribute resource consumption to teams/organization?
28 What is the overall use of infrastructure & platform resources across Twitter s services? How to attribute resource consumption to teams/organization? How do you incentivize the right behavior to improve efficiency of resource usage?
29 CHARGEBACK Ability to meter allocation and utilization of resources per service, per engineering team and charge them accordingly
30 SERVICE Ads Shard SERVICE Tweet Service SERVICE Who To Follow MULTI-TENANCY tenant management using canonical identifiers RESOURCE unit of abstraction PLATFORM AND OTHER SERVICES COMPUTE STORAGE
31 SERVICE Ads Shard SERVICE Tweet Service SERVICE Who To Follow SERVICE IDENTITY MULTI-TENANCY tenant management using canonical identifiers RESOURCE CATALOG RESOURCE unit of abstraction PLATFORM AND OTHER SERVICES COMPUTE STORAGE
32 SERVICE Ads Shard SERVICE Tweet Service SERVICE Who To Follow SERVICE IDENTITY MULTI-TENANCY tenant management using canonical identifiers RESOURCE CATALOG RESOURCE unit of abstraction METERING AND CHARGEBACK PLATFORM AND OTHER SERVICES COMPUTE STORAGE
33 SERVICE METADATA SERVICE Ads Shard SERVICE Tweet Service SERVICE Who To Follow SERVICE IDENTITY MULTI-TENANCY tenant management using canonical identifiers RESOURCE CATALOG RESOURCE unit of abstraction METERING AND CHARGEBACK PLATFORM AND OTHER SERVICES COMPUTE STORAGE
34 SERVICE METADATA SERVICE Ads Shard SERVICE Tweet Service SERVICE Who To Follow SERVICE IDENTITY MULTI-TENANCY tenant management using canonical identifiers RESOURCE CATALOG RESOURCE unit of abstraction METERING AND CHARGEBACK PLATFORM AND OTHER SERVICES COMPUTE STORAGE UNIFIED CLOUD PLATFORM
35 SERVICE IDENTITY
36 A canonical way of identifying a service that consumes resources on various platform infrastructure.
37 PROBLEM Project: chargeback Team: Cloud Infra Mgmt Source code: /cim Disparate identifiers across infrastructure and platform services COMPUTE BATCH COMPUTE role: cim-service job_name: ui; env: prod id: <role>.<env>.<job_name> role: cim-service pool: etl_pipe_prod job_name: compute_cost id: <role>.<pool>.<job_name> Multiple provisioning workflows (Self-Serve, Tickets) Disparate Ownership trackers ( , LDAP) STORAGE app_id: cost_reporting id: <app_id> Lack of support for public cloud Identity and Access Management systems (IAM)
38 OUR APPROACH DASHBOARD Designed an Entity Model that Define canonical identifier scheme across infrastructure and platform services IDENTITY MANAGER Define ownership structure with org PROVISION Single pane of glass for every developer to CONSUMPTION manage their project IDs (including abstracting out public cloud IAM systems) API INFRASTRUCTURE SERVICE Provider APIs for infrastructure services to provision and manage identity
39 IMPACT Source of truth for identifier to org structure mapping improving Service ownership within the Org Enables service to service authentication/authorization
40 BUSINESS OWNER 1:N TEAM ENTITY MODEL FOR SERVICE IDENTITY 1:N PROJECT 1:N SERVICE/ SYSTEM ACCOUNT Model that provides canonical identifier across infrastructure and platform service and ties it to an org structure 1:N <INFRA, CLIENTID>
41 ENTITY MODEL: EXAMPLE BUSINESS OWNER REVENUE 1:N TEAM ADS SERVING ADS PREDICTION 1:N PROJECT adshard prediction 1:N SERVICE/ SYSTEM ACCOUNT 1:N adshard ads-prediction <INFRA, CLIENTID> <Aurora, adshard.prod.adshard> <Aurora, adsprediction.prod.campaign-x> EXAMPLE of services running (on Aurora/Mesos)
42 RESOURCE CATALOG
43 Consistent way of identifying and inventorying of resources of various platform infrastructure.
44 PROBLEM Lack of clarity on what is available & how many resources are consumed COMPUTE STORAGE BATCH COMPUTE CPU MEMORY DISK STORAGE IN GB WPS RPS CPU FILES ACCESSED STORAGE IN GB Need to capture resource fluidity across infrastructure and platform services Better support to model abstract resources (ex, QPS, Tweets per Second) Need to define TCO (Total Cost of Ownership) of a resource per unit time
45 CORES MEMORY DISK application = Task( name = 'application', resources = Resources(cpu = 1.0, ram = 512 * MB, disk = 1024 * MB), processes = [stage_application, run_application], constraints = order(stage_application, run_application))
46 CORES MEMORY DISK application = Task( name = 'application', resources = Resources(cpu = 1.0, ram = 512 * MB, disk = 1024 * MB), processes = [stage_application, run_application], constraints = order(stage_application, run_application)) GPU NETWORK Need for Fluidity!
47 Defining unit price for a resource Framework to price resources. Ensure Total Cost of Ownership. Eg. License cost, chargeback cost from other services, human cost etc. Support for Time Granularity. Eg. Machines/VMs used per day, Cores used per day
48 Operational Overhead Headroom Excess Quota and Reservation Underutilized Quota Allocation Disaster Recovery & Event Spikes Container Size Buffer (Underutilized Reservation) Total Cost of Ownership Twitter Compute Platform $X core-day Non-Prod Used Cores Used Cores
49 PROVIDER 1:N INFRASTRUCTURE SERVICE 1:N OFFERINGS 1:N ENTITY MODEL FOR RESOURCE CATALOG Model that supports Resource Fluidity and captures and manages unit price of a resource over time. OFFER MEASURES 1:N OFFER MEASURE COST
50 ENTITY MODEL: EXAMPLE PROVIDER 1:N INFRASTRUCTURE SERVICE TWITTER DC/ PUBLIC CLOUD AURORA TWITTER DC HADOOP 1:N OFFERINGS COMPUTE STORAGE PROCESSING CLUSTER 1:N OFFER MEASURES CORE-DAYS GB- RAM FILE ACCESSES GB- RAM FILE ACCESSES 1:N OFFER MEASURE COST $X $X $Y $M $N EXAMPLE of Resource Catalog
51 METERING PIPELINE
52 HIGH LEVEL ARCHITECTURE
53 The Product
54 TEAM/ORG BILL
55 INFRASTRUCTURE PNL
56 ORG/TEAM BUDGET
57 CUSTOM REPORTS Infrastructure & Platform Owners Overall Cluster Growth Allocation v/s Utilization of resources by Customer Team Service Owners Allocation v/s Utilization of resources across each Infrastructure & Platform Finance Budget Management (Budget v/s Spend) Execs Efficiency Trends
58 What has been the Impact?
59 Twitter Compute Platform (Aurora/Mesos) Allocated Quota Jun 1, 2015 Sept 1, 2015 Utilized Cores 3 months (Jun - Sep, 2015)
60 Twitter Compute Platform (Aurora/Mesos) Allocated Quota Sept 1, 2015 Jan 1, 2015 Utilized Cores 4 months (Sep, Jan, 2016)
61 33% More core usage against reservation compared to May 2015
62 IMPACT Ensures true to the cost unit price computation Input for capacity planning and budgeting Visibility into the organizational spend and enables accountability Improved utilization of infrastructure service resources Enables comparison with Public Cloud Offerings Improved Service Ownership
63 Kite - Unified Cloud Platform A cloud agnostic service lifecycle manager
64 DASHBOARD (SINGLE PANE OF GLASS) REPORTING SERVICE LIFECYCLE WORKFLOWS SERVICE IDENTITY MANAGER RESOURCE PROVISIONING MANAGER IDENTITY METADATA RESOURCE QUOTA MANAGEMENT DEPLOY METERING & CHARGEBACK PROVIDER APIS & ADAPTERS INFRASTRUCTURE INFRASTRUCTURE & PLATFORM SERVICE SERVICE
65 @igb
66
Building Durable Real-time Data Pipeline
Building Durable Real-time Data Pipeline Apache BookKeeper at Twitter @sijieg Twitter Background Layered Architecture Agenda Design Details Performance Scale @Twitter Q & A Publish-Subscribe Online services
More informationCloud + Big Data Putting it all Together
Cloud + Big Data Putting it all Together Even Solberg 2009 VMware Inc. All rights reserved 2 Big, Fast and Flexible Data Big Big Data Processing Fast OLTP workloads Flexible Document Object Big Data Analytics
More informationTwitter Heron: Stream Processing at Scale
Twitter Heron: Stream Processing at Scale Saiyam Kohli December 8th, 2016 CIS 611 Research Paper Presentation -Sun Sunnie Chung TWITTER IS A REAL TIME ABSTRACT We process billions of events on Twitter
More informationApache BookKeeper. A High Performance and Low Latency Storage Service
Apache BookKeeper A High Performance and Low Latency Storage Service Hello! I am Sijie Guo - PMC Chair of Apache BookKeeper Co-creator of Apache DistributedLog Twitter Messaging/Pub-Sub Team Yahoo! R&D
More informationBuilding a Data-Friendly Platform for a Data- Driven Future
Building a Data-Friendly Platform for a Data- Driven Future Benjamin Hindman - @benh 2016 Mesosphere, Inc. All Rights Reserved. INTRO $ whoami BENJAMIN HINDMAN Co-founder and Chief Architect of Mesosphere,
More informationMicrosoft SharePoint 2010 The business collaboration platform for the Enterprise and the Web. We have a new pie!
Microsoft SharePoint 2010 The business collaboration platform for the Enterprise and the Web We have a new pie! 2 Introduction Key Session Objectives Agenda More Scalable More Flexible More Features Intranet
More informationEnabling Your Cloud with VMware. Rob Rowe Jason Kuipers
Enabling Your Cloud with VMware Rob Rowe Jason Kuipers Agenda Current trends in IT and virtualization today Understanding the Software-Defined Data Center VMware as Platform for the SDDC Questions Trends
More informationMicroservices on AWS. Matthias Jung, Solutions Architect AWS
Microservices on AWS Matthias Jung, Solutions Architect AWS Agenda What are Microservices? Why Microservices? Challenges of Microservices Microservices on AWS What are Microservices? What are Microservices?
More information1 Copyright 2011, Oracle and/or its affiliates. All rights reserved. reserved. Insert Information Protection Policy Classification from Slide 8
The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material,
More informationVMware vcloud Director for Service Providers
Architecture Overview TECHNICAL WHITE PAPER Table of Contents Scope of Document....3 About VMware vcloud Director....3 Platform for Infrastructure Cloud...3 Architecture Overview....3 Constructs of vcloud
More informationScalable Streaming Analytics
Scalable Streaming Analytics KARTHIK RAMASAMY @karthikz TALK OUTLINE BEGIN I! II ( III b Overview Storm Overview Storm Internals IV Z V K Heron Operational Experiences END WHAT IS ANALYTICS? according
More informationIntuit Application Centric ACI Deployment Case Study
Intuit Application Centric ACI Deployment Case Study Joon Cho, Principal Network Engineer, Intuit Lawrence Zhu, Solutions Architect, Cisco Agenda Introduction Architecture / Principle Design Rollout Key
More informationTaming the Multi-Cloud With Simplicity and Openness. Minh Dang Cisco Systems Vietnam 2018 January
Taming the Multi-Cloud With Simplicity and Openness Minh Dang Cisco Systems Vietnam 2018 January Multi-Cloud Challenge Growth in Applications and Infrastructure Many Operating Env COST Data Center Many
More informationDisclaimer This presentation may contain product features that are currently under development. This overview of new technology represents no commitme
MGT1758BE Effectively Operating an Automated Cloud Jad El-Zein @virtualjad Vincent Meoc @vmeoc #VMworld #MGT1758BE Disclaimer This presentation may contain product features that are currently under development.
More informationA10 HARMONY CONTROLLER
DATA SHEET A10 HARMONY CONTROLLER AGILE MANAGEMENT, AUTOMATION, ANALYTICS FOR MULTI-CLOUD ENVIRONMENTS PLATFORMS A10 Harmony Controller provides centralized agile management, automation and analytics for
More informationTSAR A TimeSeries AggregatoR. Anirudh Todi TSAR
TSAR A TimeSeries AggregatoR Anirudh Todi Twitter @anirudhtodi TSAR What is TSAR? What is TSAR? TSAR is a framework and service infrastructure for specifying, deploying and operating timeseries aggregation
More informationDemystifying the Cloud With a Look at Hybrid Hosting and OpenStack
Demystifying the Cloud With a Look at Hybrid Hosting and OpenStack Robert Collazo Systems Engineer Rackspace Hosting The Rackspace Vision Agenda Truly a New Era of Computing 70 s 80 s Mainframe Era 90
More informationVMware vcloud Air Network Program Product Usage Guide Q1 2015
VMware vcloud Air Network Program Q1 2015 Contents Overview... 3 VMware vcloud Air Network Program Pricing Model... 4 VMware vcloud Service Provider Bundle Premier-X Plus Edition... 6 VMware vcloud Service
More informationBringing OpenStack to the Enterprise. An enterprise-class solution ensures you get the required performance, reliability, and security
Bringing OpenStack to the Enterprise An enterprise-class solution ensures you get the required performance, reliability, and security INTRODUCTION Organizations today frequently need to quickly get systems
More informationMicroservices Architekturen aufbauen, aber wie?
Microservices Architekturen aufbauen, aber wie? Constantin Gonzalez, Principal Solutions Architect glez@amazon.de, @zalez 30. Juni 2016 2016, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
More informationTitle DC Automation: It s a MARVEL!
Title DC Automation: It s a MARVEL! Name Nikos D. Anagnostatos Position Network Consultant, Network Solutions Division Classification ISO 27001: Public Data Center Evolution 2 Space Hellas - All Rights
More informationSoftware Defined Storage
Software Defined Storage Riyadh Forum 2016 By: Ayman El Marazky Sr. System Engineer software defined solutions The CIO Dilemma IT Budget $ By 2020, the digital universe of data will go to 44 ZB Modern
More informationTransforming IT: From Silos To Services
Transforming IT: From Silos To Services Chuck Hollis Global Marketing CTO EMC Corporation http://chucksblog.emc.com @chuckhollis IT is being transformed. Our world is changing fast New Technologies New
More informationPowering Transformation With Cisco
Shape Your Business For the Future: Powering Transformation With Cisco Enabling Data Center Evolution Towards Cloud Computing Yudi Wiradarma TSO Lead, PT NetApp Indonesia Agenda The Challenge Cloud infrastructure
More informationVMware vcloud Director Evaluator s Guide TECHNICAL WHITE PAPER
VMware vcloud Director Evaluator s Guide TECHNICAL WHITE PAPER Table of Contents 1. Getting Started.... 4 1.1 About This Guide... 4 1.2 Intended Audience.... 4 1.3 Help and Support During the Evaluation....
More informationThe Road to a Complete Tweet Index
The Road to a Complete Tweet Index Yi Zhuang Staff Software Engineer @ Twitter Outline 1. Current Scale of Twitter Search 2. The History of Twitter Search Infra 3. Complete Tweet Index 4. Search Engine
More informationThe Emergence of the Datacenter Developer. Tobi Knaup, Co-Founder & CTO at
The Emergence of the Datacenter Developer Tobi Knaup, Co-Founder & CTO at Mesosphere @superguenter A Brief History of Operating Systems 2 1950 s Mainframes Punchcards No operating systems Time Sharing
More informationTen things hyperconvergence can do for you
Ten things hyperconvergence can do for you Francis O Haire Director, Technology & Strategy DataSolutions Evolution of Enterprise Infrastructure 1990s Today Virtualization Server Server Server Server Scale-Out
More informationModernizing Business Intelligence and Analytics
Modernizing Business Intelligence and Analytics Justin Erickson Senior Director, Product Management 1 Agenda What benefits can I achieve from modernizing my analytic DB? When and how do I migrate from
More information@joerg_schad Nightmares of a Container Orchestration System
@joerg_schad Nightmares of a Container Orchestration System 2017 Mesosphere, Inc. All Rights Reserved. 1 Jörg Schad Distributed Systems Engineer @joerg_schad Jan Repnak Support Engineer/ Solution Architect
More informationVMware s Journey to the Cloud: IT SDDC Journey with vcloud Automation and Management Platform Initiative Using vsphere/vcloud Stack
VMware s Journey to the Cloud: IT SDDC Journey with vcloud Automation and Management Platform Initiative Using vsphere/vcloud Stack August 2013 2013 VMware Inc. All rights reserved Expectations in the
More informationMigrating Applications with CloudCenter
Migrating Applications with CloudCenter Tuan Nguyen, Technical Marketing Engineer, Insieme BU DEVNET-1179 Cisco Spark How Questions? Use Cisco Spark to chat with the speaker after the session 1. Find this
More informationMachine Learning meets Databases. Ioannis Papapanagiotou Cloud Database Engineering
Machine Learning meets Databases Ioannis Papapanagiotou Cloud Database Engineering Create Personalized Recommendations for discoveries of engaging video content that maximizes member joy. Personalize Everything
More informationIBM Storage Software Strategy
IBM Storage Software Strategy Hakan Turgut 1 Just how fast is the data growing? 128 GB/ person The World s total data per person No Problem I I think I can do this We have a problem 24 GB/ person 0.8 GB/
More informationQualys Cloud Platform
18 QUALYS SECURITY CONFERENCE 2018 Qualys Cloud Platform Looking Under the Hood: What Makes Our Cloud Platform so Scalable and Powerful Dilip Bachwani Vice President, Engineering, Qualys, Inc. Cloud Platform
More informationSAP VORA 1.4 on AWS - MARKETPLACE EDITION FREQUENTLY ASKED QUESTIONS
SAP VORA 1.4 on AWS - MARKETPLACE EDITION FREQUENTLY ASKED QUESTIONS 1. What is SAP Vora? SAP Vora is an in-memory, distributed computing solution that helps organizations uncover actionable business insights
More informationPredictive Resilience: Leveraging Integrated DCIM to Reduce Data Center Downtime
July 17, 2013 Predictive Resilience: Leveraging Integrated DCIM to Reduce Data Center Downtime siemens.com/answers Predictive Resilience Table of content What is DCIM & Its Business Value Extract Maximum
More informationEMC Hybrid Cloud. Umair Riaz - vspecialist
EMC Hybrid Cloud Umair Riaz - vspecialist 1 The Business Drivers RESPOND FASTER TO DRIVE NEW REVENUE INCREASE AGILITY REFOCUS RESOURCES TOWARD BUSINESS VALUE INCREASE VISIBILITY & CONTROL 2 CLOUD TRANSFORMS
More informationREFERENCE ARCHITECTURE Quantum StorNext and Cloudian HyperStore
REFERENCE ARCHITECTURE Quantum StorNext and Cloudian HyperStore CLOUDIAN + QUANTUM REFERENCE ARCHITECTURE 1 Table of Contents Introduction to Quantum StorNext 3 Introduction to Cloudian HyperStore 3 Audience
More informationCisco Solution for Private Cloud
Dubrovnik, Croatia, South East Europe 20-22 May, 2013 Cisco Solution for Private Cloud Sascha Merg Technical Solutions Architect 2011 2012 Cisco and/or its affiliates. All rights reserved. Cisco Connect
More information3/26/2018. Hyperconvergence. CreekPointe, Inc. Introductions Hyperconvergance Defined Advantages Use Cases Q&A Close. Mike Clarke, CreekPointe Inc.
Hyperconvergence Mike Clarke, CreekPointe Inc. Introductions Hyperconvergance Defined Advantages Use Cases Q&A Close CreekPointe, Inc In Business since 1985 Experience in the Industry Expertise DataCenter,
More informationWhat s new in MicroStrategy on AWS
What s new in MicroStrategy on AWS MicroStrategy on AWS MicroStrategy is a leading worldwide provider of enterprise software that delivers a comprehensive enterprise analytics and mobility platform. The
More informationvcloud Usage Meter v2.3 Technical Overview 2009 VMware Inc. All rights reserved
vcloud Usage Meter v2.3 Technical Overview 2009 VMware Inc. All rights reserved Usage Meter Changes in version 2.3 Updated UI, Improve Stability and Scalability End User Reporting vsphere Backed Clouds
More informationKubernetes Integration with Virtuozzo Storage
Kubernetes Integration with Virtuozzo Storage A Technical OCTOBER, 2017 2017 Virtuozzo. All rights reserved. 1 Application Container Storage Application containers appear to be the perfect tool for supporting
More informationOsynlig infrastruktur i datacentret med inbyggd säkerhet och resursoptimering.
Osynlig infrastruktur i datacentret med inbyggd säkerhet och resursoptimering. Joel Lindberg Nutanix Build and Manage Daniel Dale varmour Secure and visibility Karl Barton VMTurbo Demand driven control
More informationpowered by Cloudian and Veritas
Lenovo Storage DX8200C powered by Cloudian and Veritas On-site data protection for Amazon S3-compliant cloud storage. assistance from Lenovo s world-class support organization, which is rated #1 for overall
More informationvcloud Air - Virtual Private Cloud OnDemand User's Guide
vcloud Air - Virtual Private Cloud OnDemand User's Guide vcloud Air This document supports the version of each product listed and supports all subsequent versions until the document is replaced by a new
More informationSoftware-defined Media Processing
Software-defined Media Processing Matthew Goldman SVP Technology, TV & Media agenda Media Processing Challenges Value of Virtualization Software Defined Media Processing Moving to the Cloud Ericsson 2017
More information#techsummitch
www.thomasmaurer.ch #techsummitch Justin Incarnato Justin Incarnato Microsoft Principal PM - Azure Stack Hyper-scale Hybrid Power of Azure in your datacenter Azure Stack Enterprise-proven On-premises
More informationwhat is cloud computing?
what is cloud computing? (Private) Cloud Computing with Mesos at Twi9er Benjamin Hindman @benh scalable virtualized self-service utility managed elastic economic pay-as-you-go what is cloud computing?
More informationVxRail: Level Up with New Capabilities and Powers GLOBAL SPONSORS
VxRail: Level Up with New Capabilities and Powers GLOBAL SPONSORS VMware customers trust their infrastructure to vsan #1 Leading SDS Vendor >10,000 >100 83% vsan Customers Countries Deployed Critical Apps
More informationHow to Keep UP Through Digital Transformation with Next-Generation App Development
How to Keep UP Through Digital Transformation with Next-Generation App Development Peter Sjoberg Jon Olby A Look Back, A Look Forward Dedicated, data structure dependent, inefficient, virtualized Infrastructure
More informationMAPR DATA GOVERNANCE WITHOUT COMPROMISE
MAPR TECHNOLOGIES, INC. WHITE PAPER JANUARY 2018 MAPR DATA GOVERNANCE TABLE OF CONTENTS EXECUTIVE SUMMARY 3 BACKGROUND 4 MAPR DATA GOVERNANCE 5 CONCLUSION 7 EXECUTIVE SUMMARY The MapR DataOps Governance
More informationEMC SRM 3.0 & ViPR 1.1
EMC SRM 3.0 & ViPR 1.1 VIRTUALIZE EVERYTHING COMPROMISE NOTHING CHRIS RATCLIFFE VIKRAM BHAMBRI Advanced Software Division EMC Corporation 1 The EMC Exabyte Journey 2 Disruptive / Opportunistic IT Trends
More informationAtoS IT Solutions and Services. Microsoft Solutions Summit 2012
Microsoft Solutions Summit 2012 1 Building Private Cloud with Microsoft Solution 2 Building Private Cloud with Microsoft Solution Atos integration Establish a new strategic IT partnership From July 2011
More informationUsing the SDACK Architecture to Build a Big Data Product. Yu-hsin Yeh (Evans Ye) Apache Big Data NA 2016 Vancouver
Using the SDACK Architecture to Build a Big Data Product Yu-hsin Yeh (Evans Ye) Apache Big Data NA 2016 Vancouver Outline A Threat Analytic Big Data product The SDACK Architecture Akka Streams and data
More informationUnified Computing System Launch. Welcome to Yas Island
Unified Computing System Launch Welcome to Yas Island Unified Computing System Launch Walid Yehia Pre-sales Manager Middle East, Africa, & Turkey Information & Infrastructure Management for Cloud Computing
More informationHow Hybrid Cloud Accelerates IT Transformation
2014 VMware Inc. and Performance Methods Inc. All rights reserved How Hybrid Cloud Accelerates IT Transformation Wayne Pauley, Ph.D. Director of Strategic Alliances, EVP SDDC Solutions Today s Challenges
More informationORGANIZING FOR SUCCESS
1 ORGANIZING FOR SUCCESS Jon Peirce Vice President, EMC Global IT Private Cloud Infrastructure Group EMC IT Leadership Council 2011 2 Agenda Cloud differences and implications new and evolving technical
More informationMulti-tenancy version of BigDataBench
Multi-tenancy version of BigDataBench Gang Lu Institute of Computing Technology, Chinese Academy of Sciences BigDataBench Tutorial MICRO 2014 Cambridge, UK INSTITUTE OF COMPUTING TECHNOLOGY 1 Multi-tenancy
More informationBigDataBench-MT: Multi-tenancy version of BigDataBench
BigDataBench-MT: Multi-tenancy version of BigDataBench Gang Lu Beijing Academy of Frontier Science and Technology BigDataBench Tutorial, ASPLOS 2016 Atlanta, GA, USA n Software perspective Multi-tenancy
More informationELASTIC DATA PLATFORM
SERVICE OVERVIEW ELASTIC DATA PLATFORM A scalable and efficient approach to provisioning analytics sandboxes with a data lake ESSENTIALS Powerful: provide read-only data to anyone in the enterprise while
More informationAPI Best Practices. Managing APIs holistically across the enterprise
API Best Practices Managing APIs holistically across the enterprise APIs are critical to evolving application architectures Public clouds Microservices Distributed apps μservice μservice μservice μservice
More informationDeveloping Enterprise Cloud Solutions with Azure
Developing Enterprise Cloud Solutions with Azure Java Focused 5 Day Course AUDIENCE FORMAT Developers and Software Architects Instructor-led with hands-on labs LEVEL 300 COURSE DESCRIPTION This course
More informationDatabase Level 100. Rohit Rahi November Copyright 2018, Oracle and/or its affiliates. All rights reserved.
Database Level 100 Rohit Rahi November 2018 1 Safe Harbor Statement The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated
More informationPLEXXI HCN FOR VMWARE VSAN
PLEXXI HCN FOR VMWARE VSAN SOLUTION BRIEF Hyperconverged Network Fabric for VMware vsan Solutions FEATURED BENEFITS: Fully automated network configuration, based on VMware, drastically reduces operating
More informationAutomating Elasticity. March 2018
Automating Elasticity March 2018 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Notices This document is provided for informational purposes only. It represents AWS s current product
More informationTITLE. the IT Landscape
The Impact of Hyperconverged Infrastructure on the IT Landscape 1 TITLE Drivers for adoption Lower TCO Speed and Agility Scale Easily Operational Simplicity Hyper-converged Integrated storage & compute
More informationCourse AZ-100T01-A: Manage Subscriptions and Resources
Course AZ-100T01-A: Manage Subscriptions and Resources Module 1: Managing Azure Subscriptions In this module, you ll learn about the components that make up an Azure subscription and how management groups
More informationBuilding a government cloud Concepts and Solutions
Building a government cloud Concepts and Solutions Dr. Gabor Szentivanyi, ULX Open Source Consulting & Distribution Background Over 18 years of experience in enterprise grade open source Based in Budapest,
More informationVMware vfabric Data Director 2.5 EVALUATION GUIDE
VMware vfabric Data Director 2.5 EVALUATION GUIDE Introduction... 2 Pre- requisites for completing the basic and advanced scenarios... 3 Basic Scenarios... 4 Install Data Director using Express Install...
More informationZombie Apocalypse Workshop
Zombie Apocalypse Workshop Building Serverless Microservices Danilo Poccia @danilop Paolo Latella @LatellaPaolo September 22 nd, 2016 2015, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
More informationStorage Considerations for VMware vcloud Director. VMware vcloud Director Version 1.0
Storage Considerations for VMware vcloud Director Version 1.0 T e c h n i c a l W H I T E P A P E R Introduction VMware vcloud Director is a new solution that addresses the challenge of rapidly provisioning
More informationBuilding and Running a Solr-as-a-Service SHAI ERERA IBM
Building and Running a Solr-as-a-Service SHAI ERERA IBM Who Am I? Working at IBM Social Analytics & Technologies Lucene/Solr committer and PMC member http://shaierera.blogspot.com shaie@apache.org Background
More informationTRANSFORMING TO IT-AS-A-SERVICE
1 TRANSFORMING TO IT-AS-A-SERVICE Leveraging IT To Accelerate Business Agility Osama Soliman Advisory Technology Consultant February 2012 2 Enterprise IT Provides Control & Reliability Enterprise IT Trusted
More informationVisual TruView Unified Network and Application Performance Management Focused on the Experience of the End User
Visual TruView Unified Network and Application Performance Management Focused on the Experience of the End User BUSINESS CHALLENGE Problems can occur anywhere from the physical layer to wireless, across
More informationBaremetal with Apache CloudStack
Baremetal with Apache CloudStack ApacheCon Europe 2016 Jaydeep Marfatia Cloud, IOT and Analytics Me Director of Product Management Cloud Products Accelerite Background Project lead for open source project
More informationMoving into the Cloud. Steven Canale, VP of Sales for SoftLayer
Moving into the Cloud Steven Canale, VP of Sales for SoftLayer What is driving IT demand? Cyber security Advanced predictive analytics Business Optimization and Big Data Explosion of mobile devices Real-time
More informationVblock Infrastructure Packages: Accelerating Deployment of the Private Cloud
Vblock Infrastructure Packages: Accelerating Deployment of the Private Cloud Roberto Missana - Channel Product Sales Specialist Data Center, Cisco 1 IT is undergoing a transformation Enterprise IT solutions
More informationProcessing of big data with Apache Spark
Processing of big data with Apache Spark JavaSkop 18 Aleksandar Donevski AGENDA What is Apache Spark? Spark vs Hadoop MapReduce Application Requirements Example Architecture Application Challenges 2 WHAT
More informationOPTIMIZING CLOUD DEPLOYMENT OF VIRTUALIZED APPLICATIONS ON EMC SYMMETRIX VMAX CLOUD EDITION
White Paper OPTIMIZING CLOUD DEPLOYMENT OF VIRTUALIZED APPLICATIONS ON EMC SYMMETRIX VMAX CLOUD EDITION Simplifies cloud storage Automates management and provisioning Transforms as-a-service delivery EMC
More informationby Cisco Intercloud Fabric and the Cisco
Expand Your Data Search and Analysis Capability Across a Hybrid Cloud Solution Brief June 2015 Highlights Extend Your Data Center and Cloud Build a hybrid cloud from your IT resources and public and providerhosted
More informationRadware ADC Solution for the Virtual Data Center Dirk Aertgeerts Country Sales Manager Belgium & Luxembourg
Radware ADC Solution for the Virtual Data Center Dirk Aertgeerts Country Sales Manager Belgium & Luxembourg About Us Public Company Sept. 1999 (NASDAQ: RDWR) Founded in 1997 630 People Worldwide 270 in
More informationTransform to Your Cloud
Transform to Your Cloud Presented by VMware 2012 VMware Inc. All rights reserved Agenda Corporate Overview Cloud Infrastructure & Management Cloud Application Platform End User Computing The Journey to
More informationAirSembly. vcloud Director Management Platform
AirSembly vcloud Director Management Platform Fully unlock the features of your vcloud Director infrastructure with the AirSembly Cloud Management Platform. More than a portal to access all of the features
More informationIBM Compose Managed Platform for Multiple Open Source Databases
IBM Compose Managed Platform for Multiple Source Databases Source for Source for Data Layer Blueprint with Compose Source for Comprehensive Catalogue for Simplified Scoping Scalable Platform for FutureProof
More informationSOFTWARE DEFINED STORAGE VS. TRADITIONAL SAN AND NAS
WHITE PAPER SOFTWARE DEFINED STORAGE VS. TRADITIONAL SAN AND NAS This white paper describes, from a storage vendor perspective, the major differences between Software Defined Storage and traditional SAN
More informationJELASTIC PLATFORM-AS-INFRASTRUCTURE
JELASTIC PLATFORM-AS-INFRASTRUCTURE Jelastic provides enterprise cloud software that redefines the economics of cloud deployment and management. We deliver Platform-as-Infrastructure: bringing together
More informationHPE Hyper Converged. Mohannad Daradkeh Data center and Hybrid Cloud Architect Hewlett-Packard Enterprise Saudi Arabia
HPE Hyper Converged Mohannad Daradkeh Data center and Hybrid Cloud Architect Hewlett-Packard Enterprise Saudi Arabia Transform to a hybrid infrastructure Accelerate the delivery of apps and services to
More informationCisco Tetration Analytics
Cisco Tetration Analytics Enhanced security and operations with real time analytics Christopher Say (CCIE RS SP) Consulting System Engineer csaychoh@cisco.com Challenges in operating a hybrid data center
More informationAnything-as-a-Service. Name
1 Anything-as-a-Service Name 2 The Business Drivers RESPOND FASTER TO DRIVE NEW REVENUE REFOCUS RESOURCES TOWARD BUSINESS VALUE INCREASE AGILITY INCREASE VISIBILITY & CONTROL 3 Today s IT Service Delivery
More informationImportant DevOps Technologies (3+2+3days) for Deployment
Important DevOps Technologies (3+2+3days) for Deployment DevOps is the blending of tasks performed by a company's application development and systems operations teams. The term DevOps is being used in
More informationPOWERING THE INTERNET WITH APACHE MESOS
Neil Conway, Niklas Nielsen, Greg Mann & Sunil Shah POWERING THE INTERNET WITH APACHE MESOS 1 MESOS: ORIGINS 2 THE BIRTH OF MESOS TWITTER TECH TALK APACHE INCUBATION The grad students working on Mesos
More informationExploring Cloud Security, Operational Visibility & Elastic Datacenters. Kiran Mohandas Consulting Engineer
Exploring Cloud Security, Operational Visibility & Elastic Datacenters Kiran Mohandas Consulting Engineer The Ideal Goal of Network Access Policies People (Developers, Net Ops, CISO, ) V I S I O N Provide
More informationCopyright 2012 EMC Corporation. All rights reserved.
1 BACKUP BUILT FOR VMWARE Mark Twomey Technical Director, The Office Of The CTO 2 Agenda Market Forces Optimized VMware Backup Backup And Recovery For VCE Vblock Protecting vcloud Director Customer Success
More informationContinuous Delivery for Cloud Native Applications
Continuous Delivery for Cloud Native Applications Cyrille Le Clerc, Director, Product Management at CloudBees Bjorn Boe, Senior Field Engineer at Pivotal Software Speakers /Cyrille Le Clerc Product Manager
More informationArchitectural challenges for building a low latency, scalable multi-tenant data warehouse
Architectural challenges for building a low latency, scalable multi-tenant data warehouse Mataprasad Agrawal Solutions Architect, Services CTO 2017 Persistent Systems Ltd. All rights reserved. Our analytics
More informationProven video conference management software for Cisco Meeting Server
Proven video conference management software for Cisco Meeting Server VQ Conference Manager (formerly Acano Manager) is your key to dependable, scalable, self-service video conferencing Increase service
More informationFluentd + MongoDB + Spark = Awesome Sauce
Fluentd + MongoDB + Spark = Awesome Sauce Nishant Sahay, Sr. Architect, Wipro Limited Bhavani Ananth, Tech Manager, Wipro Limited Your company logo here Wipro Open Source Practice: Vision & Mission Vision
More informationCONTINUOUS DELIVERY WITH DC/OS AND JENKINS
SOFTWARE ARCHITECTURE NOVEMBER 15, 2016 CONTINUOUS DELIVERY WITH DC/OS AND JENKINS AGENDA Presentation Introduction to Apache Mesos and DC/OS Components that make up modern infrastructure Running Jenkins
More information