Adapting Enterprise Distributed Real-time and Embedded (DRE) Pub/Sub Middleware for Cloud Computing Environments

Size: px
Start display at page:

Download "Adapting Enterprise Distributed Real-time and Embedded (DRE) Pub/Sub Middleware for Cloud Computing Environments"

Transcription

1 Adapting Enterprise Distributed Real-time and Embedded (DRE) Pub/Sub Middleware for Cloud Computing Environments Joe Hoffert, Douglas Schmidt, and Aniruddha Gokhale Vanderbilt University Nashville, TN, USA

2 Context: Cloud Computing Resources provided as service Resources on demand Pay-as-you-go usage fee Computing resources CPUs, RAM Networking resources Bandwidth, network latency Popular implementations Amazon Elastic Compute Cloud (EC2), Google App Engine, GoGrid, AppNexus, Emulab OS, Database, RAM, CPU, Disk space, cores, load balancing, applications (e.g., Apache, Facebook servers), bandwidth, link latency 12/2/2010 Joe Hoffert, Vanderbilt University 2

3 Context: Enterprise DRE (E-DRE) Systems Wide range of DRE application domains testing & training of experimental aircraft across large geographic area air traffic management systems disaster recovery operations Manage data, resources critical to the system operations Correct configuration for given environment crucial to proper operation Typically developed for specific computing/networking environment Simplifies development by focusing on single operating environment Decreases system flexibility (e.g., porting to new computing hardware) 3 GHz CPUs, 4 GB RAM 1 Gb/s LAN Problem: Deploying E-DRE Systems In Cloud Infrastructures 12/2/2010 Joe Hoffert, Vanderbilt University 3

4 Motivating Example: Search & Rescue Missions (1/2) Scenario Regional disasters (e.g., hurricane, flooding) Survivors trapped Search & rescue mission initiated Search application fuses multiple sensor streams Thermal scans from unmanned aerial vehicles (UAVs) Video from existing camera infrastructure Data streams sent to ad-hoc datacenter for fusion & dissemination 4

5 Motivating Example: Search & Rescue Missions (2/2) Datacenter Requirements Operate in flexible environments, e.g., Support multiple missions & applications Varying # of senders, receivers Leverage available resources local resources unavailable Flexible resources, e.g., network bandwidth, CPU speed, RAM UAV providing infrared scan stream Cloud computing infrastructure Infrastructure camera providing video stream Ad-hoc datacenter Support Multiple QoS Reliability & latency e.g., video & streamed thermal scans Multimedia data Rescue helicopter Disaster victims 5

6 Challenges for Datacenter in Flexible Environments (1/3) Challenge 1: Reduction of Development Complexity Developing adaptive behavior is challenging: Inherent complexity designing appropriate responses for environment Accidental complexity transforming & managing appropriate responses from design to implementation 850 MHz CPUs, 2 GB RAM X 100 Mb/s LAN network loss data sending rate Increased development complexity reduces availability, assurance, and portability 6

7 Challenges for Datacenter in Flexible Environments (2/3) Challenge 2: Accurate Configuration in Flexible Environments Environment resources unknown a priori make static configuration inadequate Cloud computing infrastructure Ad-hoc datacenter Multicast TCP/IP UDP/IP??? Custom? protocol QoS mechanisms Inaccurate adaptation can result in loss of life & property 7

8 Challenges for Datacenter in Flexible Environments (3/3) Challenge 3: Timely Adaptation in Flexible Environments DRE systems require timely configuration Cloud computing infrastructure Ad-hoc datacenter TCP/IP UDP/IP Multicast Custom protocol QoS mechanisms Untimely adaptation can result in loss of life & property 8

9 Solution Approach: Autonomically Configuring Middleware and Transport Protocols via Machine Learning Techniques ADAptive Middleware And Network Transports (ADAMANT): Data Distribution Service (DDS) OMG pub/sub standard, rich QoS support OpenDDS, OpenSplice implementations Pluggable transport protocol frameworks Open source Adaptive Network Transports (ANT) framework Transport protocol framework Composable modules Fine-grained protocol control NAK-based Reed-Solomon encoding Artificial Neural Network (ANN) Trained on protocol properties Interpolates/Extrapolates for new environments 0 FEC-group Determines optimal protocol/parameters Constant time performance ACK-based Tornado encoding FEC-receiver FEC-sender XOR encoding Interpolation between training data ACK-based FEC-sender XOR encoding Custom protocol 1 NAK-based FEC-receiver Reed-Solomon encoding Custom protocol 2 Protocol Optimization 9

10 ADAMANT Architecture & Control Flow SAR Topic(s) 1. ADAMANT queries environment for resources. DDS Data Writer App Publisher Domain Data Reader App Subscriber Data Reader ADAMANT Adaptive Network Transport (ANT) Protocols ADAMANT Protocol Optimizer (ANN) 2. Resource information passed to ADAMANT. 3. ANN selects appropriate protocol in a timely manner & notifies ANT 4. ANT configures the protocol for the middleware Cloud Computing Environment Key: Control interaction between subsystems Assoc. between reader/writer &topic

11 Addressing Challenges for Datacenter in Flexible Envs. (1/3) ADAMANT addresses challenge 1 (development) via ANNs to manage protocol selection & implementation transformation ANNs manage the development complexity of protocol management: Automatically manage inherent complexity of relationships between environment and protocols Used directly in implementations (i.e., avoids accidental complexity of developing implementation) 3 GHz CPUs, 4 GB RAM X network loss 1 Gb/s LAN CPU speed RAM Network speed Network % loss Sending rate ADAMANT DDS ANN Autonomic Configuration Controller protocol parameters data sending rate Adaptive Network Transport (ANT) Framework 11

12 Challenges for Datacenter in Flexible Environments (2/3) ADAMANT addresses challenge 2 (accuracy) by overfitting ANN to the data Overfitting data increases ANN s accuracy for selecting appropriate protocol Cloud computing infrastructure Ad-hoc datacenter X X X TCP/IP Multicast UDP/IP Custom protocol QoS mechanisms ADAMANT accurately selects correct protocol 12

13 Challenges for Datacenter in Flexible Environments (3/3) ADAMANT addresses challenge 3 (timeliness) via ANN w/ bounded constanttime response ANNs are equation based: Equations based on nodes and connections Fixed number of inputs, hidden nodes, outputs (determined at off-line training time) Constant # of connections (determined at training time) CPU speed, RAM Network speed Network % loss protocol parameters ANN 13

14 Empirical Results Different Hardware Different Protocols Experimental environment: Using protocols that balance reliability and low latency IP Multicast w/ NAKs (NAKcast) Modified FEC (Ricochet) Varied CPU speed, network bandwidth Conducted several training runs ReLate2 Values GHz CPU, 1Gb LAN, 3 rcvrs, 5% loss NAKcast Hz Ricochet R4C3-25Hz Experiment Experiment Difference in hardware triggers a difference in appropriate transport protocol ReLate2 Values 850 MHz CPU, 100Mb LAN, 3 rcvrs, 5% loss NAKCast Hz Ricochet R4 C3-25Hz 14

15 Empirical Results - Accuracy Experimental environment: 394 operating environments Varied CPU speed, network bandwidth, # of data receivers, sending rate Conducted several training runs ANN outputs tested against known correct responses & cross-validation Accuracy (%) ANN Accuracy (known environments) hidden nodes hidden nodes hidden nodes 86 6 hidden nodes Accuracy for excluded data (%) ANN Accuracy (10-fold cross-validation) hidden nodes, error 24 hidden nodes, error 12 hidden nodes, error 6 hidden nodes, error Training Run Training Run ANNs w/ 24 nodes provide most instances of 100% accuracy, highest accuracy with cross-validation 15

16 Empirical Results - Timeliness Experimental environment: 394 operating environments Emulab: 3 GHz CPU, 2GB of RAM, Fedora Core 6 w/ real-time patches Sub 10 µs average response times for all ANN configurations Sub µs jitter for all ANN configurations 8 7 Average ANN Response Times Std Deviation ANN Response Times Time (µs) hidden nodes 12 hidden nodes 24 hidden nodes 36 hidden nodes Time (µs) hidden nodes 12 hidden nodes 24 hidden nodes 36 hidden nodes Classification Run Classification Run ANNs provide the predictable timeliness needed for DRE systems 16

17 Concluding Remarks & Future Work DRE systems in flexible environments need Accurate guidance Bounded, constant-time responses Overfitted ANNs provide Perfect accuracy for known inputs Low latency, constant time performance 0 Current/Future Work Combining multiple supervised machine learning techniques Autonomically adapting while environment dynamically changes Thank you for your time and attention Accuracy (%) ANN Accuracy Training Run Time (µs) 10 5 Average ANN Response Times Classification Run More information at ANN + Support Vector Machines Soli Deo Gloria 17

FLEXible Middleware And Transports (FLEXMAT) for Real-time Event Stream Processing (RT-ESP) Applications

FLEXible Middleware And Transports (FLEXMAT) for Real-time Event Stream Processing (RT-ESP) Applications FLEXible Middleware And Transports (FLEXMAT) for Real-time Event Stream Processing (RT-ESP) Applications Joe Hoffert, Doug Schmidt Vanderbilt University 1 Challenges and Goals Real-time Event Stream Processing

More information

Adapting Distributed Real-time and Embedded Pub/Sub Middleware for Cloud Computing Environments

Adapting Distributed Real-time and Embedded Pub/Sub Middleware for Cloud Computing Environments Adapting Distributed Real-time and Embedded Pub/Sub Middleware for Cloud Computing Environments Joe Hoffert, Douglas C. Schmidt, and Aniruddha Gokhale Vanderbilt University, VU Station B #1829, 2015 Terrace

More information

Integrating Machine Learning Techniques to Adapt Protocols for QoS-enabled Distributed Real-time and Embedded Publish/Subscribe Middleware

Integrating Machine Learning Techniques to Adapt Protocols for QoS-enabled Distributed Real-time and Embedded Publish/Subscribe Middleware Integrating Machine Learning Techniques to Adapt Protocols for QoS-enabled Distributed Real-time and Embedded Publish/Subscribe Middleware Joe Hoffert Dept. of Electrical Engineering and Computer Science

More information

Supporting Scalability and Adaptability via ADAptive Middleware And Network Transports (ADAMANT)

Supporting Scalability and Adaptability via ADAptive Middleware And Network Transports (ADAMANT) Supporting Scalability and Adaptability via ADAptive Middleware And Network Transports (ADAMANT) Joe Hoffert, Doug Schmidt Vanderbilt University Mahesh Balakrishnan, Ken Birman Cornell University Motivation

More information

Evaluating Timeliness and Accuracy Trade-offs of Supervised Machine Learning for Adapting Enterprise DRE Systems in Dynamic Environments *

Evaluating Timeliness and Accuracy Trade-offs of Supervised Machine Learning for Adapting Enterprise DRE Systems in Dynamic Environments * Evaluating Timeliness and Accuracy Trade-offs of Supervised Machine Learning for Adapting Enterprise DRE Systems in Dynamic Environments * Joe Hoffert Electrical Engineering & Computer Science, Vanderbilt

More information

Design and Run-Time Quality of Service Management Techniques for Publish/Subscribe Distributed Real-Time and Embedded Systems

Design and Run-Time Quality of Service Management Techniques for Publish/Subscribe Distributed Real-Time and Embedded Systems Design and Run-Time Quality of Service Management Techniques for Publish/Subscribe Distributed Real-Time and Embedded Systems http://www.dre.vanderbilt.edu/~jhoffert/dissertation.pdf Joe Hoffert jhoffert@dre.vanderbilt.edu

More information

Using Machine Learning to Maintain QoS for Large-scale Publish/Subscribe Systems in Dynamic Environments

Using Machine Learning to Maintain QoS for Large-scale Publish/Subscribe Systems in Dynamic Environments 1 Using Machine Learning to Maintain QoS for Large-scale Publish/Subscribe Systems in Dynamic Environments Joe Hoffert, Daniel Mack, and Douglas Schmidt Department of Electrical Engineering & Computer

More information

Adapting and Evaluating Distributed Real-time and Embedded Systems in Dynamic Environments

Adapting and Evaluating Distributed Real-time and Embedded Systems in Dynamic Environments Adapting and Evaluating Distributed Real-time and Embedded Systems in Dynamic Environments Joe Hoffert, Douglas Schmidt, and Aniruddha Gokhale Vanderbilt University, Nashville, TN, USA {joseph.w.hoffert,

More information

Evaluating Transport Protocols for Real-time Event Stream Processing Middleware and Applications

Evaluating Transport Protocols for Real-time Event Stream Processing Middleware and Applications Evaluating Transport Protocols for Real-time Event Stream Processing Middleware and Applications Joe Hoffert, Douglas Schmidt, and Aniruddha Gokhale Institute for Software Integrated Systems, Dept. of

More information

Evaluating Timeliness and Accuracy Trade-offs of Supervised Machine Learning for Adapting Enterprise DRE Systems in Dynamic Environments *

Evaluating Timeliness and Accuracy Trade-offs of Supervised Machine Learning for Adapting Enterprise DRE Systems in Dynamic Environments * Evaluating Timeliness and Accuracy Trade-offs of Supervised Machine Learning for Adapting Enterprise DRE Systems in Dynamic Environments * Joe Hoffert The King s University College, 9125-50 Street Edmonton,

More information

Adapting and Evaluating Distributed Real-time and Embedded Systems in Dynamic Environments

Adapting and Evaluating Distributed Real-time and Embedded Systems in Dynamic Environments Adapting and Evaluating Distributed Real-time and Embedded Systems in Dynamic Environments Joe Hoffert, Douglas Schmidt, and Annirudha Gokhale Vanderbilt University, Nashville, TN, USA {joseph.w.hoffert,

More information

Intelligent Event Processing in Quality of Service (QoS) Enabled Publish/Subscribe (Pub/Sub) Middleware

Intelligent Event Processing in Quality of Service (QoS) Enabled Publish/Subscribe (Pub/Sub) Middleware Intelligent Event Processing in Quality of Service (QoS) Enabled Publish/Subscribe (Pub/Sub) Middleware Joe Hoffert jhoffert@dre.vanderbilt.edu http://www.dre.vanderbilt.edu/~jhoffert/ CS PhD Student Vanderbilt

More information

Empirical Evaluation of Latency-Sensitive Application Performance in the Cloud

Empirical Evaluation of Latency-Sensitive Application Performance in the Cloud Empirical Evaluation of Latency-Sensitive Application Performance in the Cloud Sean Barker and Prashant Shenoy University of Massachusetts Amherst Department of Computer Science Cloud Computing! Cloud

More information

Techniques for Dynamic Swapping in the Lightweight CORBA Component Model

Techniques for Dynamic Swapping in the Lightweight CORBA Component Model in the Lightweight CORBA Component Model jai@dre.vanderbilt.edu www.dre.vanderbilt.edu/~jai Dr. Aniruddha Gokhale gokhale@dre.vanderbilt.edu www.dre.vanderbilt.edu/~gokhale Dr. Douglas C. Schmidt schmidt@dre.vanderbilt.edu

More information

A Data-Centric Approach for Modular Assurance Abstract. Keywords: 1 Introduction

A Data-Centric Approach for Modular Assurance Abstract. Keywords: 1 Introduction A Data-Centric Approach for Modular Assurance Gabriela F. Ciocarlie, Heidi Schubert and Rose Wahlin Real-Time Innovations, Inc. {gabriela, heidi, rose}@rti.com Abstract. A mixed-criticality system is one

More information

Meeting the Challenges of Ultra-Large

Meeting the Challenges of Ultra-Large Meeting the Challenges of Ultra-Large Large-Scale Systems Tuesday, July 11, 2006,, OMG RTWS, Arlington, VA Dr. Douglas C. Schmidt d.schmidt@vanderbilt.edu www.dre.vanderbilt.edu/~schmidt Institute for

More information

Institute for Software Integrated Systems Vanderbilt University Nashville, Tennessee

Institute for Software Integrated Systems Vanderbilt University Nashville, Tennessee Architectural and Optimization Techniques for Scalable, Real-time and Robust Deployment and Configuration of DRE Systems Gan Deng Douglas C. Schmidt Aniruddha Gokhale Institute for Software Integrated

More information

Architectural Support for Mode-Driven Fault Tolerance in Distributed Applications

Architectural Support for Mode-Driven Fault Tolerance in Distributed Applications Architectural Support for in Distributed Applications Deepti Srivastava and Priya Narasimhan Department of Electrical and Computer Engineering University Pittsburgh, PA, USA Motivation Fault tolerance

More information

DREMS: A Toolchain and Platform for the Rapid Application Development, Integration, and Deployment of Managed Distributed Real-time Embedded Systems

DREMS: A Toolchain and Platform for the Rapid Application Development, Integration, and Deployment of Managed Distributed Real-time Embedded Systems DREMS: A Toolchain and Platform for the Rapid Application Development, Integration, and Deployment of Managed Distributed Real-time Embedded Systems William Emfinger, Pranav Kumar, Abhishek Dubey, William

More information

Dependable Computing Clouds for Cyber-Physical Systems

Dependable Computing Clouds for Cyber-Physical Systems Dependable Computing Clouds for Cyber-Physical Systems Dependability Issues in Cloud Computing (DISCCO) Workshop October 11 th, 2012 Douglas C. Schmidt d.schmidt@vanderbilt.edu Institute for Software Integrated

More information

Towards a DDS-based Platform Specific Model for Robotics

Towards a DDS-based Platform Specific Model for Robotics Towards a DDS-based Platform Specific Model for Robotics Juan Pedro Bandera Rubio, Adrián Garcés and Jesús Martínez SDIR VI, ICRA 2011 May 9, 2011 Shangai (China) University of Málaga, University of Extremadura,

More information

Data Model Considerations for Radar Systems

Data Model Considerations for Radar Systems WHITEPAPER Data Model Considerations for Radar Systems Executive Summary The market demands that today s radar systems be designed to keep up with a rapidly changing threat environment, adapt to new technologies,

More information

QoS Adaptation for Publish/Subscribe Middleware in Real-Time Dynamic Environments

QoS Adaptation for Publish/Subscribe Middleware in Real-Time Dynamic Environments 230 The International Arab Journal of Information Technology, Vol. 14, No. 2, 2017 QoS Adaptation for Publish/Subscribe Middleware in Real-Time Dynamic Environments Basem Almadani 1, Shadi Abudalfa 1,

More information

Features. HDX WAN optimization. QoS

Features. HDX WAN optimization. QoS May 2013 Citrix CloudBridge Accelerates, controls and optimizes applications to all locations: datacenter, branch offices, public and private clouds and mobile users Citrix CloudBridge provides a unified

More information

Towards integration of the Data Distribution Service with the CORBA Component Model

Towards integration of the Data Distribution Service with the CORBA Component Model Towards integration of the Data Distribution Service with the CORBA Component Model William R. Otte, Friedhelm Wolf, Douglas C. Schmidt (Vanderbilt University) Christian Esposito (University of Napoli,

More information

NetQoPE: A Middleware-based Network QoS Provisioning Engine for Distributed Real-time and Embedded Systems

NetQoPE: A Middleware-based Network QoS Provisioning Engine for Distributed Real-time and Embedded Systems NetQoPE: A Middleware-based Network QoS Provisioning Engine for Distributed Real-time and Embedded Systems Jaiganesh Balasubramanian 1, Sumant Tambe 1, Shrirang Gadgil 2, Frederick Porter 2, Balakrishnan

More information

Using DDS with TSN and Adaptive AUTOSAR. Bob Leigh, Director of Market Development, Autonomous Vehicles Reinier Torenbeek, Systems Architect

Using DDS with TSN and Adaptive AUTOSAR. Bob Leigh, Director of Market Development, Autonomous Vehicles Reinier Torenbeek, Systems Architect Using DDS with TSN and Adaptive AUTOSAR Bob Leigh, Director of Market Development, Autonomous Vehicles Reinier Torenbeek, Systems Architect Agenda Intro to Data Distribution Service (DDS) Use Cases for

More information

Back To The Future - VMware Product Directions. Andre Kemp Sr. Product Marketing Manager Asia - Pacific

Back To The Future - VMware Product Directions. Andre Kemp Sr. Product Marketing Manager Asia - Pacific Back To The Future - VMware Product Directions Andre Kemp Sr. Product Marketing Manager Asia - Pacific Disclaimer This session contains product features that are currently under development. This session/overview

More information

CS 514: Transport Protocols for Datacenters

CS 514: Transport Protocols for Datacenters Department of Computer Science Cornell University Outline Motivation 1 Motivation 2 3 Commodity Datacenters Blade-servers, Fast Interconnects Different Apps: Google -> Search Amazon -> Etailing Computational

More information

Next-Generation Cloud Platform

Next-Generation Cloud Platform Next-Generation Cloud Platform Jangwoo Kim Jun 24, 2013 E-mail: jangwoo@postech.ac.kr High Performance Computing Lab Department of Computer Science & Engineering Pohang University of Science and Technology

More information

Scaling Internet TV Content Delivery ALEX GUTARIN DIRECTOR OF ENGINEERING, NETFLIX

Scaling Internet TV Content Delivery ALEX GUTARIN DIRECTOR OF ENGINEERING, NETFLIX Scaling Internet TV Content Delivery ALEX GUTARIN DIRECTOR OF ENGINEERING, NETFLIX Inventing Internet TV Available in more than 190 countries 104+ million subscribers Lots of Streaming == Lots of Traffic

More information

Building High-Assurance Systems out of Software Components of Lesser Assurance Using Middleware Security Gateways

Building High-Assurance Systems out of Software Components of Lesser Assurance Using Middleware Security Gateways Building High-Assurance Systems out of Software Components of Lesser Assurance Using Middleware Security Gateways A PrismTech Product Line OMG's First Software Assurance Workshop: Working Together for

More information

Research Faculty Summit Systems Fueling future disruptions

Research Faculty Summit Systems Fueling future disruptions Research Faculty Summit 2018 Systems Fueling future disruptions Elevating the Edge to be a Peer of the Cloud Kishore Ramachandran Embedded Pervasive Lab, Georgia Tech August 2, 2018 Acknowledgements Enrique

More information

Applying Model Intelligence Frameworks for Deployment Problem in Real-Time and Embedded Systems

Applying Model Intelligence Frameworks for Deployment Problem in Real-Time and Embedded Systems Applying Model Intelligence Frameworks for Deployment Problem in Real-Time and Embedded Systems Andrey Nechypurenko 1, Egon Wuchner 1, Jules White 2, and Douglas C. Schmidt 2 1 Siemens AG, Corporate Technology

More information

Angelo Corsaro, Ph.D. Chief Technology Officer! OMG DDS Sig Co-Chair PrismTech

Angelo Corsaro, Ph.D. Chief Technology Officer! OMG DDS Sig Co-Chair PrismTech Angelo Corsaro, Ph.D. Chief Technology Officer! OMG DDS Sig Co-Chair PrismTech angelo.corsaro@prismtech.com! Standards Scopes Standards Compared DDS Standard v1.2 2004 Programming Language Independent

More information

Wireless Environments

Wireless Environments A Cyber Physical Systems Architecture for Timely and Reliable Information Dissemination in Mobile, Aniruddha Gokhale Vanderbilt University EECS Nashville, TN Wireless Environments Steven Drager, William

More information

Ivanti Service Desk and Asset Manager Technical Specifications and Architecture Guidelines

Ivanti Service Desk and Asset Manager Technical Specifications and Architecture Guidelines Ivanti Service Desk and Asset Manager Technical Specifications and Architecture Guidelines This document contains the confidential information and/or proprietary property of Ivanti, Inc. and its affiliates

More information

Model-Driven Optimizations of Component Systems

Model-Driven Optimizations of Component Systems Model-Driven Optimizations of omponent Systems OMG Real-time Workshop July 12, 2006 Krishnakumar Balasubramanian Dr. Douglas. Schmidt {kitty,schmidt}@dre.vanderbilt.edu Institute for Software Integrated

More information

DQML: A Modeling Language for Configuring Distributed Publish/Subscribe Quality of Service Policies

DQML: A Modeling Language for Configuring Distributed Publish/Subscribe Quality of Service Policies DQML: A Modeling Language for Configuring Distributed Publish/Subscribe Quality of Service Policies Joe Hoffert, Douglas Schmidt, and Aniruddha Gokhale Institute for Software Integrated Systems, Dept.

More information

Defense & Aerospace. Networked visualization for distributed mission operations

Defense & Aerospace. Networked visualization for distributed mission operations Defense & Aerospace Networked visualization for distributed mission operations Collaboration over IP Because operators and decision-makers need immediate access to visual information from a wide variety

More information

The Future of Virtualization Desktop to the Datacentre. Raghu Raghuram Vice President Product and Solutions VMware

The Future of Virtualization Desktop to the Datacentre. Raghu Raghuram Vice President Product and Solutions VMware The Future of Virtualization Desktop to the Datacentre Raghu Raghuram Vice President Product and Solutions VMware Virtualization- Desktop to the Datacentre VDC- vcloud vclient With our partners, we are

More information

Overview of QPM 4.1. What is QPM? CHAPTER

Overview of QPM 4.1. What is QPM? CHAPTER CHAPTER 1 Overview of QPM 4.1 This chapter contains the following topics: What is QPM?, page 1-1 Preparing to Install QPM, page 1-2 Further Resources, page 1-5 What is QPM? QoS Policy Manager (QPM) lets

More information

Performance impact of Mobile Cloud Computing on Wireless LAN

Performance impact of Mobile Cloud Computing on Wireless LAN Performance impact of Mobile Cloud Computing on Wireless LAN 17. Mobilfunktagung in Osnabrück 2012 Arun Wadhawan Fraunhofer Institut for Computer Graphics IGD Darmstadt, Germany Email: arun.wadhawan@igd.fraunhofer.de

More information

Controlling Quality-of-Service in a Distributed Real-time and Embedded Multimedia Application via Adaptive Middleware

Controlling Quality-of-Service in a Distributed Real-time and Embedded Multimedia Application via Adaptive Middleware Controlling Quality-of-Service in a Distributed Real-time and Embedded Multimedia Application via Adaptive Middleware Richard E. Schantz, Joseph P. Loyall, Craig Rodrigues BBN Technologies Cambridge, MA,

More information

Evaluating Adaptive Resource Management for Distributed Real-Time Embedded Systems

Evaluating Adaptive Resource Management for Distributed Real-Time Embedded Systems Evaluating Adaptive Management for Distributed Real-Time Embedded Systems Nishanth Shankaran, Xenofon Koutsoukos, Douglas C. Schmidt, and Aniruddha Gokhale Dept. of EECS, Vanderbilt University, Nashville

More information

Developing Enterprise Cloud Solutions with Azure

Developing Enterprise Cloud Solutions with Azure Developing Enterprise Cloud Solutions with Azure Java Focused 5 Day Course AUDIENCE FORMAT Developers and Software Architects Instructor-led with hands-on labs LEVEL 300 COURSE DESCRIPTION This course

More information

Adaptive System Infrastructure for Ultra-Large. Large-Scale Systems. SMART Conference, Thursday, March 6 th, 2008

Adaptive System Infrastructure for Ultra-Large. Large-Scale Systems. SMART Conference, Thursday, March 6 th, 2008 Adaptive System Infrastructure for Ultra-Large Large-Scale Systems SMART Conference, Thursday, March 6 th, 2008 Dr. Douglas C. Schmidt d.schmidt@vanderbilt.edu www.dre.vanderbilt.edu/~schmidt Institute

More information

F6 Model-driven Development Kit (F6MDK)

F6 Model-driven Development Kit (F6MDK) F6 Model-driven Development Kit (F6MDK) Gabor Karsai, Abhishek Dubey, Andy Gokhale, William R. Otte, Csanad Szabo; Vanderbilt University/ISIS Alessandro Coglio, Eric Smith; Kestrel Institute Prasanta Bose;

More information

Cross-layer Optimization for Virtual Machine Resource Management

Cross-layer Optimization for Virtual Machine Resource Management Cross-layer Optimization for Virtual Machine Resource Management Ming Zhao, Arizona State University Lixi Wang, Amazon Yun Lv, Beihang Universituy Jing Xu, Google http://visa.lab.asu.edu Virtualized Infrastructures,

More information

A Publish/Subscribe Middleware for Dependable and Real-time Resource Monitoring in the Cloud

A Publish/Subscribe Middleware for Dependable and Real-time Resource Monitoring in the Cloud A Publish/Subscribe Middleware for Dependable and Real-time Resource Monitoring in the Cloud Kyoungho An, Subhav Pradhan, Faruk Caglar, Aniruddha Gokhale Institute for Software Integrated Systems (ISIS)

More information

Developing deterministic networking technology for railway applications using TTEthernet software-based end systems

Developing deterministic networking technology for railway applications using TTEthernet software-based end systems Developing deterministic networking technology for railway applications using TTEthernet software-based end systems Project n 100021 Astrit Ademaj, TTTech Computertechnik AG Outline GENESYS requirements

More information

A Cloud Middleware for Assuring Performance and High Availability of Soft Real-time Applications

A Cloud Middleware for Assuring Performance and High Availability of Soft Real-time Applications A Cloud Middleware for Assuring Performance and High Availability of Soft Real-time Applications Kyoungho An, Shashank Shekhar, Faruk Caglar, Aniruddha Gokhale a, Shivakumar Sastry b a Institute for Software

More information

Distributed Systems. 31. The Cloud: Infrastructure as a Service Paul Krzyzanowski. Rutgers University. Fall 2013

Distributed Systems. 31. The Cloud: Infrastructure as a Service Paul Krzyzanowski. Rutgers University. Fall 2013 Distributed Systems 31. The Cloud: Infrastructure as a Service Paul Krzyzanowski Rutgers University Fall 2013 December 12, 2014 2013 Paul Krzyzanowski 1 Motivation for the Cloud Self-service configuration

More information

Maelstrom: An Enterprise Continuity Protocol for Financial Datacenters

Maelstrom: An Enterprise Continuity Protocol for Financial Datacenters Maelstrom: An Enterprise Continuity Protocol for Financial Datacenters Mahesh Balakrishnan, Tudor Marian, Hakim Weatherspoon Cornell University, Ithaca, NY Datacenters Internet Services (90s) Websites,

More information

Pocket: Elastic Ephemeral Storage for Serverless Analytics

Pocket: Elastic Ephemeral Storage for Serverless Analytics Pocket: Elastic Ephemeral Storage for Serverless Analytics Ana Klimovic*, Yawen Wang*, Patrick Stuedi +, Animesh Trivedi +, Jonas Pfefferle +, Christos Kozyrakis* *Stanford University, + IBM Research 1

More information

Oktober 2018 Dell Tech. Forum München

Oktober 2018 Dell Tech. Forum München Oktober 2018 Dell Tech. Forum München Virtustream Digital Transformation & SAP Jan Büsen Client Solutions Executive, Virtustream The Business Agenda: Digital IT = Competitive Advantage Business Driven

More information

Reliable Communication for Datacenters

Reliable Communication for Datacenters Cornell University Datacenters Internet Services (90s) Websites, Search, Online Stores Since then: # of low-end volume servers Millions 30 25 20 15 10 5 0 2000 2001 2002 2003 2004 2005 Installed Server

More information

SCALE AND SECURE MOBILE / IOT MQTT TRAFFIC

SCALE AND SECURE MOBILE / IOT MQTT TRAFFIC APPLICATION NOTE SCALE AND SECURE MOBILE / IOT TRAFFIC Connecting millions of devices requires a simple implementation for fast deployments, adaptive security for protection against hacker attacks, and

More information

Introduction to Distributed Systems

Introduction to Distributed Systems Introduction to Distributed Systems Other matters: review of the Bakery Algorithm: why can t we simply keep track of the last ticket taken and the next ticvket to be called? Ref: [Coulouris&al Ch 1, 2]

More information

Simulation of Cloud Computing Environments with CloudSim

Simulation of Cloud Computing Environments with CloudSim Simulation of Cloud Computing Environments with CloudSim Print ISSN: 1312-2622; Online ISSN: 2367-5357 DOI: 10.1515/itc-2016-0001 Key Words: Cloud computing; datacenter; simulation; resource management.

More information

Vortex OpenSplice. Python DDS Binding

Vortex OpenSplice. Python DDS Binding Vortex OpenSplice Python DDS Binding ist.adlinktech.com 2018 Table of Contents 1. Background... 3 2. Why Python DDS Binding is a Big Deal... 4 2 1. Background 1.1 Python Python Software Foundation s Python

More information

CloudAP: Improving the QoS of Mobile Applications with Efficient VM Migration

CloudAP: Improving the QoS of Mobile Applications with Efficient VM Migration CloudAP: Improving the QoS of Mobile Applications with Efficient VM Migration Renyu Yang, Ph.D. Student School of Computing, Beihang University yangry@act.buaa.edu.cn In IEEE HPCC, Zhangjiajie, China,

More information

CaDAnCE: A Criticality-aware Deployment And Configuration Engine

CaDAnCE: A Criticality-aware Deployment And Configuration Engine CaDAnCE: A Criticality-aware Deployment And Configuration Engine Gan Deng, Douglas C. Schmidt, Aniruddha Gokhale Dept. of EECS, Vanderbilt University, Nashville, TN {dengg,schmidt,gokhale}@dre.vanderbilt.edu

More information

Evaluating Distributed Real-time and Embedded System Test Correctness using System Execution Traces

Evaluating Distributed Real-time and Embedded System Test Correctness using System Execution Traces Cent. Eur. J. Comp. Sci. 1-21 Author version Central European Journal of Computer Science Evaluating Distributed Real-time and Embedded System Test Correctness using System Execution Traces Research Article

More information

Chapter 1: Introduction 1/29

Chapter 1: Introduction 1/29 Chapter 1: Introduction 1/29 What is a Distributed System? A distributed system is a collection of independent computers that appears to its users as a single coherent system. 2/29 Characteristics of a

More information

WHITE PAPER: BEST PRACTICES. Sizing and Scalability Recommendations for Symantec Endpoint Protection. Symantec Enterprise Security Solutions Group

WHITE PAPER: BEST PRACTICES. Sizing and Scalability Recommendations for Symantec Endpoint Protection. Symantec Enterprise Security Solutions Group WHITE PAPER: BEST PRACTICES Sizing and Scalability Recommendations for Symantec Rev 2.2 Symantec Enterprise Security Solutions Group White Paper: Symantec Best Practices Contents Introduction... 4 The

More information

NetAlly. Application Advisor. Distributed Sites and Applications. Monitor and troubleshoot end user application experience.

NetAlly. Application Advisor. Distributed Sites and Applications. Monitor and troubleshoot end user application experience. NetAlly Application Advisor Monitor End User Experience for Local and Remote Users, Distributed Sites and Applications Part of the OptiView Management Suite (OMS) OMS provides the breadth of visibility

More information

Migration and Building of Data Centers in IBM SoftLayer

Migration and Building of Data Centers in IBM SoftLayer Migration and Building of Data Centers in IBM SoftLayer Advantages of IBM SoftLayer and RackWare Together IBM SoftLayer offers customers the advantage of migrating and building complex environments into

More information

Applying CORBA Fault Tolerant Mechanisms to Network Management. B. Natarajan, F. Kuhns, and C. O Ryan

Applying CORBA Fault Tolerant Mechanisms to Network Management. B. Natarajan, F. Kuhns, and C. O Ryan Applying CORBA Fault Tolerant Mechanisms to Network Management Aniruddha Gokhale Shalini Yajnik Bell Laboratories Lucent Technologies Douglas Schmidt B. Natarajan, F. Kuhns, and C. O Ryan Distributed Object

More information

VM Migration Acceleration over 40GigE Meet SLA & Maximize ROI

VM Migration Acceleration over 40GigE Meet SLA & Maximize ROI VM Migration Acceleration over 40GigE Meet SLA & Maximize ROI Mellanox Technologies Inc. Motti Beck, Director Marketing Motti@mellanox.com Topics Introduction to Mellanox Technologies Inc. Why Cloud SLA

More information

Validating Hyperconsolidation Savings With VMAX 3

Validating Hyperconsolidation Savings With VMAX 3 Validating Hyperconsolidation Savings With VMAX 3 By Ashish Nadkarni, IDC Storage Team An IDC Infobrief, sponsored by EMC January 2015 Validating Hyperconsolidation Savings With VMAX 3 Executive Summary:

More information

A QoS Policy Configuration Modeling Language for Publish/Subscribe Middleware Platforms

A QoS Policy Configuration Modeling Language for Publish/Subscribe Middleware Platforms A QoS Policy Configuration Modeling Language for Publish/Subscribe Middleware Platforms Joe Hoffert, Douglas Schmidt, and Aniruddha Gokhale Institute for Software Integrated Systems, Dept of EECS Vanderbilt

More information

Zombie Apocalypse Workshop

Zombie Apocalypse Workshop Zombie Apocalypse Workshop Building Serverless Microservices Danilo Poccia @danilop Paolo Latella @LatellaPaolo September 22 nd, 2016 2015, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

More information

Designing High Performance IEC61499 Applications on Top of DDS

Designing High Performance IEC61499 Applications on Top of DDS ETFA2013 4th 4DIAC Users Workshop Designing High Performance IEC61499 Applications on Top of DDS Industrial communications Complex Different solutions at the different layers Fieldbus at bottom layers:

More information

Information-Centric IoT Platforms for City-Scale Deployments

Information-Centric IoT Platforms for City-Scale Deployments Information-Centric IoT Platforms for City-Scale Deployments Jiachen Chen WINLAB, Rutgers University, NJ, USA Email: jiachen@winlab.rutgers.edu Dec. 2, 2016 Information-Centric IoT Platforms for City-Scale

More information

Concern-based Composition and Reuse of Distributed Systems

Concern-based Composition and Reuse of Distributed Systems Concern-based Composition and Reuse of Distributed Systems Andrey Nechypurenko andrey.nechypurenko@siem ens.com Siemens AG, Germany Douglas Schmidt, Tao Lu, Gan Deng, Emre Turkay, Aniruddha Gokhale Vanderbilt

More information

Distributed Systems. Edited by. Ghada Ahmed, PhD. Fall (3rd Edition) Maarten van Steen and Tanenbaum

Distributed Systems. Edited by. Ghada Ahmed, PhD. Fall (3rd Edition) Maarten van Steen and Tanenbaum Distributed Systems (3rd Edition) Maarten van Steen and Tanenbaum Edited by Ghada Ahmed, PhD Fall 2017 Introduction: What is a distributed system? Distributed System Definition A distributed system is

More information

Introduction to Amazon Web Services

Introduction to Amazon Web Services Introduction to Amazon Web Services Introduction Amazon Web Services (AWS) is a collection of remote infrastructure services mainly in the Infrastructure as a Service (IaaS) category, with some services

More information

Distributed Systems Principles and Paradigms

Distributed Systems Principles and Paradigms Distributed Systems Principles and Paradigms Chapter 01 (version September 5, 2007) Maarten van Steen Vrije Universiteit Amsterdam, Faculty of Science Dept. Mathematics and Computer Science Room R4.20.

More information

DISTRIBUTED SYSTEMS Principles and Paradigms Second Edition ANDREW S. TANENBAUM MAARTEN VAN STEEN. Chapter 1. Introduction

DISTRIBUTED SYSTEMS Principles and Paradigms Second Edition ANDREW S. TANENBAUM MAARTEN VAN STEEN. Chapter 1. Introduction DISTRIBUTED SYSTEMS Principles and Paradigms Second Edition ANDREW S. TANENBAUM MAARTEN VAN STEEN Chapter 1 Introduction Modified by: Dr. Ramzi Saifan Definition of a Distributed System (1) A distributed

More information

PRISMTECH. Benchmarking OMG DDS for Large-scale Distributed Systems. Powering Netcentricity

PRISMTECH. Benchmarking OMG DDS for Large-scale Distributed Systems. Powering Netcentricity PRISMTECH Powering Netcentricity Benchmarking OMG DDS for Large-scale Distributed Systems Reinier Torenbeek reinier.torenbeek@prismtech.com Senior Solution Architect PrismTech Benchmarking OMG DDS for

More information

VMware Vision and Future Directions Jan Kvinta

VMware Vision and Future Directions Jan Kvinta VMware Vision and Future Directions Jan Kvinta Click to edit Master text styles The Worldwide Server Market CY2007: 8M total server units shipped (x86 server units =7.6M) Other Servers 5% x86 servers

More information

Opendedupe & Veritas NetBackup ARCHITECTURE OVERVIEW AND USE CASES

Opendedupe & Veritas NetBackup ARCHITECTURE OVERVIEW AND USE CASES Opendedupe & Veritas NetBackup ARCHITECTURE OVERVIEW AND USE CASES May, 2017 Contents Introduction... 2 Overview... 2 Architecture... 2 SDFS File System Service... 3 Data Writes... 3 Data Reads... 3 De-duplication

More information

Quality of Service (QoS) Enabled Dissemination of Managed Information Objects in a Publish-Subscribe-Query

Quality of Service (QoS) Enabled Dissemination of Managed Information Objects in a Publish-Subscribe-Query Quality of Service (QoS) Enabled Dissemination of Managed Information Objects in a Publish-Subscribe-Query Information Broker Dr. Joe Loyall BBN Technologies The Boeing Company Florida Institute for Human

More information

QLIKVIEW SCALABILITY BENCHMARK WHITE PAPER

QLIKVIEW SCALABILITY BENCHMARK WHITE PAPER QLIKVIEW SCALABILITY BENCHMARK WHITE PAPER Hardware Sizing Using Amazon EC2 A QlikView Scalability Center Technical White Paper June 2013 qlikview.com Table of Contents Executive Summary 3 A Challenge

More information

Unisys ClearPath Plus Server CS7201.

Unisys ClearPath Plus Server CS7201. Unisys ClearPath Plus Server CS7201. The CS7201 server is a mid-range, fully featured, Intel Xeon processor MP based system for MCP environments. This ClearPath Plus server running the MCP operating system

More information

SIMPLE, FLEXIBLE CONNECTIONS FOR TODAY S BUSINESS. Ethernet Services from Verizon

SIMPLE, FLEXIBLE CONNECTIONS FOR TODAY S BUSINESS. Ethernet Services from Verizon SIMPLE, FLEXIBLE CONNECTIONS FOR TODAY S BUSINESS Ethernet Services from Verizon For growing businesses, the network is more important than ever. It s the foundation for all of the technology that helps

More information

The Future of Virtualization. Jeff Jennings Global Vice President Products & Solutions VMware

The Future of Virtualization. Jeff Jennings Global Vice President Products & Solutions VMware The Future of Virtualization Jeff Jennings Global Vice President Products & Solutions VMware From Virtual Infrastructure to VDC- Windows Linux Future Future Future lication Availability Security Scalability

More information

Risk-Aware Rapid Data Evacuation for Large- Scale Disasters in Optical Cloud Networks

Risk-Aware Rapid Data Evacuation for Large- Scale Disasters in Optical Cloud Networks Risk-Aware Rapid Data Evacuation for Large- Scale Disasters in Optical Cloud Networks Presenter: Yongcheng (Jeremy) Li PhD student, School of Electronic and Information Engineering, Soochow University,

More information

SEER: LEVERAGING BIG DATA TO NAVIGATE THE COMPLEXITY OF PERFORMANCE DEBUGGING IN CLOUD MICROSERVICES

SEER: LEVERAGING BIG DATA TO NAVIGATE THE COMPLEXITY OF PERFORMANCE DEBUGGING IN CLOUD MICROSERVICES SEER: LEVERAGING BIG DATA TO NAVIGATE THE COMPLEXITY OF PERFORMANCE DEBUGGING IN CLOUD MICROSERVICES Yu Gan, Yanqi Zhang, Kelvin Hu, Dailun Cheng, Yuan He, Meghna Pancholi, and Christina Delimitrou Cornell

More information

Datasheet. Shenzhen TG-NET Botone Technology Co., Ltd. M-5 TG-NET Cloud Box. Datasheet

Datasheet. Shenzhen TG-NET Botone Technology Co., Ltd. M-5 TG-NET Cloud Box. Datasheet Datasheet M-5 TG-NET Cloud Box Datasheet Shenzhen TG-NET Botone Technology Co., Ltd. Address: Bldg.E3,Int l E-City,#1001 Zhongshanyuan Rd.,Nanshan District,Shenzhen, China Website: www.tg-net.net Tel:

More information

Advanced Architectures for Oracle Database on Amazon EC2

Advanced Architectures for Oracle Database on Amazon EC2 Advanced Architectures for Oracle Database on Amazon EC2 Abdul Sathar Sait Jinyoung Jung Amazon Web Services November 2014 Last update: April 2016 Contents Abstract 2 Introduction 3 Oracle Database Editions

More information

Edge for All Business

Edge for All Business 1 Edge for All Business Datasheet Zynstra is designed and built for the edge the business-critical compute activity that takes place outside a large central datacenter, in branches, remote offices, or

More information

Cloud Computing. What is cloud computing. CS 537 Fall 2017

Cloud Computing. What is cloud computing. CS 537 Fall 2017 Cloud Computing CS 537 Fall 2017 What is cloud computing Illusion of infinite computing resources available on demand Scale-up for most apps Elimination of up-front commitment Small initial investment,

More information

Analyzing Compute vs. Storage Tradeoff for Videoaware Storage Efficiency

Analyzing Compute vs. Storage Tradeoff for Videoaware Storage Efficiency Analyzing Compute vs. Storage Tradeoff for Videoaware Storage Efficiency Atish Kathpal, Mandar Kulkarni Ajay Bakre Advanced Technology Group NetApp Inc. 1 Context and Overview Trend: Number of devices

More information

Enhanced Ethernet Switching Technology. Time Applications. Rui Santos 17 / 04 / 2009

Enhanced Ethernet Switching Technology. Time Applications. Rui Santos 17 / 04 / 2009 Enhanced Ethernet Switching Technology for Adaptive Hard Real- Time Applications Rui Santos (rsantos@ua.pt) 17 / 04 / 2009 Problem 2 Switched Ethernet became common in real-time communications Some interesting

More information

Evaluating CPU utilization in a Cloud Environment

Evaluating CPU utilization in a Cloud Environment Evaluating CPU utilization in a Cloud Environment Presenter MSCS, KFUPM Thesis Committee Members Dr. Farag Azzedin (Advisor) Dr. Mahmood Khan Naizi Dr. Salahdin Adam ICS Department, KFUPM 6/9/2017 2 of

More information

CIT 668: System Architecture. Amazon Web Services

CIT 668: System Architecture. Amazon Web Services CIT 668: System Architecture Amazon Web Services Topics 1. AWS Global Infrastructure 2. Foundation Services 1. Compute 2. Storage 3. Database 4. Network 3. AWS Economics Amazon Services Architecture Regions

More information

Data-Centric Architecture for Space Systems

Data-Centric Architecture for Space Systems Data-Centric Architecture for Space Systems 3 rd Annual Workshop on Flight Software, Nov 5, 2009 The Real-Time Middleware Experts Rajive Joshi, Ph.D. Real-Time Innovations Our goals are the same but not

More information

Distributed Systems. Chapter 1: Introduction

Distributed Systems. Chapter 1: Introduction Distributed Systems (3rd Edition) Chapter 1: Introduction Version: February 25, 2017 2/56 Introduction: What is a distributed system? Distributed System Definition A distributed system is a collection

More information