MOVING BIG DATA MEDICAL IMAGE EHR TO THE CLOUD: AN APPROACH TO DESIGN FAST PERFORMANCE TRANSPORT SOFTWARE USING FASP

Size: px
Start display at page:

Download "MOVING BIG DATA MEDICAL IMAGE EHR TO THE CLOUD: AN APPROACH TO DESIGN FAST PERFORMANCE TRANSPORT SOFTWARE USING FASP"

Transcription

1 IJRETS, ICICSIT 2015 MOVING BIG DATA MEDICAL IMAGE EHR TO THE CLOUD: AN APPROACH TO DESIGN FAST PERFORMANCE Sreekanth R 1, Dr. Gondkar RR 2,Augustin Minalkar3 1 Research Scholar, R&D Center, Bharathiyar University, Coimbatore, TamilNadu, India 2 Professor, Department of MCA, Brindavan College, Bangalore, India 3 HoD, Faculty of Computing, Botho University, Gabarone, Botswana ABSTRACT Cloud computing provides efficient and scalable resources to store, process and access data. Healthcare organizations are moving to store their Electronic Health Records (EHR) onto the cloud as it is an emerging computation model. With the increase in healthcare data collected from various geographical locations and to move such huge big data onto the cloud for efficient processing is a challenging issue. Most of the healthcare data is unstructured and moving this data to cloud for processing requires a fault-tolerant system that can be deployed on low cost hardware. Hadoop distributed file system (HDFS) is fault-tolerant and deployed on low cost hardware. Recently researchers have proposed online algorithms based on costminimizing approach. These algorithms at any point of time aggregate and efficiently process the data by selecting the data center. In this paper we first study the cost-minimizing algorithms online lazy migration (OLM) and randomized fixed horizon control (RHFC) proposed by researchers recently. We then study Fast and secure protocol (FASP) to move big data electronic health records to the cloud. As EHR data is unstructured and large image data like X-ray, scan images, graph images (ECG, Treadmill, Echo) need to be moved to cloud, an efficient fast performance transport software is required which uses FASP considering these parameters Keywords Algorithms, Cloud Computing, EHR, FASP, Hadoop [1] INTRODUCTION Cloud computing guarantee to provide on demand, scalable, pay-as-you-go computation and storage capacity and enabling server resources such as CPU, bandwidth to users with managed clouds. Cloud platforms from Amazon EC2 and S3, Microsoft Azure, Google App Engine, Rackspace, salesforce have demonstrated an advanced way of managing the cloud by the concept of do-it-together. These platforms provide the users a shared pool of servers from various data centers and provide services to all users by virtualization technologies. Dataintensive applications i.e. big data applications are depending on cloud platforms for execution of their applications as cloud is elastic and resource provisioned. The move from paper based medical records to EHR systems has generated big data [1]. Big data provides an opportunity to healthcare experts to take better decisions and minimize costs [2] by providing personalized medical care to patients. As 80% of EHR data is unstructured and these data rely on clouds for analyzing and processing their data sets. Computing framework MapReduce and Hadoop provides framework to process large scale data sets. There are bottlenecks when data to be transferred to cloud especially when it is big data. The cost of transferring the data can add up quickly making the data transfer cost an issue. One of the solution given to avoid the huge data transfer cost is from Amazon web service [3] of its new cloud front service. This can reduce the Sreekanth R, Dr Gondkar RR and Augustin Minalkar 1

2 MOVING BIG DATA MEDICAL IMAGE EHR TO THE CLOUD: AN APPROACH TO DESIGN FAST PERFORMANCE bandwidth of about 1,500Mbit/sec when we intend to transfer 10TB of data [4]. Two online algorithms proposed for the data migration by the researchers is carefully studied. OLM and RFHC algorithm for optimal migration of large data sets of EHR on to the cloud can be discussed. The remaining sections of the paper are organized as follows. Section II discusses the related work carried out, section III discuss about the EHR migration issues on to cloud. Section IV discuss about the solution for data migration to cloud. Section V focus on evaluation and Section VI concluded remarks are made to complete the paper. [2] RELATED WORK Healthcare organizations are showing interest in migrating the various applications and huge EHR data to the cloud platform. There are models developed for migrating health care data to cloud. F. Desprez [5] proposed a cloud brokering algorithm improvement that optimizes the infrastructure deployment cost considering different data storage and transfer policies. Data transfer and storage is taken into account while designing the algorithms. The algorithms were validated on SimGrid Cloud broker (SGCB). They deployed n VMs, v 1,.v n across the m available clouds c 1, c m, using a given number instance types, it 1,.it l. Experiments have concluded that keeping images in every cloud results in higher storage cost but reduction is seen in the final bill. Linquan Zhang [6] proposed two online algorithms for moving the data to the cloud. The OLM algorithm achieves a worst-case competitive ratio of as low as 2.55 under real world settings and not considering future information. The RHFC algorithm provides a decreasing competitive ration with increasing size of the look ahead window. Further an algorithm for moving deferrable big data to cloud is proposed by Linquan Zhang [7]. The algorithm will minimize the traffic cost for uploading the big data to the cloud. [3]MEDICAL IMAGES EHR DATA MIGRATION ISSUE ON TO CLOUD STORAGE In this section we first discuss the issues of migrating medical images to the cloud for storage. As medical images are huge and are usually in size of terabytes the bandwidth will slow down when it is moved to the cloud over the internet. Medical images on cloud are regulated by HIPPA [10] and healthcare organizations have to comply with these requirements. Cloud computing should also adhere to EHR regulations. The traditional WAN based methodology cannot move the terabytes of medical image data to the cloud with the speed as required by the organizations. They just use the high speed bandwidth for minimal time and therefore it is unsuitable for huge volume of data and this causes delays. As cloud computing promises three key advantages such as reducing the risk of upfront investment, pay-as-you-go model help to improve the cash flow, consume the required resources at any point of time [11]. The way how the terabytes of data moved to the cloud is by traditional means of shipping hard disk to the cloud providers, and transfer the data through web using the TCP based transfer methods such as FTP or HTTP. These types of migrating the images to the cloud create issues of loss or damage of the data or engaging number of engineered IT systems. There are two bottlenecks while transferring such huge data to the cloud. One is while transferring the data over WAN; the other is at the cloud data center. For transfer of large data sets to the cloud these two bottlenecks to be addressed [8]. Fig1. Shows moving large medical images to the cloud using WAN. As WAN based transfers are TCP based a single HTTP uses less than 10 Mbps and multiple HTTP uses Mbps [13]. This can slow down the transfer of terabytes of medical image data to the cloud. 2

3 IJRETS, ICICSIT 2015 Transfer from local server to cloud storage can use multiple HTTP connections which again is a bottleneck while moving to a datacenter. Fig 1: Medical image files moving to cloud over WAN with I/O bottlenecks In HDFS the default size of the data chunk is 64MB. If we are trying to upload or download the data through applications which are larger sizes in Terabytes or Petabytes the file requires dividing it into thousands of chunks which is a bottleneck in transfer speed for the WAN. Cloud services need the technology to get the data transported at very high speed mechanism that can solve the issues of data migration to cloud. By optimizing the intra-cloud data transfer and providing consistent speed throughout the data path and medical image files of large data to be transferred at any distance over any network. High-speed software lines can be established which can transfer the image data directly to the cloud providers [8] and without any input and output hurdles. [4] SOLUTION FOR MEDICAL IMAGE DATA MIGRATION DIRECT TO CLOUD STORAGE The solution to transfer the medical image data to the cloud will be based on direct to cloud transport platform to transfer the data files or directories to, from and between cloud storage. The transport technology should be based on fast access and secure protocol so that the large image files can transfer with high speed transfer of files for uploading or downloading from the cloud. The technology used in transferring the image files to the cloud will provide the capabilities to perform the transfer at any distance up to the I/O limits of the platform. It will also support to transfer the image files in a single transfer session in a default size of 64MB chunks of various parts. For eg. Medical image data files up to 0.625TB of data can be transferred per single session on Amazon web services S3 [9]. The technology also provides adaptive bandwidth control to avoid network congestion. Security authentication and access control mechanisms and built in encryptions will help on client and server to control the secured access of files from the cloud storage. Fig2 shows the large medical image data can be transfer to cloud storage with fast and secure protocol which avoids the bottlenecks of input and output. This supports all the major cloud storage platforms. Sreekanth R, Dr Gondkar RR and Augustin Minalkar 3

4 MOVING BIG DATA MEDICAL IMAGE EHR TO THE CLOUD: AN APPROACH TO DESIGN FAST PERFORMANCE Fig 2: Medical image files moving to cloud over WAN which uses a virtual on demand server with FASP [5] EVALUATION The performance of the medical image file transfer can be tested on a single virtual machine with server software with FASP. Various test types conducted on the server for cloud storage with different dimension values and with platform limitations proved that the fast and secure protocol provides the best way to transfer large image files to the cloud without major bottlenecks. Table 1 below shows cloud storage with various test types and dimensions. Various platforms like Google, Microsoft azure, AWS S3 are taken into consideration for the tests. Test Area Cloud storage WAN Test type Dimensions Values Platform limitations Load Test Stress Test Performance test File size 400 GB AWS S3 upto 5TB Google max Session 62 GB Azure max session 1TB Bandwidth 10,100,500 Mbps Azure max bandwidth 400 Mbps Data Sets Large files up to 100 GB Google file size 62 GB File size 0 byte to 400 GB AWS S3 up to 5TB for single session Google max Session 62 GB Azure max session 200GB Bandwidth 500 Mbps 1 Gbps Azure max bandwidth 400 Mbps Data Sets Large files upto 100 GB Google file size 62 GB Bandwidth 512 kbps 10Gbps Packet loss rate Block sizes Operating systems 0%,0.1%,1%,5%,10%,20% 16kb 4MB All major OS Table1: Cloud storage testing [6] CONCLUSION Cloud services can be considered for storing medical image files by the healthcare organizations. As the cloud provides virtual centralization of applications, storage, computing and can be accessed by web applications. Health care industries have enormous opportunities for storing, archiving, sharing and accessing medical images in the cloud. The cloud allows the health care industry to manage the data more efficiently and cost-effectively. In this paper we first discuss on various cost effective algorithms proposed by various researchers to transfer the data to the cloud. The cloud enables to efficiently manage the large set of images with high bandwidth transfer. It can scale the capacity as and when needed. It can manage the authentication encryption and security protocols. Large datasets of image files need to be 4

5 IJRETS, ICICSIT 2015 transferred to cloud storage by avoiding major bottlenecks with regards to input and output. By using WAN and TCP based transfers it is not possible to transfer Terabytes of image data to the cloud. By using fast and secure protocol sessions and virtual on demand servers it is possible to transfer the image files to the cloud by utilizing the maximum bandwidth. REFERENCES [1] D. I. Sessler, Big Data and its contributions to peri operativemedicine, Anaesthesia, vol. 69, no. 2, pp , [2]Sreekanth Rallapalli, RR Gondkar, Augusting Minalkar Improving Healthcare Big data analytics on Electronic Heatlh Records on cloud. Journal of Advances in Information Technology, USA. [3] aws.amazon.com/importexport/productdetails [4] M. Armbrust, A. Fox, R. Grifth, A. D. Joseph, R. Katz, A. Konwinski, G. Lee, D. P. A. Rabkin, I. Stoica, and M. Zaharia, Above the Clouds: A Berkeley View of Cloud Computing, EECS, University of California, Berkeley, Tech. Rep., [5] F. Desprez, J.L Lucas-simarro, R. Moreno-vozmediano, J. Rouzaud-Cornabas, Image transfer and storage cost aware brokering strat. For multiple clouds, project-team avalon, [6] Linquan zhang, chuan wu, Zongpeng li, chuanxiong guo, minghua chen and Francis C.M Lau, Moving Big Data to the cloud: An online cost-minimizing approach IEEE journal on selected areas in communication Vol 31, No 12, December [7] Linquan Zhang, Zongpeng Li, Chuan Wu, Minghua Chen, Online Algorithms for uploading Deferrable Big data to the cloud, IEEE journal in communications, [8] [9]On the state of art in high speed transport direct-to-cloud storage and support by asperasoft. [10] Ermakova, T., Fabian, B., Zarnekow, R., 2013, Security and Privacy System Requirements for Adopting Cloud Computing in Healthcare Data Sharing Scenarios,in Proceedings of the Nineteenth Americas Conference on Information Systems, Chicago, Illinois. [11] Vaquero, L., Rodero-Merino, L., Buyya, B., 2011, Dynamically Scaling Applications in the Cloud, in ACM SIGCOMM Computer Communication Review, Vol 41, Number 1. [12] Sultan, N., 2012, Making use of cloud computing for healthcare provision: Opportunities and challenges, International Journal of Information Management 34(2): pp [13] Kolodner, E. et al., 2011, A Cloud Environment for Dataintensive Storage Services, in 3rd International Conference on Cloud Computing Technology and Science, CloudCom, IEEE, Athens, Greece. [14] Al-Khanjari, Z., Al-Ani, A., Al-He for Establishing Privacy Domains in Systems of E-Health Cloud, in International Journal of Engineering Research andapplications,vol.4,issue7,pp [15] Armbrust, M., Fox, A., Griffith, R., Joseph, A., Katz, R.,Konwinski, A., Lee, G., Patterson, D., Ariel, Rabkin A., Stoica, I., Zaharia, M., April 2010, A View of Cloud Computing, in Communications of the ACM, Vol 53 Issue 4, pp [16] Rajkumar Buyya, Chee Shin Yeo, Srikumar Venugopal, James Broberg, and Ivona Brandic. Cloud computing and emerging IT platforms: Vi-sion, hype, and reality for delivering computing as the 5th utility. Future Generation Computer Systems, 25(6): , Sreekanth R, Dr Gondkar RR and Augustin Minalkar 5

6 MOVING BIG DATA MEDICAL IMAGE EHR TO THE CLOUD: AN APPROACH TO DESIGN FAST PERFORMANCE [17] J.L. Lucas-Simarro, R. Moreno-Vozmediano, R.S. Montero, and I.M. Llorente. Scheduling strategies for optimal service deployment across multiple clouds. Future Generation Computer Systems, in press, [18] B. Wickremasinghe, R.N. Calheiros, and R. Buyya. Cloudanalyst: A cloudsim-based visual modeller for analysing cloud computing environments and applications. 24 th IEEE conference, Author[s] brief Introduction Sreekanth R received his Masters Degree in computer Applications in 2001, and MPhil (Computer Science) in 2006 from Bharathidasan University, India. He is currently pursuing his PhD from Bharathiyar University, India. He has 15 years of work experience in teaching various universities in india and abroad. He has published more than 20 research papers in National and International Journals and conferences. His area of research includes Big Data analytics, Cloud Computing. Dr RR Gondkar received his PhD from Kuvempu University, India. He is currently working as Professor & HoD, Brindavan college Bangalore. He has published more than 40 papers in national and international conferences nd journals. He is Research guide to various universities in india. He is guiding PhD, students in areas of Cloud Computing, Image processing, Datamining. Augustin Minalkar received his MCA degree from From Mysore university in the year He has 11 years of teaching experience. He is currently HoD, FoC, Botho University, Botswana. He has Attended 3 conferences. His area of interest is Data Mining, Data warehouse, Big Data. 6

Secure Token Based Storage System to Preserve the Sensitive Data Using Proxy Re-Encryption Technique

Secure Token Based Storage System to Preserve the Sensitive Data Using Proxy Re-Encryption Technique Available Online at www.ijcsmc.com International Journal of Computer Science and Mobile Computing A Monthly Journal of Computer Science and Information Technology IJCSMC, Vol. 3, Issue. 2, February 2014,

More information

Experimental Model for Load Balancing in Cloud Computing Using Equally Spread Current Execution Load Algorithm

Experimental Model for Load Balancing in Cloud Computing Using Equally Spread Current Execution Load Algorithm Experimental Model for Load Balancing in Cloud Computing Using Equally Spread Current Execution Load Algorithm Ivan Noviandrie Falisha 1, Tito Waluyo Purboyo 2 and Roswan Latuconsina 3 Research Scholar

More information

Privacy Preserving Public Auditing in Secured Cloud Storage Using Block Authentication Code

Privacy Preserving Public Auditing in Secured Cloud Storage Using Block Authentication Code Privacy Preserving Public Auditing in Secured Cloud Storage Using Block Authentication Code Sajeev V 1, Gowthamani R 2 Department of Computer Science, Nehru Institute of Technology, Coimbatore, India 1,

More information

DYNAMIC LOAD BALANCING FOR CLOUD PARTITION IN PUBLIC CLOUD MODEL USING VISTA SCHEDULER ALGORITHM

DYNAMIC LOAD BALANCING FOR CLOUD PARTITION IN PUBLIC CLOUD MODEL USING VISTA SCHEDULER ALGORITHM DYNAMIC LOAD BALANCING FOR CLOUD PARTITION IN PUBLIC CLOUD MODEL USING VISTA SCHEDULER ALGORITHM 1 MANISHANKAR S, 2 SANDHYA R, 3 BHAGYASHREE S 1 Assistant Professor, Department of Computer Science, Amrita

More information

MAPREDUCE FOR BIG DATA PROCESSING BASED ON NETWORK TRAFFIC PERFORMANCE Rajeshwari Adrakatti

MAPREDUCE FOR BIG DATA PROCESSING BASED ON NETWORK TRAFFIC PERFORMANCE Rajeshwari Adrakatti International Journal of Computer Engineering and Applications, ICCSTAR-2016, Special Issue, May.16 MAPREDUCE FOR BIG DATA PROCESSING BASED ON NETWORK TRAFFIC PERFORMANCE Rajeshwari Adrakatti 1 Department

More information

SURVEY PAPER ON CLOUD COMPUTING

SURVEY PAPER ON CLOUD COMPUTING SURVEY PAPER ON CLOUD COMPUTING Kalpana Tiwari 1, Er. Sachin Chaudhary 2, Er. Kumar Shanu 3 1,2,3 Department of Computer Science and Engineering Bhagwant Institute of Technology, Muzaffarnagar, Uttar Pradesh

More information

SIGNIFICANCE OF SOFTWARE RELIABILITY ASSESSMENT IN MULTI CLOUD COMPUTING SYSTEMS A REVIEW

SIGNIFICANCE OF SOFTWARE RELIABILITY ASSESSMENT IN MULTI CLOUD COMPUTING SYSTEMS A REVIEW International Journal of Computer Engineering and Technology (IJCET) Volume 6, Issue 7, July 2015, pp. 35-40, Article ID: 50120150607005 Available online at http://www.iaeme.com/currentissue.asp?jtype=ijcet&vtype=6&itype=7

More information

PROFILING BASED REDUCE MEMORY PROVISIONING FOR IMPROVING THE PERFORMANCE IN HADOOP

PROFILING BASED REDUCE MEMORY PROVISIONING FOR IMPROVING THE PERFORMANCE IN HADOOP ISSN: 0976-2876 (Print) ISSN: 2250-0138 (Online) PROFILING BASED REDUCE MEMORY PROVISIONING FOR IMPROVING THE PERFORMANCE IN HADOOP T. S. NISHA a1 AND K. SATYANARAYAN REDDY b a Department of CSE, Cambridge

More information

Apache Spark and Hadoop Based Big Data Processing System for Clinical Research

Apache Spark and Hadoop Based Big Data Processing System for Clinical Research Apache Spark and Hadoop Based Big Data Processing System for Clinical Research Sreekanth Rallapalli 1,*, Gondkar R R 2 1 Research Scholar, R&D Centre, Bharathiyar University, Coimbatore, Tamilnadu, India.

More information

EXTRACT DATA IN LARGE DATABASE WITH HADOOP

EXTRACT DATA IN LARGE DATABASE WITH HADOOP International Journal of Advances in Engineering & Scientific Research (IJAESR) ISSN: 2349 3607 (Online), ISSN: 2349 4824 (Print) Download Full paper from : http://www.arseam.com/content/volume-1-issue-7-nov-2014-0

More information

A New Approach to Web Data Mining Based on Cloud Computing

A New Approach to Web Data Mining Based on Cloud Computing Regular Paper Journal of Computing Science and Engineering, Vol. 8, No. 4, December 2014, pp. 181-186 A New Approach to Web Data Mining Based on Cloud Computing Wenzheng Zhu* and Changhoon Lee School of

More information

A formal framework for the management of any digital resource in the cloud - Simulation

A formal framework for the management of any digital resource in the cloud - Simulation Mehdi Ahmed-Nacer, Samir Tata and Sami Bhiri (Telecom SudParis) August 15 2015 Updated: August 17, 2015 A formal framework for the management of any digital resource in the cloud - Simulation Abstract

More information

SEGMENT STATURE HASH TABLE BASED COST EFFICIENT DATA SHARING IN CLOUD ENVIRONMENT

SEGMENT STATURE HASH TABLE BASED COST EFFICIENT DATA SHARING IN CLOUD ENVIRONMENT SEGMENT STATURE HASH TABLE BASED COST EFFICIENT DATA SHARING IN CLOUD ENVIRONMENT K. Karthika Lekshmi 1, Dr. M. Vigilsonprem 2 1 Assistant Professor, Department of Information Technology, Cape Institute

More information

Internet Traffic Classification Using Machine Learning. Tanjila Ahmed Dec 6, 2017

Internet Traffic Classification Using Machine Learning. Tanjila Ahmed Dec 6, 2017 Internet Traffic Classification Using Machine Learning Tanjila Ahmed Dec 6, 2017 Agenda 1. Introduction 2. Motivation 3. Methodology 4. Results 5. Conclusion 6. References Motivation Traffic classification

More information

PARALLEL DATA COMPRESSION IN CLINICAL DATA WITH CHUNKING ALGORITHM ON A CLOUD

PARALLEL DATA COMPRESSION IN CLINICAL DATA WITH CHUNKING ALGORITHM ON A CLOUD PARALLEL DATA COMPRESSION IN CLINICAL DATA WITH CHUNKING ALGORITHM ON A CLOUD Ms. R. Hemavathy 1, Mrs. G. Sangeethalakshmi 2, Ms. A. Anitha 3 1 Research Scholar, Dept of Computer Science and Applications,

More information

Huge Data Analysis and Processing Platform based on Hadoop Yuanbin LI1, a, Rong CHEN2

Huge Data Analysis and Processing Platform based on Hadoop Yuanbin LI1, a, Rong CHEN2 2nd International Conference on Materials Science, Machinery and Energy Engineering (MSMEE 2017) Huge Data Analysis and Processing Platform based on Hadoop Yuanbin LI1, a, Rong CHEN2 1 Information Engineering

More information

Experimental Model for Load Balancing in Cloud Computing Using Throttled Algorithm

Experimental Model for Load Balancing in Cloud Computing Using Throttled Algorithm Experimental Model for Load Balancing in Cloud Computing Using Throttled Algorithm Gema Ramadhan 1, Tito Waluyo Purboyo 2, Roswan Latuconsina 3 Research Scholar 1, Lecturer 2,3 1,2,3 Computer Engineering,

More information

Three Levels of Access Control to Personal Health Records in a Healthcare Cloud

Three Levels of Access Control to Personal Health Records in a Healthcare Cloud Three Levels of Access Control to Personal Health Records in a Healthcare Cloud Gabriel Sanchez Bautista and Ning Zhang School of Computer Science The University of Manchester Manchester M13 9PL, United

More information

IBM Aspera Direct-to- Cloud Storage

IBM Aspera Direct-to- Cloud Storage IBM Aspera Direct-to- Cloud Storage A technical whitepaper on the state-of-the art in high-speed transport direct-to-cloud storage and support for third-party cloud storage platforms Contents: 1 Overview

More information

CPSC 426/526. Cloud Computing. Ennan Zhai. Computer Science Department Yale University

CPSC 426/526. Cloud Computing. Ennan Zhai. Computer Science Department Yale University CPSC 426/526 Cloud Computing Ennan Zhai Computer Science Department Yale University Recall: Lec-7 In the lec-7, I talked about: - P2P vs Enterprise control - Firewall - NATs - Software defined network

More information

CSE 124: Networked Services Lecture-16

CSE 124: Networked Services Lecture-16 Fall 2010 CSE 124: Networked Services Lecture-16 Instructor: B. S. Manoj, Ph.D http://cseweb.ucsd.edu/classes/fa10/cse124 11/23/2010 CSE 124 Networked Services Fall 2010 1 Updates PlanetLab experiments

More information

Twitter data Analytics using Distributed Computing

Twitter data Analytics using Distributed Computing Twitter data Analytics using Distributed Computing Uma Narayanan Athrira Unnikrishnan Dr. Varghese Paul Dr. Shelbi Joseph Research Scholar M.tech Student Professor Assistant Professor Dept. of IT, SOE

More information

Load Balancing in Cloud Computing System

Load Balancing in Cloud Computing System Rashmi Sharma and Abhishek Kumar Department of CSE, ABES Engineering College, Ghaziabad, Uttar Pradesh, India E-mail: abhishek221196@gmail.com (Received on 10 August 2012 and accepted on 15 October 2012)

More information

ABSTRACT I. INTRODUCTION

ABSTRACT I. INTRODUCTION International Journal of Scientific Research in Computer Science, Engineering and Information Technology 2018 IJSRCSEIT Volume 3 Issue 3 ISS: 2456-3307 Hadoop Periodic Jobs Using Data Blocks to Achieve

More information

ADAPTIVE HANDLING OF 3V S OF BIG DATA TO IMPROVE EFFICIENCY USING HETEROGENEOUS CLUSTERS

ADAPTIVE HANDLING OF 3V S OF BIG DATA TO IMPROVE EFFICIENCY USING HETEROGENEOUS CLUSTERS INTERNATIONAL JOURNAL OF RESEARCH IN COMPUTER APPLICATIONS AND ROBOTICS ISSN 2320-7345 ADAPTIVE HANDLING OF 3V S OF BIG DATA TO IMPROVE EFFICIENCY USING HETEROGENEOUS CLUSTERS Radhakrishnan R 1, Karthik

More information

The Community Library Anniance Based on Cloud Computing

The Community Library Anniance Based on Cloud Computing Available online at www.sciencedirect.com Procedia Engineering 29 (2012) 2804 2808 2012 International Workshop on Information and Electronics Engineering (IWIEE) The Community Library Anniance Based on

More information

Simulation of Cloud Computing Environments with CloudSim

Simulation of Cloud Computing Environments with CloudSim Simulation of Cloud Computing Environments with CloudSim Print ISSN: 1312-2622; Online ISSN: 2367-5357 DOI: 10.1515/itc-2016-0001 Key Words: Cloud computing; datacenter; simulation; resource management.

More information

CES: A FRAMEWORK FOR EFFICIENT INFRASTRUCTURE UTILIZATION THROUGH CLOUD ELASTICITY AS A SERVICE (CES)

CES: A FRAMEWORK FOR EFFICIENT INFRASTRUCTURE UTILIZATION THROUGH CLOUD ELASTICITY AS A SERVICE (CES) International Journal of Computer Engineering & Technology (IJCET) Volume 6, Issue 8, Aug 2015, pp. 24-30, Article ID: IJCET_06_08_004 Available online at http://www.iaeme.com/ijcet/issues.asp?jtypeijcet&vtype=6&itype=8

More information

Global Journal of Engineering Science and Research Management

Global Journal of Engineering Science and Research Management A FUNDAMENTAL CONCEPT OF MAPREDUCE WITH MASSIVE FILES DATASET IN BIG DATA USING HADOOP PSEUDO-DISTRIBUTION MODE K. Srikanth*, P. Venkateswarlu, Ashok Suragala * Department of Information Technology, JNTUK-UCEV

More information

Aspera Direct-to-Cloud Storage WHITE PAPER

Aspera Direct-to-Cloud Storage WHITE PAPER Transport Direct-to-Cloud Storage and Support for Third Party June 2017 WHITE PAPER TABLE OF CONTENTS OVERVIEW 3 1 - THE PROBLEM 3 2 - A FUNDAMENTAL SOLUTION - ASPERA DIRECT-TO-CLOUD TRANSPORT 5 3 - T

More information

QoS-Aware Virtual Machine Scheduling for Video Streaming Services in Multi-Cloud

QoS-Aware Virtual Machine Scheduling for Video Streaming Services in Multi-Cloud TSINGHUA SCIENCE AND TECHNOLOGY ISSNll1007-0214ll10/11llpp308-317 Volume 18, Number 3, June 2013 QoS-Aware Virtual Machine Scheduling for Video Streaming Services in Multi-Cloud Wei Chen, Junwei Cao, and

More information

Available online at ScienceDirect. Procedia Computer Science 93 (2016 )

Available online at   ScienceDirect. Procedia Computer Science 93 (2016 ) Available online at www.sciencedirect.com ScienceDirect Procedia Computer Science 93 (2016 ) 269 275 6th International Conference On Advances In Computing & Communications, ICACC 2016, 6-8 September 2016,

More information

CLIENT DATA NODE NAME NODE

CLIENT DATA NODE NAME NODE Volume 6, Issue 12, December 2016 ISSN: 2277 128X International Journal of Advanced Research in Computer Science and Software Engineering Research Paper Available online at: www.ijarcsse.com Efficiency

More information

Efficient Task Scheduling Algorithms for Cloud Computing Environment

Efficient Task Scheduling Algorithms for Cloud Computing Environment Efficient Task Scheduling Algorithms for Cloud Computing Environment S. Sindhu 1 and Saswati Mukherjee 2 1 Research Scholar, Department of Information Science and Technology sindhu.nss@gmail.com 2 Professor

More information

Dynamic Task Scheduling in Cloud Computing Based on the Availability Level of Resources

Dynamic Task Scheduling in Cloud Computing Based on the Availability Level of Resources Vol. 1, No. 8 (217), pp.21-36 http://dx.doi.org/1.14257/ijgdc.217.1.8.3 Dynamic Task Scheduling in Cloud Computing Based on the Availability Level of Resources Elhossiny Ibrahim 1, Nirmeen A. El-Bahnasawy

More information

OPENSTACK PRIVATE CLOUD WITH GITHUB

OPENSTACK PRIVATE CLOUD WITH GITHUB OPENSTACK PRIVATE CLOUD WITH GITHUB Kiran Gurbani 1 Abstract Today, with rapid growth of the cloud computing technology, enterprises and organizations need to build their private cloud for their own specific

More information

IBM Aspera Direct-to-Cloud Storage

IBM Aspera Direct-to-Cloud Storage IBM Aspera Direct-to-Cloud Storage A on the State-of-the Art in High Speed Transport Direct-to-Cloud Storage and Support for Third Party Cloud Storage Platforms Contents: 1 Overview 2 The problem 3 A fundamental

More information

FTCloudSim: support for cloud service reliability enhancement simulation

FTCloudSim: support for cloud service reliability enhancement simulation Int. J. Web and Grid Services, Vol. 11, No. 4, 2015 347 FTCloudSim: support for cloud service reliability enhancement simulation Ao Zhou, Shangguang Wang*, Chenchen Yang, Lei Sun, Qibo Sun and Fangchun

More information

Welcome to the. Migrating SQL Server Databases to Azure

Welcome to the. Migrating SQL Server Databases to Azure Welcome to the 1 Migrating SQL Server Databases to Azure Migrating SQL Server Databases to Azure Agenda Overview of SQL Server in Microsoft Azure Getting started with SQL Server in an Azure virtual machine

More information

Co-operative Scheduled Energy Aware Load-Balancing technique for an Efficient Computational Cloud

Co-operative Scheduled Energy Aware Load-Balancing technique for an Efficient Computational Cloud 571 Co-operative Scheduled Energy Aware Load-Balancing technique for an Efficient Computational Cloud T.R.V. Anandharajan 1, Dr. M.A. Bhagyaveni 2 1 Research Scholar, Department of Electronics and Communication,

More information

A COMPARISON STUDY OF VARIOUS VIRTUAL MACHINE CONSOLIDATION ALGORITHMS IN CLOUD DATACENTER

A COMPARISON STUDY OF VARIOUS VIRTUAL MACHINE CONSOLIDATION ALGORITHMS IN CLOUD DATACENTER A COMPARISON STUDY OF VARIOUS VIRTUAL MACHINE CONSOLIDATION ALGORITHMS IN CLOUD DATACENTER Arockia Ranjini A. and Arun Sahayadhas Department of Computer Science and Engineering, Vels University, Chennai,

More information

2010 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media,

2010 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, 2010 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising

More information

A Comparative Performance Analysis of Load Balancing Policies in Cloud Computing Using Cloud Analyst

A Comparative Performance Analysis of Load Balancing Policies in Cloud Computing Using Cloud Analyst A Comparative Performance Analysis of Load Balancing Policies in Cloud Computing Using Cloud Analyst Saurabh Shukla 1, Dr. Deepak Arora 2 P.G. Student, Department of Computer Science & Engineering, Amity

More information

A Robust Cloud-based Service Architecture for Multimedia Streaming Using Hadoop

A Robust Cloud-based Service Architecture for Multimedia Streaming Using Hadoop A Robust Cloud-based Service Architecture for Multimedia Streaming Using Hadoop Myoungjin Kim 1, Seungho Han 1, Jongjin Jung 3, Hanku Lee 1,2,*, Okkyung Choi 2 1 Department of Internet and Multimedia Engineering,

More information

Introduction To Cloud Computing

Introduction To Cloud Computing Introduction To Cloud Computing What is Cloud Computing? Cloud computing is a model for enabling ubiquitous, convenient, on-demand network access to a shared pool of configurable computing resources (e.g.,

More information

Embedded Technosolutions

Embedded Technosolutions Hadoop Big Data An Important technology in IT Sector Hadoop - Big Data Oerie 90% of the worlds data was generated in the last few years. Due to the advent of new technologies, devices, and communication

More information

Brasilia s Database Administrators

Brasilia s Database Administrators ISSN: 2468-4376 eissn: 2468-4376 Brasilia s Database Administrators Jane Adriana* and Maristela Holanda* University of Brasilia, BRAZIL *Correspondence to: Janeadriana88@gmail.com, mholanda@unb.br ABSTRACT

More information

High Performance Computing on MapReduce Programming Framework

High Performance Computing on MapReduce Programming Framework International Journal of Private Cloud Computing Environment and Management Vol. 2, No. 1, (2015), pp. 27-32 http://dx.doi.org/10.21742/ijpccem.2015.2.1.04 High Performance Computing on MapReduce Programming

More information

Scaling Internet TV Content Delivery ALEX GUTARIN DIRECTOR OF ENGINEERING, NETFLIX

Scaling Internet TV Content Delivery ALEX GUTARIN DIRECTOR OF ENGINEERING, NETFLIX Scaling Internet TV Content Delivery ALEX GUTARIN DIRECTOR OF ENGINEERING, NETFLIX Inventing Internet TV Available in more than 190 countries 104+ million subscribers Lots of Streaming == Lots of Traffic

More information

Cross-Site Virtual Network Provisioning in Cloud and Fog Computing

Cross-Site Virtual Network Provisioning in Cloud and Fog Computing This paper was accepted for publication in the IEEE Cloud Computing. The copyright was transferred to IEEE. The final version of the paper will be made available on IEEE Xplore via http://dx.doi.org/10.1109/mcc.2017.28

More information

CSE 124: Networked Services Fall 2009 Lecture-19

CSE 124: Networked Services Fall 2009 Lecture-19 CSE 124: Networked Services Fall 2009 Lecture-19 Instructor: B. S. Manoj, Ph.D http://cseweb.ucsd.edu/classes/fa09/cse124 Some of these slides are adapted from various sources/individuals including but

More information

QOS BASED SCHEDULING OF WORKFLOWS IN CLOUD COMPUTING UPNP ARCHITECTURE

QOS BASED SCHEDULING OF WORKFLOWS IN CLOUD COMPUTING UPNP ARCHITECTURE QOS BASED SCHEDULING OF WORKFLOWS IN CLOUD COMPUTING UPNP ARCHITECTURE 1 K. Ramkumar, 2 Dr.G.Gunasekaran 1Research Scholar, Computer Science and Engineering Manonmaniam Sundaranar University Tirunelveli

More information

International Journal of Modern Trends in Engineering and Research e-issn No.: , Date: 2-4 July, 2015

International Journal of Modern Trends in Engineering and Research   e-issn No.: , Date: 2-4 July, 2015 International Journal of Modern Trends in Engineering and Research www.ijmter.com e-issn No.:2349-9745, Date: 2-4 July, 215 Provisioning Rapid Elasticity by Light-Weight Live Resource Migration S. Kirthica

More information

Double Threshold Based Load Balancing Approach by Using VM Migration for the Cloud Computing Environment

Double Threshold Based Load Balancing Approach by Using VM Migration for the Cloud Computing Environment www.ijecs.in International Journal Of Engineering And Computer Science ISSN:2319-7242 Volume 4 Issue 1 January 2015, Page No. 9966-9970 Double Threshold Based Load Balancing Approach by Using VM Migration

More information

Distributed System Framework for Mobile Cloud Computing

Distributed System Framework for Mobile Cloud Computing Bonfring International Journal of Research in Communication Engineering, Vol. 8, No. 1, February 2018 5 Distributed System Framework for Mobile Cloud Computing K. Arul Jothy, K. Sivakumar and M.J. Delsey

More information

Eucalyptus LSS: Load-Based Scheduling on Virtual Servers Using Eucalyptus Private Cloud

Eucalyptus LSS: Load-Based Scheduling on Virtual Servers Using Eucalyptus Private Cloud 2ND INTERNATIONAL WORKSHOP ON COLLABORATION BETWEEN FEU AND UPLB 1 Eucalyptus LSS: Load-Based Scheduling on Virtual Servers Using Eucalyptus Private Cloud Shenlene A. Cabigting and Joseph Anthony C. Hermocilla

More information

Association of Cloud Computing in IOT

Association of Cloud Computing in IOT , pp.60-65 http://dx.doi.org/10.14257/astl.2017.147.08 Association of Cloud Computing in IOT K.Asish Vardhan 1, Eswar Patnala 2 and Rednam S S Jyothi 3 2,3 Assistant Professor, Dept. of Information Technology,

More information

Computing Environments

Computing Environments Brokering Techniques for Managing ThreeTier Applications in Distributed Cloud Computing Environments Nikolay Grozev Supervisor: Prof. Rajkumar Buyya 7th October 2015 PhD Completion Seminar 1 2 3 Cloud

More information

Scalability Performance Evaluation of the E-Ambulance Software Service

Scalability Performance Evaluation of the E-Ambulance Software Service Scalability Performance Evaluation of the E-Ambulance Software Service Dejan Stamenov, Dimitar Venov, Marjan Gusev Faculty of Computer Science and Engineering Ss. Cyril and Methodius University Skopje,

More information

PLATFORM AND SOFTWARE AS A SERVICE THE MAPREDUCE PROGRAMMING MODEL AND IMPLEMENTATIONS

PLATFORM AND SOFTWARE AS A SERVICE THE MAPREDUCE PROGRAMMING MODEL AND IMPLEMENTATIONS PLATFORM AND SOFTWARE AS A SERVICE THE MAPREDUCE PROGRAMMING MODEL AND IMPLEMENTATIONS By HAI JIN, SHADI IBRAHIM, LI QI, HAIJUN CAO, SONG WU and XUANHUA SHI Prepared by: Dr. Faramarz Safi Islamic Azad

More information

Cloud Computing and the Cloud Simulation

Cloud Computing and the Cloud Simulation Cloud Computing and the Cloud Simulation Kritika Sharma 1, Raman Maini 2 1 M.Tech Student, Department Of Computer Engineering, Punjabi University, Patiala, Punjab (India) 2 Professor, Department Of Computer

More information

International Journal of Advanced Research in Computer Science and Software Engineering

International Journal of Advanced Research in Computer Science and Software Engineering Volume 2, Issue 9, September 2012 ISSN: 2277 128X International Journal of Advanced Research in Computer Science and Software Engineering Research Paper Available online at: www.ijarcsse.com A Comprehensive

More information

SoftNAS Cloud Performance Evaluation on AWS

SoftNAS Cloud Performance Evaluation on AWS SoftNAS Cloud Performance Evaluation on AWS October 25, 2016 Contents SoftNAS Cloud Overview... 3 Introduction... 3 Executive Summary... 4 Key Findings for AWS:... 5 Test Methodology... 6 Performance Summary

More information

Establishing a Service Model of Private Elastic VPN for cloud computing

Establishing a Service Model of Private Elastic VPN for cloud computing Volume 1, Issue 4, August 2012 www.ijcsn.org ISSN 2277-5420 Establishing a Service Model of Private Elastic VPN for cloud computing 1 Priyanka Gupta, 2 Ashok Verma Page 22 1 Computer Science, RGPV, GGITS

More information

Virtual Appliance Applications. Yao-Min Chen

Virtual Appliance Applications. Yao-Min Chen Virtual Appliance Applications Yao-Min Chen Outline Introduction to Case Study 1: License Server Virtual Appliance Case Study 2: Distributed Virtual Switch (DVS) Controller Virtual Appliance Intrusion

More information

DEEP DIVE INTO CLOUD COMPUTING

DEEP DIVE INTO CLOUD COMPUTING International Journal of Research in Engineering, Technology and Science, Volume VI, Special Issue, July 2016 www.ijrets.com, editor@ijrets.com, ISSN 2454-1915 DEEP DIVE INTO CLOUD COMPUTING Ranvir Gorai

More information

CSE6331: Cloud Computing

CSE6331: Cloud Computing CSE6331: Cloud Computing Leonidas Fegaras University of Texas at Arlington c 2019 by Leonidas Fegaras Cloud Computing Fundamentals Based on: J. Freire s class notes on Big Data http://vgc.poly.edu/~juliana/courses/bigdata2016/

More information

INFS 214: Introduction to Computing

INFS 214: Introduction to Computing INFS 214: Introduction to Computing Session 13 Cloud Computing Lecturer: Dr. Ebenezer Ankrah, Dept. of Information Studies Contact Information: eankrah@ug.edu.gh College of Education School of Continuing

More information

Efficient Load Balancing and Disk Failure Avoidance Approach Using Restful Web Services

Efficient Load Balancing and Disk Failure Avoidance Approach Using Restful Web Services Efficient Load Balancing and Disk Failure Avoidance Approach Using Restful Web Services Neha Shiraz, Dr. Parikshit N. Mahalle Persuing M.E, Department of Computer Engineering, Smt. Kashibai Navale College

More information

RCD: Rapid Close to Deadline Scheduling for Datacenter Networks

RCD: Rapid Close to Deadline Scheduling for Datacenter Networks RCD: Rapid Close to Deadline Scheduling for Datacenter Networks Mohammad Noormohammadpour 1, Cauligi S. Raghavendra 1, Sriram Rao 2, Asad M. Madni 3 1 Ming Hsieh Department of Electrical Engineering, University

More information

Survey on MapReduce Scheduling Algorithms

Survey on MapReduce Scheduling Algorithms Survey on MapReduce Scheduling Algorithms Liya Thomas, Mtech Student, Department of CSE, SCTCE,TVM Syama R, Assistant Professor Department of CSE, SCTCE,TVM ABSTRACT MapReduce is a programming model used

More information

QADR with Energy Consumption for DIA in Cloud

QADR with Energy Consumption for DIA in Cloud Available Online at www.ijcsmc.com International Journal of Computer Science and Mobile Computing A Monthly Journal of Computer Science and Information Technology IJCSMC, Vol. 3, Issue. 4, April 2014,

More information

A New HadoopBased Network Management System with Policy Approach

A New HadoopBased Network Management System with Policy Approach Computer Engineering and Applications Vol. 3, No. 3, September 2014 A New HadoopBased Network Management System with Policy Approach Department of Computer Engineering and IT, Shiraz University of Technology,

More information

EFFICIENT ALLOCATION OF DYNAMIC RESOURCES IN A CLOUD

EFFICIENT ALLOCATION OF DYNAMIC RESOURCES IN A CLOUD EFFICIENT ALLOCATION OF DYNAMIC RESOURCES IN A CLOUD S.THIRUNAVUKKARASU 1, DR.K.P.KALIYAMURTHIE 2 Assistant Professor, Dept of IT, Bharath University, Chennai-73 1 Professor& Head, Dept of IT, Bharath

More information

Technical Specifications. Desktop Application

Technical Specifications. Desktop Application Technical Specifications Desktop Application Table of contents Software and hardware requirements 3 Supported virtualized environments 4 Nuance virtual extensions 5 Server runtime requirements 6 Network

More information

Global Journal of Engineering Science and Research Management

Global Journal of Engineering Science and Research Management ENHANCED MULTI OBJECTIVE TASK SCHEDULING FOR CLOUD ENVIRONMENT USING TASK GROUPING Mohana. R. S *, Thangaraj. P, Kalaiselvi. S, Krishnakumar. B * Assistant Professor (SRG), Department of Computer Science,

More information

Data Deduplication using Even or Odd Block (EOB) Checking Algorithm in Hybrid Cloud

Data Deduplication using Even or Odd Block (EOB) Checking Algorithm in Hybrid Cloud Data Deduplication using Even or Odd Block (EOB) Checking Algorithm in Hybrid Cloud Suganthi.M 1, Hemalatha.B 2 Research Scholar, Depart. Of Computer Science, Chikkanna Government Arts College, Tamilnadu,

More information

Analysis of Extended Performance for clustering of Satellite Images Using Bigdata Platform Spark

Analysis of Extended Performance for clustering of Satellite Images Using Bigdata Platform Spark Analysis of Extended Performance for clustering of Satellite Images Using Bigdata Platform Spark PL.Marichamy 1, M.Phil Research Scholar, Department of Computer Application, Alagappa University, Karaikudi,

More information

Azure MapReduce. Thilina Gunarathne Salsa group, Indiana University

Azure MapReduce. Thilina Gunarathne Salsa group, Indiana University Azure MapReduce Thilina Gunarathne Salsa group, Indiana University Agenda Recap of Azure Cloud Services Recap of MapReduce Azure MapReduce Architecture Application development using AzureMR Pairwise distance

More information

Scrutinize : Fault Monitoring for Preventing System Failure in Cloud Computing

Scrutinize : Fault Monitoring for Preventing System Failure in Cloud Computing Scrutinize : Fault Monitoring for Preventing System Failure in Cloud Computing Anu Computer Science Department, Thapar University, Patiala, India Anju Bala Computer Science Department, Thapar University,

More information

Introduction to Cloud Computing and Virtual Resource Management. Jian Tang Syracuse University

Introduction to Cloud Computing and Virtual Resource Management. Jian Tang Syracuse University Introduction to Cloud Computing and Virtual Resource Management Jian Tang Syracuse University 1 Outline Definition Components Why Cloud Computing Cloud Services IaaS Cloud Providers Overview of Virtual

More information

Cloud Computing and Hadoop Distributed File System. UCSB CS170, Spring 2018

Cloud Computing and Hadoop Distributed File System. UCSB CS170, Spring 2018 Cloud Computing and Hadoop Distributed File System UCSB CS70, Spring 08 Cluster Computing Motivations Large-scale data processing on clusters Scan 000 TB on node @ 00 MB/s = days Scan on 000-node cluster

More information

Cloud & container monitoring , Lars Michelsen Check_MK Conference #4

Cloud & container monitoring , Lars Michelsen Check_MK Conference #4 Cloud & container monitoring 04.05.2018, Lars Michelsen Some cloud definitions Applications Data Runtime Middleware O/S Virtualization Servers Storage Networking Software-as-a-Service (SaaS) Applications

More information

ENERGY EFFICIENT VIRTUAL MACHINE INTEGRATION IN CLOUD COMPUTING

ENERGY EFFICIENT VIRTUAL MACHINE INTEGRATION IN CLOUD COMPUTING ENERGY EFFICIENT VIRTUAL MACHINE INTEGRATION IN CLOUD COMPUTING Mrs. Shweta Agarwal Assistant Professor, Dept. of MCA St. Aloysius Institute of Technology, Jabalpur(India) ABSTRACT In the present study,

More information

Implementation of Decentralized Access Control with Anonymous Authentication in Cloud

Implementation of Decentralized Access Control with Anonymous Authentication in Cloud Volume-5, Issue-6, December-2015 International Journal of Engineering and Management Research Page Number: 210-214 Implementation of Decentralized Access Control with Anonymous Authentication in Cloud

More information

Decentralized Grid Management Model Based on Broker Overlay

Decentralized Grid Management Model Based on Broker Overlay Decentralized Grid Management Model Based on Broker Overlay Abdulrahman Azab 1, Hein Meling 1 1 Dept. of Computer Science and Electrical Engineering, Faculty of Science and Technology, University of Stavanger,

More information

A Comparative Study of Amazon Web Service and Windows Azure

A Comparative Study of Amazon Web Service and Windows Azure A Comparative Study of Amazon Web Service and Windows Azure Rajeev BV 1, Vinod Baliga 2, Arun kumar 3 Abstract This paper compares features of two major cloud vendors Amazon Web Services (AWS) and Microsoft

More information

Seminar Map/Reduce Prof. Johann-Christoph Freytag, Ph. D. Rico Bergmann

Seminar Map/Reduce Prof. Johann-Christoph Freytag, Ph. D. Rico Bergmann Seminar Map/ 20.10.2010 Prof. Johann-Christoph Freytag, Ph. D. Rico Bergmann contact Prof. Johann-Christoph Freytag Ph.D. Prof. at chair in Databases and Information Systems (DBIS) RUD25 Rico Bergmann

More information

A Network-aware Scheduler in Data-parallel Clusters for High Performance

A Network-aware Scheduler in Data-parallel Clusters for High Performance A Network-aware Scheduler in Data-parallel Clusters for High Performance Zhuozhao Li, Haiying Shen and Ankur Sarker Department of Computer Science University of Virginia May, 2018 1/61 Data-parallel clusters

More information

Ultra high-speed transmission technology for wide area data movement

Ultra high-speed transmission technology for wide area data movement Ultra high-speed transmission technology for wide area data movement Michelle Munson, president & co-founder Aspera Outline Business motivation Moving ever larger file sets over commodity IP networks (public,

More information

Survey Paper on Traditional Hadoop and Pipelined Map Reduce

Survey Paper on Traditional Hadoop and Pipelined Map Reduce International Journal of Computational Engineering Research Vol, 03 Issue, 12 Survey Paper on Traditional Hadoop and Pipelined Map Reduce Dhole Poonam B 1, Gunjal Baisa L 2 1 M.E.ComputerAVCOE, Sangamner,

More information

Emperical Resource Allocation Using Dynamic Distributed Allocation Policy in Cloud Computing

Emperical Resource Allocation Using Dynamic Distributed Allocation Policy in Cloud Computing Emperical Resource Allocation Using Dynamic Distributed Allocation Policy in Cloud Computing Sasmita Parida, Suvendu Chandan Nayak Department of Computer Science & Engineering C.V.Raman college of Engineering,

More information

TRANSFORMING CLOUD INFRASTRUCTURE TO SUPPORT BIG DATA STORAGE AND WORKFLOWS

TRANSFORMING CLOUD INFRASTRUCTURE TO SUPPORT BIG DATA STORAGE AND WORKFLOWS TRANSFORMING CLOUD INFRASTRUCTURE TO SUPPORT BIG DATA STORAGE AND WORKFLOWS PRESENTER AND AGENDA PRESENTER Jay Migliaccio Director Cloud platforms and Services jay@asperasoft.com AGENDA Aspera Intro Big

More information

The Design and Implementation of Disaster Recovery in Dual-active Cloud Center

The Design and Implementation of Disaster Recovery in Dual-active Cloud Center International Conference on Information Sciences, Machinery, Materials and Energy (ICISMME 2015) The Design and Implementation of Disaster Recovery in Dual-active Cloud Center Xiao Chen 1, a, Longjun Zhang

More information

A Methodology to Detect Most Effective Compression Technique Based on Time Complexity Cloud Migration for High Image Data Load

A Methodology to Detect Most Effective Compression Technique Based on Time Complexity Cloud Migration for High Image Data Load AUSTRALIAN JOURNAL OF BASIC AND APPLIED SCIENCES ISSN:1991-8178 EISSN: 2309-8414 Journal home page: www.ajbasweb.com A Methodology to Detect Most Effective Compression Technique Based on Time Complexity

More information

Data Analysis Using MapReduce in Hadoop Environment

Data Analysis Using MapReduce in Hadoop Environment Data Analysis Using MapReduce in Hadoop Environment Muhammad Khairul Rijal Muhammad*, Saiful Adli Ismail, Mohd Nazri Kama, Othman Mohd Yusop, Azri Azmi Advanced Informatics School (UTM AIS), Universiti

More information

TOOLS FOR INTEGRATING BIG DATA IN CLOUD COMPUTING: A STATE OF ART SURVEY

TOOLS FOR INTEGRATING BIG DATA IN CLOUD COMPUTING: A STATE OF ART SURVEY Journal of Analysis and Computation (JAC) (An International Peer Reviewed Journal), www.ijaconline.com, ISSN 0973-2861 International Conference on Emerging Trends in IOT & Machine Learning, 2018 TOOLS

More information

Dell Technologies IoT Solution Surveillance with Genetec Security Center

Dell Technologies IoT Solution Surveillance with Genetec Security Center Dell Technologies IoT Solution Surveillance with Genetec Security Center Surveillance December 2018 H17436 Sizing Guide Abstract The purpose of this guide is to help you understand the benefits of using

More information

Cloud Computing. Ennan Zhai. Computer Science at Yale University

Cloud Computing. Ennan Zhai. Computer Science at Yale University Cloud Computing Ennan Zhai Computer Science at Yale University ennan.zhai@yale.edu About Final Project About Final Project Important dates before demo session: - Oct 31: Proposal v1.0 - Nov 7: Source code

More information

CloudFTP: A Case Study of Migrating Traditional Applications to the Cloud

CloudFTP: A Case Study of Migrating Traditional Applications to the Cloud 2013 Third International Conference on Intelligent System Design and Engineering Applications CloudFTP: A Case Study of Migrating Traditional Applications to the Cloud Liang Zhou School of Software, Shanghai

More information