Research on the High Robustness JavaEE Enterprise Development Mode Based on Hadoop and Cloud Servers

Similar documents
Construction of SSI Framework Based on MVC Software Design Model Yongchang Rena, Yongzhe Mab

Research on software development platform based on SSH framework structure

Development of E-Institute Management System Based on Integrated SSH Framework

New research on Key Technologies of unstructured data cloud storage

Software Design COSC 4353/6353 DR. RAJ SINGH

Research and Design of Education and Teaching Resource Management System based on ASP.NET Technology

Construction Scheme for Cloud Platform of NSFC Information System

The Establishment of Large Data Mining Platform Based on Cloud Computing. Wei CAI

purequery Deep Dive Part 2: Data Access Development Dan Galvin Galvin Consulting, Inc.

Solace JMS Broker Delivers Highest Throughput for Persistent and Non-Persistent Delivery

A Study on Load Balancing Techniques for Task Allocation in Big Data Processing* Jin Xiaohong1,a, Li Hui1, b, Liu Yanjun1, c, Fan Yanfang1, d

SUN Sun Certified Enterprise Architect for J2EE 5. Download Full Version :

Introduction. Key Features and Benefits

An Indian Journal FULL PAPER ABSTRACT KEYWORDS. Trade Science Inc. The study on magnanimous data-storage system based on cloud computing

Chapter 1 GETTING STARTED. SYS-ED/ Computer Education Techniques, Inc.

Research on the Application of Bank Transaction Data Stream Storage based on HBase Xiaoguo Wang*, Yuxiang Liu and Lin Zhang

Migrating traditional Java EE applications to mobile

The power quality intelligent monitoring system based on cloud computing Jie Bai 1a, Changpo Song 2b

Java Spring Hibernate Interview Questions And Answers For

THIS IS ONLY SAMPLE RESUME - DO NOT COPY AND PASTE INTO YOUR RESUME. WE ARE NOT RESPONSIBLE Name: xxxxxx

. METHODOLOGY. MVC Based E-commerce Design. Literature Review based On Model View Controller MVC with J2EE. Public Cloud Implementation for E-commerce

Java EE Application Assembly & Deployment Packaging Applications, Java EE modules. Model View Controller (MVC)2 Architecture & Packaging EJB Module

1Z Oracle. Java Enterprise Edition 5 Enterprise Architect Certified Master

Department of Computer Science San Marcos, TX Report Number TXSTATE-CS-TR Clustering in the Cloud. Xuan Wang

Apache Spark is a fast and general-purpose engine for large-scale data processing Spark aims at achieving the following goals in the Big data context

Appendix A - Glossary(of OO software term s)

X-S Framework Leveraging XML on Servlet Technology

Data Interface Design for Java-Based Mysql Database

What is it? What does it do?

"Charting the Course... Certified Information Systems Auditor (CISA) Course Summary

Design and Implementation of High-Speed Real-Time Data Acquisition and Processing System based on FPGA

Design on Office Automation System based on Domino/Notes Lijun Wang1,a, Jiahui Wang2,b

COURSE DETAILS: CORE AND ADVANCE JAVA Core Java

WSO2 Platform Offerings for Developers

Oracle Fusion Middleware 11g: Build Applications with ADF I

A Decision Support System Based on SSH and DWR for the Retail Industry

Embedded Technosolutions

Java Spring Hibernate Interview Questions And Answers For

Design and Implementation of Inspection System for Lift Based on Android Platform Yan Zhang1, a, Yanping Hu2,b

Construction and Application of Cloud Data Center in University

Research and Application of Mobile Geographic Information Service Technology Based on JSP Chengtong GUO1, a, Yan YAO1,b

Spring & Hibernate. Knowledge of database. And basic Knowledge of web application development. Module 1: Spring Basics

~ Ian Hunneybell: CBSD Revision Notes (07/06/2006) ~

Design and Implementation of the Omni Media Content Production and Service Platform

Etanova Enterprise Solutions

ABSTRACT I. INTRODUCTION

Cloud Computing CS

Services Management Model Based on the SOA

JAVA Training Overview (For Demo Classes Call Us )

2005, Cornell University

Not just an App. Server

HiTune. Dataflow-Based Performance Analysis for Big Data Cloud

Enterprise Java Development using JPA, Hibernate and Spring. Srini Penchikala Detroit JUG Developer Day Conference November 14, 2009

PLATFORM AND SOFTWARE AS A SERVICE THE MAPREDUCE PROGRAMMING MODEL AND IMPLEMENTATIONS

CMP 436/774. Introduction to Java Enterprise Edition. Java Enterprise Edition

BioTechnology. An Indian Journal FULL PAPER. Trade Science Inc. Study on secure data storage based on cloud computing ABSTRACT KEYWORDS

PaaS Cloud mit Java. Eberhard Wolff, Principal Technologist, SpringSource A division of VMware VMware Inc. All rights reserved

Open Access Apriori Algorithm Research Based on Map-Reduce in Cloud Computing Environments

Inside GigaSpaces XAP Technical Overview and Value Proposition

Remote Health Service System based on Struts2 and Hibernate

TOPLink for WebLogic. Whitepaper. The Challenge: The Solution:

Enterprise Java Unit 1-Chapter 2 Prof. Sujata Rizal Java EE 6 Architecture, Server and Containers

Design of Physical Education Management System Guoquan Zhang

JAVA COURSES. Empowering Innovation. DN InfoTech Pvt. Ltd. H-151, Sector 63, Noida, UP

Market leading web application server product

Introduction. Enterprise Java Instructor: Please introduce yourself Name Experience in Java Enterprise Edition Goals you hope to achieve

Design on Students Score Management System based on Asp.net Zhe Li1,a, Jiahui Wang2,b, Shuang Wei3,c

2/26/2017. Originally developed at the University of California - Berkeley's AMPLab

Hadoop. copyright 2011 Trainologic LTD

Dynamic Data Placement Strategy in MapReduce-styled Data Processing Platform Hua-Ci WANG 1,a,*, Cai CHEN 2,b,*, Yi LIANG 3,c

APPLICATION OF JAVA TECHNOLOGY IN THE REGIONAL COMPARATIVE ADVANTAGE ANALYSIS SYSTEM OF MAIN GRAIN IN CHINA

Decision analysis of the weather log by Hadoop

Programming in C# for Experienced Programmers

Cloud Computing & Visualization

China Big Data and HPC Initiatives Overview. Xuanhua Shi

Type of Classes Nested Classes Inner Classes Local and Anonymous Inner Classes

Introduction to K2View Fabric

Application Design and Development: October 30

Chapter 6 Enterprise Java Beans

Building modern enterprise applications from scratch: lessons learned DOAG 2014 Dr. Clemens Wrzodek

Caché and Data Management in the Financial Services Industry

The Key Technology and Algorithm Design for the Development of Intelligent Examination System

Oracle Developer Day

Postgres Plus and JBoss

Tools to Develop New Linux Applications

Research Article Apriori Association Rule Algorithms using VMware Environment

CS 61C: Great Ideas in Computer Architecture. MapReduce

Bringing OpenStack to the Enterprise. An enterprise-class solution ensures you get the required performance, reliability, and security

Oracle Fusion Middleware 11g: Build Applications with ADF I

The Umbilical Cord And Alphabet Soup

APPLICATION OF HADOOP MAPREDUCE TECHNIQUE TOVIRTUAL DATABASE SYSTEM DESIGN. Neha Tiwari Rahul Pandita Nisha Chhatwani Divyakalpa Patil Prof. N.B.

The MapReduce Framework

Java Enterprise Edition

Cloud Computing 2. CSCI 4850/5850 High-Performance Computing Spring 2018

TITLE: PRE-REQUISITE THEORY. 1. Introduction to Hadoop. 2. Cluster. Implement sort algorithm and run it using HADOOP

Available online at Procedia Engineering 29 (2012) 69 73

IBM WebSphere Application Server - Express, Version 5.1

Cloud Programming. Programming Environment Oct 29, 2015 Osamu Tatebe

/ / JAVA TRAINING

Enterprise Java Unit 1- Chapter 3 Prof. Sujata Rizal Introduction to Servlets

Transcription:

2016 4 th International Conference on Advances in Social Science, Humanities, and Management (ASSHM 2016) ISBN: 978-1-60595-412-7 Research on the High Robustness JavaEE Enterprise Development Mode Based on Hadoop and Cloud Servers Kun Liu 1 Abstract In this paper, we conduct research on the high robustness JavaEE enterprise development mode based on Hadoop and cloud servers. The current virtual machine real-time migration can only achieve manual migration, and cannot achieve full-automatic migration. In other words, when the server overload requires the administrator to artificially select a low-load host, and then hit migration command to implement the migration. In recent years, the Hadoop is becoming popular, and the read performance of the data is measured in terms of the time overhead for reading the required data. The key to reducing read time is to optimize that Hadoop cloud data read time and the RDBMS data query time. This paper integrates the mentioned techniques to construct the novel JavaEE enterprise development pattern that will promote the further development of the related techniques. Keywords: High Robustness, JavaEE Enterprise, Hadoop, Cloud Servers. Introduction In recent years, with the rapid development of electronic information and Internet technology the new application system architecture has been paid more and more attention by people from all walks of life. This is based on Web technology Browser/Server Architecture, referred to as B/S. At present, the application software structure system is used in the Internet to replace the traditional C/S architecture, the development of TCP/IP protocol-based, Web-focused internal applications system that is being advocated by many companies well respected. From the function, satisfies the data is does not have the question completely using the platform development request. But from the technology, the Java use difficulty must be bigger than Microsoft's asp and.net, only through Java elementary knowledge and J2EE development kit training, and if does not have the actually Java procedure development experience, must cause the data to apply the platform establishment above Java that has the technical difficulty big problem. After the practice exploration, it establishes the practical Java procedure development frame can reduce the Java procedure development difficulty regarding begins studies Java is reduces the procedure development difficulty and the enhancement feasibility measure. 1 School of Information Science and Engineering, University of Jinan, Jinan 250022, PR China Shandong Provincial Key Laboratory of Network Based Intelligent Computing, University of Jinan, Jinan 250022, PR China 292

Figure 1. The Hadoop Processing Architecture. In recent years, the Hadoop is becoming popular, and the read performance of the data is measured in terms of the time overhead for reading the required data. The key to reducing read time is to optimize that Hadoop cloud data read time and the RDBMS data query time. RDBMS data query is essentially the data comparison operation, it and the overall database size, the CPU performance, the number of tables in the database, the number of records in the table, the size of each record data and the complexity of the query are difficult to give specific of the time model. The figure one shows the principles, in the later sections, we will discuss in detail. The Proposed Methodology The J2EE Development and the Java Architecture. In the JavaEE based enterprise application system development project management, design and implementation of the data persistence layer has been the focus of the research and development of enterprises. At present, there are many lasting solutions to achieve, such as JDBC, EJB and ORM. In these schemes using JDBC directly running efficiency is the highest, but the DAO and SQL objects he engaged in language too closely; the EJB is powerful, but the use of complex and flexible enough and ORM is a relatively ideal solution. Accordingly, the primary techniques can be organized as the follows. Figure 2. The Visualized Java Architecture. OBS systems use JSF presentation layer model driven framework is a set of the events, the framework provides a series of UI components used to display and Render, UI value 293

provided based on the Backing Bean and Bean properties binding and dynamic updating mechanism, can use the system to provide a custom converter is used to display and type conversion. The data acquisition interface in the BS system uses the Web Service interface as the message communication mechanism. To ensure the scalability of the acquisition protocol specification, the OBS system data collection interface uses XML format to express the message and file data. The billing system publishes detailed format of the Web service interface and contents. Labelling is in the Java language tremendous change, used massively in the OBS system realization has labelled. May simplify the JavaEE application procedure through the labelling use the issue process as causes the development personnel to be possible extricates from the code and in the issue document synchronization. The Cloud Server. The tradition memory system data integrity inspection mainly is based on the visit, like the online memory system, the mass memory system as well as the database memory system and so on, these systems visit on the server frequently the data, increased the server burden, wastes the network seriously the band width resources. The current virtual machine real-time migration can only achieve manual migration, and cannot achieve full-automatic migration. In other words, when the server overload requires the administrator to artificially select a low-load host, and then hit migration command to implement the migration. When the virtual machine can also be less manual, but the current size of the data center is often thousands to tens of thousands of servers, when there are dozens or even hundreds of high load occurs, it is clear that the efficiency of manual migration is very low, and may delay the migration of some of the reasons for a long time server overload or even downtime. And accordingly, the cloud server can be then separated into the listed aspects. Platform service. This is an application can be regarded as a set of infrastructure services layer, which includes middleware as services, messaging services, as then integrated as a service, information service, such as connectivity as a service, service is mainly to support application. Infrastructure service. The foundation structure service level is the cloud service the first floor, is a set of physical property, like the server, the network equipment, as well as provides the memory floppy disk as the supplies service to the user and so on. Here service support application procedure foundation structure and more users. Application services. Application services are running in the cloud applications and according to the requirements as a service to the user. These applications provided in the form of a web service, the user through the UDDI lookup or use these services. UbiCloud is a cloud computing system designed to address the needs of the complex computing resources for general weak endpoints that enabling seamless invocation of server-side software on the weak endpoints and resource integration. The application software is one kind of novel computation resources, we need to know this resources some basic informations, and while for example: Service type, transfer parameter, support informations and so on MIME type, simultaneously we also need to understand this computation resources the visit way, how namely does transfer this basic application procedure, for example service agreement, IP address and port and so on. 294

Figure 3. The Cloud Server and Data Communication Demonstration. The Hadoop. Hadoop MapReduce is an easy-to-use software framework that allows applications written on it to run on large clusters of thousands of business machines and in parallel to handle the T-level data sets in a reliable fault-tolerant manner. In the cluster, file by Hadoop block for storage, and as Map/Reduce frame input data sources, Map/Reduce will according to the file size and the size of Block decided to make the number of splits, and therefore decided to generate the number of Map tasks and Map tasks to get records of the iterator according to the splits, to read records and generate key/value to call the custom map function, this is a continuous cycle until all the data so far. Under this basis, we can then cut the Hadoop architecture as the follows. Reducer reduces the set of intermediate values associated with a key to a smaller set of values. Implementors of the reducer need to override the JobConfigurable.configure (JobConf) method, which needs to pass a JobConf parameter, the purpose is to complete the reducer initialization work. Mapper is inputs the key value to map to a group of middle form key value to the set. Hadoop the MapReduce frame has one map duty for each InputSplit, but each InputSplit is produces by this work InputFormat. Because the Reduce task does not have the task locality, when the resource manager receives the heartbeat information of the idle resource node to request the task allocation, the idle resource is allocated to the operation of the resource application. Job to determine whether the CPU and storage resources of idle resources to meet the needs, if satisfied, from the Reduce task to be assigned to select a task placed in the node. For the systematic testing, the core code of the Hadoop is shown as follows. In the shuffle phase, the data transfer from the map end to the reduce end uses the Http protocol. Http is built on the request/response model, first by the customer to establish a link with the server TCP, and sent to a request to the server, the request contains the request method, URI, protocol version and the related MIME (multi-purpose Internet mail-extensions) style message. The server responds with a basic status line containing the protocol version of the message, a success and failure code, and a MIME-style message containing server information, resource entity information, and possibly resource content. 295

Figure 4. The Hadoop Core Initialization Code. The High Robustness JavaEE Enterprise Development Suggestions. Java programming framework can reduce the difficulty of the Java program development, which is the consensus of the program development community, so that the Hibernate, Strus, Spring and other frameworks are very popular, but the use of these frameworks for non-experienced computer professionals, Although they are strong, advanced design, scalability, the feeling of these frames around the bend too much, not suitable for a particular system of the information processing, it is difficult to apply these popular framework to their own Java project development. Here, we give the listed suggestions. The Struts frame was the Web application has provided an general frame, how could such development personnel solve manager in the actual problem. At the same time, Struts also can in the suitable place expansion connection, enable the application procedure to expand this frame better adaptation user's actual need. Hibernate is a java-based open source persistence of middleware, it made a lightweight the JDBC encapsulation, provides not only the ORM mapping services, also provides data query and data cache function, Java developers can easily through the Hibernate API to manipulate the database. A growing number of Java developers use Hibernate as enterprise application and the relationship between the database middleware, to save and object persistence JDBC programming about 30% of the workload. MVC model, the model view controller model, whose core idea is to divide the program code into 3 components that are relatively independent and can work together. MVC weakens the coupling between business logic interface and data interface makes software maintainability, maintainability, extensibility, flexibility and the encapsulation. Besides these, we should also provide the suggestions on the agile development. (1) Refactoring refers to reorienting and optimizing the internal structure of the system to reduce complexity, eliminate redundancy, increase flexibility and improve performance without changing the behavior of the system. By refactoring to improve the design of existing code is correct, but the reconstruction can easily be misused. If, as some people understand, refactoring means designing continuously at the development time, there is a problem. (2) Agile processes promote "writing tests first, then coding". Driver code and failed test cases design that can reduce unnecessary construction. Developers must ensure that unit testing and integration testing operation and correct all the time, even the scene of the customer representative is to be able to write functional test program. (3) At any time requires the design of the code as simple as 296

possible, just to meet the needs of the current function, not many also a lot of. Guided by a simple metaphorical description of how the whole system works. Conclusion In this paper, we conduct research on the high robustness JavaEE enterprise development mode based on Hadoop and cloud servers. With the server virtualization technology in the cloud computing data center applications, the rapid development of virtualization technology, including the virtual and the virtual machine real-time migration technology has become an important development branch of the virtualization technology due to the advantages of resource integration, load balancing, energy saving and power saving, and routine maintenance. However, the current real-time virtual machine migration can only be manually selected by the administrator to migrates the virtual machine and the receiver physical machine, when the high load of virtual machine too much the efficiency of manual migration is very low. Along with computer network unceasing development, the people more and more are also high regarding the data storage request, specially emerges in cloud computation under background, becomes the attention based on the magnanimous data cloud memory system the hot spot. Under this basis, this paper proposes the JavaEE enterprise development mode based on Hadoop and cloud servers that will promote the development of the enterprise application design. References [1] O Driscoll, Aisling, Jurate Daugelaite, and Roy D. Sleator. " Big data, Hadoop and cloud computing in genomics." Journal of biomedical informatics46.5 (2013): 774-781. [2] Yang, Chao, Weiwei Lin, and Mingqi Liu. "A Novel Triple Encryption Scheme for Hadoop-Based Cloud Data Security." Emerging Intelligent Data and Web Technologies (EIDWT), 2013 Fourth International Conference on. IEEE, 2013. [3] Cheng, Feng-Qi, and I-Ching Hsu. "Hadoop environment management App based on mobile cloud computing." Bulletin of Networking, Computing, Systems, and Software 5.1 (2016): 1-4. [4] He, Chenguang, Xiaomao Fan, and Ye Li. "Toward ubiquitous healthcare services with a novel efficient cloud platform." IEEE Transactions on Biomedical Engineering 60.1 (2013): 230-234. [5] Hyder, Muhammad Faraz, Muhammad Ali Ismail, and Hameeza Ahmed. "Performance comparison of Hadoop Clusters configured on virtual machines and as a cloud service." Emerging Technologies (ICET), 2014 International Conference on. IEEE, 2014. [6] Poggi, Nicolas, et al. "ALOJA: A systematic study of hadoop deployment variables to enable automated characterization of cost-effectiveness." Big Data (Big Data), 2014 IEEE International Conference on. IEEE, 2014. [7] Padhy, Rabi Prasad. "Big data processing with Hadoop-MapReduce in cloud systems." International Journal of Cloud Computing and Services Science2.1 (2013): 16. 297