Big Data Service Combination for Efficient Energy Data Analytics

Similar documents
A Design of Building Group Management Service Framework for On-Going Commissioning

A Study on the IoT Sensor Interaction Transmission System based on BigData

The Design and Implementation of a BLE-based WebD2D Service for Android Smartphone

An Efficient Flow Table Management Scheme for SDNs Based On Flow Forwarding Paths

Design of a Processing Structure of CNN Algorithm using Filter Buffers

A Graph-based Interpretation for Finding Solution Strategies of Contradiction Problems in the Butterfly Diagram

Building Ubiquitous Computing Environment Using the Web of Things Platform

Network Intrusion Forensics System based on Collection and Preservation of Attack Evidence

A Preliminary Study on Daylighting Performance of Light Shelf according to the Depth of Space

Abnormal Data Detection with CEP Engine for Smart Factory

A study on improvement of evaluation method on web accessibility automatic evaluation tool's <IMG> alternative texts based on OCR

Determination of the Parameter for Transformation of Local Geodetic System to the World Geodetic System using GNSS

Sentiment Analysis for Customer Review Sites

Post-Classification Change Detection of High Resolution Satellite Images Using AdaBoost Classifier

Supporting Collaborative 3D Editing over Cloud Storage

Automatic Pipeline Generation by the Sequential Segmentation and Skelton Construction of Point Cloud

Development of Smart-CITY Based Convergent Contents Platform Using Bluetooth Low Energy Beacon Sensors

Design of Good Bibimbap Restaurant Recommendation System Using TCA based on BigData

Document Summarization using Semantic Feature based on Cloud

A Study on Architecture of CAN over 3GPP Gateway in Vehicle Network

A Study on Development of Azimuth Angle Tracking Algorithm for Tracking-type Floating Photovoltaic System

Development of a M2M Network-based Smart SMPS System

An Analysis of Website Accessibility of Private Industries -Focusing on the Time for Compulsory Compliance with Web Accessibility Guidelines in Korea-

Remote Direct Storage Management for Exa-Scale Storage

Design of Ontology Engine Architecture for L-V-C Integrating System

Keywords: wearable system, flexible platform, complex bio-signal, wireless network

A study on accessibility to mobile websites - Centering on public institution mobile websites in Korea -

Deep Learning Based Real-time Object Recognition System with Image Web Crawler

Virtualized Testbed Development using Openstack

Proposal of Quadruped Rigging Method by Using Auxiliary Joint

A Design of Distributed Data Traffic Algorithm based on Hierarchical Wireless/Mobile Networks

Integrated Framework for Keyword-based Text Data Collection and Analysis

Seamless Multicast Handover in Fmipv6-Based Networks

Common Service Discovery Scheme in IoT Environments

A Noise-Robust and Adaptive Image Segmentation Method based on Splitting and Merging method

Architecture for QoS-enabled Application Service Deployment in Virtualized Environment

A Case Study of Black-Box Testing for Embedded Software using Test Automation Tool

Study on the Signboard Region Detection in Natural Image

Reliability Measure of 2D-PAGE Spot Matching using Multiple Graphs

Semantic Web Search Model for Information Retrieval of the Semantic Data *

A Fast Handoff Scheme Between PDSNs in 3G Network

A study on MAC protocol for urgent data transmission in Wireless Bio Signal Monitoring Environment

Frequency-based NCQ-aware disk cache algorithm

3D Grid Size Optimization of Automatic Space Analysis for Plant Facility Using Point Cloud Data

IJREAT International Journal of Research in Engineering & Advanced Technology, Volume 1, Issue 5, Oct-Nov, ISSN:

Fast Device Discovery for Remote Device Management in Lighting Control Networks

Improved MAC protocol for urgent data transmission in wireless healthcare monitoring sensor networks

Classification of Roadway Type and Estimation of a Road Curvature Using a Road Characteristic Conversion Coefficient

An Efficient Provable Data Possession Scheme based on Counting Bloom Filter for Dynamic Data in the Cloud Storage

Distributed CoAP Handover Using Distributed Mobility Agents in Internet-of-Things Networks

Text Classification Using Mahout

A Virtual-Synchronized-File Based Privacy Protection System

An Improvement of the Occlusion Detection Performance in Sequential Images Using Optical Flow

Research on the Performance of JavaScript-based IoT Service Platform

3D Memory Formed of Unrepairable Memory Dice and Spare Layer

E-Training Content Delivery Networking System for Augmented Reality Car Maintenance Training Application

Keywords: disk throughput, virtual machine, I/O scheduling, performance evaluation

Data Imbalance Problem solving for SMOTE Based Oversampling: Study on Fault Detection Prediction Model in Semiconductor Manufacturing Process

Robot localization method based on visual features and their geometric relationship

An Automata-based Security Policy Translation for Network Security Functions

A Study of Open Middleware for Wireless Sensor Networks

XETA: extensible metadata System

Optimizing Web Service Composition in Parallel

An Energy Efficient Data Dissemination Algorithm for Wireless Sensor Networks

Time Stamp based Multiple Snapshot Management Method for Storage System

Reliable transmission of visible light communication data in lighting control networks

Trajectory Planning for Mobile Robots with Considering Velocity Constraints on Xenomai

Causal Order Multicast Protocol Using Different Information from Brokers to Subscribers

A Repository Framework for Self-Growing Robot Software

Delay Reduced MAC Protocol for Bio Signal Monitoring in the WBSN Environment

Pupil Center Detection Using Edge and Circle Characteristic

Optimized Vehicular Traffic Flow Strategy using Content Centric Network based Azimuth Routing

An Intelligent Agent for RFID-based Home Network System

Message Processing at Integrated PHD Gateways for Servicing Various PHDs

A Robust Hand Gesture Recognition Using Combined Moment Invariants in Hand Shape

How to Optimize Jobs on the Data Integration Service for Performance and Stability

Generalized alternative image theory to estimating sound field for complex shapes of indoor spaces

The Analysis of D-CATV VOD Service Users and Their Usage Patterns. Abstract

Data Mining Technology Based on Bayesian Network Structure Applied in Learning

A Study of Mountain Environment Monitoring Based Sensor Web in Wireless Sensor Networks

Hierarchical Group Data Management Scheme using Priority Information Big Data Environment

A study on automation of modal analysis of a spindle system of machine tools using ANSYS

Implementation of Monitoring and Control Systems for 50KW PV Systems Using the Wire-Wireless Network

Partial Caching Scheme for Streaming Multimedia Data in Ad-hoc Network

Study on the Distributed Crawling for Processing Massive Data in the Distributed Network Environment

What s New in Spotfire DXP 1.1. Spotfire Product Management January 2007

INTRUSION DETECTION SYSTEM USING BIG DATA FRAMEWORK

Implementation of Omni-directional Image Viewer Program for Effective Monitoring

A NOVEL SCANNING SCHEME FOR DIRECTIONAL SPATIAL PREDICTION OF AVS INTRA CODING

A Personal Information Retrieval System in a Web Environment

Application of Fuzzy Logic Control to Dynamic Channel Allocation of WiMedia UWB Networks

Towards Secure Virtual Machine Migration in Vehicular Cloud Environment

Learning System FRIMAN

Analysis of Virtual Machine Scalability based on Queue Spinlock

Data Curation with Autonomous Data Collection: A Study on Research Guides at Korea University Library

K/Compute (Private) Limited Web:

SQL-to-MapReduce Translation for Efficient OLAP Query Processing

Voice Annotation Technique for Reading-disabled People on Mobile System

Development of Massive Data Transferring Method for UPnP based Robot Middleware

A Layout-Free Method for Extracting Elements from Document Images

Transcription:

, pp.455-459 http://dx.doi.org/10.14257/astl.2016.139.90 Big Data Service Combination for Efficient Energy Data Analytics Tai-Yeon Ku, Wan-ki Park, Il-Woo Lee Energy IT Technology Research Section Hyper-connected Communication Research Laboratory, ETRI Dae-jeon, Korea kutai@etri.re.kr, wkpark@etri.re.kr, ilwoo@etri.re.kr Abstract. The paper relates to a system and method for combining a Big Data service for efficient energy data analytics. Big data platform technology has been developed, and various methods for utilizing the technology are being proposed, but only information technologies (ITs) for advanced users have been offered. This paper is directed to a system and method for combining a service combination capable of providing a big data analysis more easily and rapidly and recognizing an analysis flow more easily by combining a model-based service combination. The Big Data Service combination tool is to provide a system and a method for data analysis services which is able to select data corresponding to a user requirement and an analysis algorithm which is able to analyze the data and let an analysis service selected by the user among a plurality of analysis services be automatically performed in a big data platform. Keywords: Big Data, Analytics, Service Combination 1 Introduction Recently, a data market, an analysis algorithm market is based on the Hadoop. Many big data platform techniques have been tried to interconnect between data and an analysis algorithm but it is not still visualized since there is no standard method yet. Many data analysis algorithms and methods have been introduced technically but data owners have to be familiar with such intricate analysis methods or do not know how to utilize it. As a result, such valuable data becomes disappeared. Thus, various methods for utilizing data have been introduced and big data platform technics have been developed to resolve such problems but they are still only for professional users. 2 Overview of Big-Data Service Combination architecture Accordingly, the workflow model may be configured in a selection tree form including various workflow models according to a user s intention. That is, a plurality of workflow models in which each node configures an upper and lower level may be included in one workflow model. ISSN: 2287-1233 ASTL Copyright 2016 SERSC

Fig.1. Platform Independent Service Combination 3 Platform Independent Bigdata Service Combination Mechanism Fig. 2 is a diagram for describing a combination of a hierarchical model-based service combination. The levels of the service combination model may be generated differently according to which classification standard the service combination model is classified based on. For example, a classification according to a data type may be arranged in a first level, a classification according to an analysis domain may be arranged in a second level which is a lower level than the first level, and a classification according to a function may be arranged in a third level which is a lower level than the second level. 456 Copyright 2016 SERSC

Fig.2. Multi-Level Service Combination Model Accordingly, the service combination model may be configured in a selection tree form including various service combination models according to a user s intention. That is, a plurality of service combination models in which each node configures an upper and lower level may be included in one service combination model. When a selection input of a user for the classification standard is received and the selection tree form is configured as shown in FIG. 2, a service combination model P1 formed as one or more levels may be mapped to one or more nodes P2 configuring the service combination model. That is, one or more service combination models including their lower levels may be mapped to one node. The service combination generation tool may provide the service combination model to the user, and the user may select and utilize a service combination model P1 which the user wants. FIG. 3 is a diagram for describing a hierarchical structure of a service combination model. Fig.3. A hierarchical structure of a service combination Copyright 2016 SERSC 457

One service combination model P1 may be generated through various manners. For example, the service combination model P1 may be generated by receiving information corresponding to a node of a lower level input by a user, and may be generated through a combination of a service combination model which is previously generated. In order to generate the service combination model in the various manners, the service combination model P1 may have a multi-level structure. That is, a service combination model P1 in which a lower level for an advanced developer, a level providing a basic parameter value, a level of abstractly componentizing frequently used functions and providing the componentized functions, a level of automatically providing complex big data through designation of a simple input and output value, etc. are configured in the multi-level may be provided. In the method for combining a service combination, first, a classification standard for each level of the service combination model may be selected in response to a selection input of the user for the classification standard of the service combination model. Next, according to the classification standard for each level, one or more service combination models may be mapped to a node included in the service combination model. In this case, one classification standard may be applied to each level, and a service combination model formed as one or more levels may be mapped to the node. Meanwhile, each level of the service combination model may have a level different from other levels, and each level may include different authority and function. Next, the mapped service combination model may be displayed. Meanwhile, the method for combining the service combination may further include an operation of receiving a selection input for a node of each level of the mapped service combination model input by the user. That is, as the user selects any one node for each level, the node for each level which is selected may be displayed on the service combination generation space of the service combination GUI tool based on the sequence of the levels. In the description described above, according to implementation examples of the present paper, the operations may be separated to have further operations or be combined to have the smaller number of operations. Further, some operations may be omitted according to necessity, and the sequence of the operations may be changed. Moreover, even though some description have been omitted, the content described above regarding the proposed service combination mechanism for combining the service combination may also be applied to the method for combining the service combination. A plurality of users may easily and rapidly generate an analysis service through a combination of a puzzle form based on a defined model by defining ecosystems as the model and providing a reusable structure. Further, information such as a state of work which is currently being performed, work which is completed, and work which is not processed, etc. among work listed on a service combination may be easily recognized. Moreover, an analysis result may be provided in various manners through a visualization model. In addition, a setting error, etc. needed when generating or performing a service of a complex ecosystem through the provided service combination generation tool may be automatically detected, and it may be possible to generate a service using the minimum necessary input through a default setting value. Also, when updating the ecosystem, the previously generated service combination may be easily reusable through a model update of a related ecosystem, and thus it is possible to rapidly adapt to big data technology which is rapidly changing. Through this paper, big data analysis which has 458 Copyright 2016 SERSC

been performed by some specialists may be easily and rapidly provided, and an analysis flow may be easily recognized by a combination of the model-based service combination. Moreover, an analysis result may be provided in various manners through the visualization model. 4 Conclusion The paper relates to a system and method for combining a Big Data service for efficient energy data analytics. Big data platform technology has been developed, and various methods for utilizing the technology are being proposed, but only information technologies (ITs) for advanced users have been offered. This paper is directed to a system and method for combining a service combination capable of providing a big data analysis more easily and rapidly and recognizing an analysis flow more easily by combining a model-based service combination. Acknowledgements. This work was supported by the Korea Institute of Energy Technology Evaluation and Planning (KETEP) and the Ministry of Trade, Industry & Energy (MOTIE) of the Republic of Korea (No. 20161210200360). References 1. Ku, T.-y., Won, H.-S., Choi, H.: Service Recommendation System for Big Data Analysis, ICOIN 2016, Oct, 2015 2. Ku, T.-y., Won, H.-S., Choi, H.:, Adaptive Cache Deploying Architecture Using Big Data Framework for CDN, ICTC 2015, Oct, 2015 Copyright 2016 SERSC 459