A Study on Information Connection Model using Rulebased Connection Platform

Transcription

1 A Study on Information Connection Model using Rulebased Connection Platform Heeseok Choi, Jaesoo Kim NTIS Center, Korea Institute of Science and Technology Information, Daejeon, Korea Abstract - National Science & Technology Information Service (NTIS) collects national R&D information through the connection system in real time with specialized institutions under government ministries for R&D information service. However, because the information connection between the research management systems in each ministry (institution) and the NTIS is different, it is not easy to operate the connection system, and immediate data collection is thus not ensured. This study aims to propose an information connection model to be applied on the NTIS-like systems. To do this, we examine methods or styles of information connection and compare strength and weakness of connection methods. In this paper we also understand issues or characteristics of the methods through analyzing current information connection methods applied on the NTIS. Therefore, we design a rule-based information connection platform to minimize the information connection issues. Based on the platform, we also propose an information connection model. Keywords: Information Connection, Information Sharing, Rule-based Connection, NTIS 1 Introduction National Science & Technology Information Service (NTIS) was developed for improving efficient research and development throughout the cycle from planning R&D to using the outcome thereof [1]. For this purpose, each representative institution under the government ministries and agencies comprehensively manages its R&D information for connection with the NTIS for the purpose of real-time collection of national R&D information (periodical update when collecting and changing the information at the time of project agreement). The NTIS has currently built a real-time connection system with representative institutions under government ministries and agencies [2]. However, since the connection criteria of each institution with external systems are different, the NTIS is connected with the research management system of each institution in various manners, to collect R&D information. Accordingly, immediate data collection is not ensured, and various manners of connection contribute to inefficient operation/maintenance. This study aims to propose an information connection model to be applied on the NTIS-like systems. To do this, we examine methods or styles of information connection and compare strength and weakness of connection methods. In this paper we also understand issues or characteristics of the methods through analyzing current information connection methods applied on the NTIS. Therefore, we design a rulebased information connection platform to minimize the information connection issues. Based on the platform, we also propose an information connection model to be applied on the NTIS-like systems. 2 Related works 2.1 Technologies of information connection For information connection between systems, P2P, EAI, ESB or combinations thereof are currently applied [3]. Features and characteristics of each method are described below. 1 P2P: 1:1 connection between individual systems, and cannot be extended or reused. However, because connection between individual systems is simple, a connection system is easily built in conformity with features of each system. 2 EAI: Individual applications are connected to the central hub by means of an adapter, and are connected to other applications through the central hub. This significantly improves typical complex connections. However, this method uses vender-dependent technology and adapter costs should be paid for each connected application. 3 ESB: This method was developed to avoid weakness of non-standard EAI (Hub & Spoke) and SPOF (Single Point Of Failure). However, because the current ESB solution market is controlled by the EAI solution providers, the tendency is that the previous EAI solutions are supplemented and developed. In general, this method is used for service connection. Table 1 describes the strength and weakness of each technology in terms of complexity, extensibility, flexibility, and integration cost, etc.

2 P2P EAI ESB Table 1. Comparison of connection technologies Strength -Easy application to simple interworking between systems in a non-complex environment. -Easy extension in introducing new applications. -Increased productivity and convenience for development and maintenance. -Reduced integration cost because standard technology is used and service units can be reused. -Loose connection in a bus type contributes to high extension capability and flexibility. Weakness -As the number of systems to be connected increases, the cost for maintenance may sharply increase. -Low extension capability and flexibility. -High cost of establishment and maintenance. -Central hub failure affects the entire system. (Single Point of Failure) -High cost of initial establishment. 2.2 Styles of data provision (collection) When systems of other organizations are connected, independency of system operation and system/data security of the organizations can be also an important issue. Therefore, the subject of data provision (collection) can be considered as an important factor in building and operatiing a connection system. Connection depending on the subject of data provision (collection) is divided into the push method and the polling method [4]. 1 Push method: an information source (information provider) who owns and manages original information pushes data into information targets (information consumers) in a given cycle according to the information provision policy. Therefore, information connection in this method is by a subject of information provision who leads information connection. This method is in favor of operation and security of data and institution systems for information providers, but does not ensure immediate information collection for information providers. 2 Polling method: this is to access information providers (systems for information sources) when an information collector requires the information to bring required information. Therefore, this is a method of connection in which the subject of information collection leads information connection. This method ensures immediate information collection, but is not preferred by information providers in terms of operation independency and security of internal systems because information sources are directly accessed from external systems. Table 2 describes the strength and weakness of provision styles in terms of security, maintenance, performance, and dependency, etc. Push Polling Table 2. Comparison of data provision styles Strength -High security in system connection between systems of institutions. -Independent connection with external systems in system operation. -Information providers lead connection. -Because information collectors lead information management is easily implemented according to information collection policies. -Immediate data collection is ensured. Weakness -Because information providers lead information management of systems to be connected is not easy. -Information connection varies with institution by institution, maintenance is not easy. -Security is vulnerable in system connection. -Because performance may be affected by connection with external systems in system operation, information providers do not like this method. 3 Analysis of the NTIS connection system We analyzed the case of NTIS. The NTIS established an information connection system with research management systems of representative institutions under government ministries and agencies in order to connect and collect national R&D information. In this case, the push method is applied as a connection method to enable each representative institution to have the right of providing data appropriate for the connection policy and system environment thereof with external systems, and to have the ownership of the data owned by each representative institution. That is, data are provided by means of connection according to a given cycle for data items defined in the national R&D information standard. However, the principle of providing data on a daily basis if data are created is not ensured by adding an approval procedure for data provision to the automatic connection process in actually operating the connection system. Also, although data are provided in the push method, the link method and the unidirectional EAI method are applied to each institution depending on each institution environment. More details are shown in Table 3 to show implemented connection systems in various types. The reason of application is because the method of data provision is determined and implemented in various types according to the preference of each institution (for tasks or system environment) when the push method is applied. This results in no assurance of immediate data provision, and also makes monitoring and operation of the connection system difficult.

3 Table 3. Information connection styles in the NTIS Method Type Description Link EAI View Snapshot Trigger Trigger+ JC Script Procedures Program Direct connection to a in a connection server of an institution. The procedure Inquiry/Send is used. The copy of institution table refreshes the connection server in a given cycle. Trigger is established to reflect relevant changes on the connection server in updating the institution. Trigger is established to reflect relevant changes on the connection server in updating the institution (based on Java, etc.). Uses script to send data from an institution to the connection server in a given cycle. Transmits data from an institution to the connection server table by means of the procedure. Transmits data by means of the EAI program of each ministry (institution) (unidirectional). information is first transferred to the connection from the institution s system. This section is defined as a variation area. Subsequent data processing in the connection and data transmission to the integration is defined as a major function of a common area which can be standardized. Figure 1. Basic steps of information connection Therefore, it is necessary to build the connection platform as a function to overcome variability of each institution in the variation areas and to process the functions in the common area. To this end, the connection platform includes functions of connection rule processing, mapping, connection error processing, and creation of update information and monitoring information. Fig.2 shows system architecture of a connection platform which includes the aforementioned functions. 4 Design of an information connection model using rule-based connection platform The current NTIS information connection system has been established in the P2P style through the link or the unidirectional EAI method as described in the chapter 3. However, it is necessary to improve the connection system in a standardized method for immediate provision, integrity, efficient connection system monitoring and operation of data connection. It is also important to design the method based on easily managable rules. In this study, parts which can be functionally standardized in information connection between the NTIS and specialized institutions under ministries and agencies are identified to design them as a major functional module of the connection platform. We design a rule-based information connection platform to be applied on the NTISlike information connection systems. Based on the platform, we also propose an information connection model. 4.1 Rule-based connection platform Rule-based connection platform should be basically designed on standardization for information connection among heterogeneous systems. The sections from which data are first acquired in connection with each institution are divided into variation areas for the purpose of information connection based on standardization, and the next phases are identified as standard functional areas. That is, as shown in Fig.1, the R&D Figure 2. Rule-based connection platform Fig. 2 shows the connection platform which is composed of rule processing (preactors), connection processing (Workers), and parallel task processing control (Controllers), and which performs connection of the common areas according to the rule predefined in the Rule File. 1 Schema mapping (Mapper): this is carried out between an institution schema and the NTIS standard collection schema according to the schema mapping rule defined in the Rule File for the data transferred from the institution. Code mapping is also carried out from the code value in the institution to the code value in the NTIS integration according to the code mapping rule defined in the Rule File.

4 2 Comparison of data (Comparer, I/U/D Handler): this is to compare the data transferred from an institution with the data transferred in the previous cycle to decide whether to update the data. On the basis of comparison result, the system in the connection institution system displays I(Insert), U(Update), or D(Delete) to indicate that the relevant data is new, updated or deleted data. 3 Connection error processing (Error Checker, Error Handler): this is to check errors in connection, for example, key errors, errors in essential connection items, code conversion errors, data conversion errors, data format errors, data length errors, etc. Details of the checked connection errors are created to be an error. Normal data are then stored as an Org to be transmitted to the NTIS integration. 4 Connection monitoring information creation (Monitor): information is created about whether connection normally operates, for example, the number of connection data, details of updated data, execution of the connection module according to the schedule, or how much new data has been provided. 5 Rule Parser: this enhances data mapping through rule based processing. The Rule Parser interprets the Rule File which specifies schema mapping, code mapping and rules that should be observed when data are provided from an institution to the NTIS. 6 Scheduler: information connection is performed periodically or in real time depending on information type. Therefore, the function to control the information connection execution cycle is provided. Three types of execution scheduling is provided, including manual execution (immediate execution) by an operator, periodical execution and execution after standby for a given period of time in consideration of the features of NTIS connection. 7 Data Cacher: information frequently used, for example, schema information and code mapping tables, is internally cached to improve connection capability. Data are deleted after a given period of time. 8 Operation environment (Controllers): this controls listing tasks to be processed for optimized resource management and function processing by means of multi threads, and to carry out the tasks according to the processing sequence. Controllers also provide access to storages to store the connection result in the or a file. The connection platform designed as such can improve data processing speed through internal data caching. It can enhance data mapping through rule-based data processing, and can operate and maintain the connection system by producing/changing rules. It sorts data sources from targets to manage data history, and systematically checks data errors. It can address difficulty in connection monitoring due to different connection methods between institutions, and processes data update information. 4.2 Information connection model using rulebased connection platform On the basis of the rule-based connection platform designed in 4.1, information connections in the push method, and in the EAI method or the polling method by agents can be implemented. Therefore, two types of information connection models were designed and the two types of connection models were compared with respect to the important issues considered in information connection by the NTIS with the representative specialized institutions. 1 P2P & Push method using the connection platform For standardized information connection, the connection platform was defined, which processes the information connection rule, performs encryption, and creates connection error and monitoring information. The connection standard platform contributes to addressing limitations by different information connection methods of each institution. That is, although each institution provides data in a different method (entire relevant data or some of changed data), it is possible to identify details of data change, and to create consistent error and monitoring information. Consistent connection also contributes to easy management of information connection. This connection method, however, can provide data to a connection system at times desired by an institution. Fig.3 shows this method as described above. Figure 3. Connection in P2P & Push method 2 Agent & Polling method using the connection platform This is a method of connection to apply the Polling method which uses an agent to bring institution data while information connection is based on standardization. This method enhances the efficiency of using connection server resources, and ensures the initiative of data collection to ensure immediate data collection. Integrated connection system management can be also implemented. The system for jointly using administrative information employs this method. Fig.4 shows this method as described above.

5 the common area. We also examined methods In this paper we also understand issues or characteristics of the methods through analyzing current information connection methods applied on the NTIS. Therefore, we designed a rule-based information connection platform to be applied on the NTISlike information connection systems. Based on the platform, we also proposed an information connection model. Figure 4 Connection in Agent & Polling method Finally, Table 4 shows the strength and weakness of two connection methods in information connection. Of course, most external connection institutions prefer connection by the P2P & Push methods because security is a key factor to determine their connection method. However, in consideration of the strength described in Table 4, it is necessary to employ a connection method which implements the aforementioned strength. Therefore, in this study, the method of Agent & Polling using rule-based connection platform is suggested for future NTIS information connection. To this end, it is necessary to establish schemes for strengthening security, and to establish access supported by policies and strategies. Table 4. Comparison of the connection methods It is necessary to expand rule-based connection platform to establish a flexible and extensible connection system. In addition, it is necessary to develop a connection guideline for standardizing information connection. 6 References [1] NTIS, National Science and Technology Information Service, [2] Choi, H., etc, "Study on Real-time Integration System Extension of National R&D Information", Korea Computer Congress, [3] Nah, Y., ESB-based Data Service Connection" [4] Choi, H. etc, Technology Trends on Information Connection, Technical Reports, KISTI, Connection speed Storage capacity Management efficiency Immediate connection Security P2P & Push Same Great *Because each institution uses its own data provision method, data pre-processing is thus required. Because information providers are the subject of information management is not easy. Not ensured. Relatively high (in terms of institution systems) Agent & Polling Same Not great Because information collectors are the subject of information connection, integrated management is easy. Ensured Relatively low (in terms of institution systems) 5 Conclusions and future works This study examined methods or styles of information connection and compare strength and weakness of connection methods. We also analyzed the current NTIS information connection system established with representative specialized institutions under government ministries and agencies. On the basis of this, the variation area and the common area were identified to design a connection platform for the functions of