Development of Distributed MetBroker toward Information Grid

Transcription

1 Development of Distributed MetBroker toward Information Grid Jedsada Phengsuwan, Sornthep Vannarat Computer Technology Research and Development Division (R-DC) National Electronics and Computer Technology Center (NECTEC), Thailand

2 Agenda Objective Distributed MetBroker Progress of Distributed MetBroker Information Grid Page 2

3 Objective Collaborative work between NECTEC, HAII (Thailand) and NARC (Japan) Extend NARC s Centralize MetBroker to distributed System Based on Web Services and Grid Technology Consist of 2 main components MetBroker Discovery Service Applies for other project (Multiple Broker, Info. Grid) Page 3

4 MetBroker Consistent data access to one kind of data Applications Driver for each database Domain Databases (Heterogeneous) Met Broker Relational Broker File-based Web-pages /CGI Mathew Laurenson, NARC, Page JAPAN 4

5 Distributed MetBrokers Scenario DS DS DS discovery result DS data MetBroker DS Discovery Service Page 5

6 Discovery Service Discover MetBroker analyze user s data request return suitable MetBroker Smart Discovery Service Registry MetBroker registry services Monitor MetBroker status (running, shutdown) Page 6

7 Discovery Services Components NR Marker Smart Discovery Services Single Sign-on service Page 7

8 Progress of Distributed MetBroker Replace Object Stored Database with Ozone Database MetBroker Web Services version MetBroker s system resources sharing on grid environment Page 8

9 Replace with Open source database A B A B Application MetBroker MetBroker Server Object Store Ozone Page 9

10 MetBroker Web Services Page 10

11 MetBroker Web Services Page 11

12 MetBroker Web Services Page 12

13 MetBroker Web Services Page 13

14 MetBroker Web Services Page 14

15 Sharing system resource information Grid environment MetBroker System Resource Engine Grid Service Container Create grid service instance Services ds-instance DiscoveryServiceFactory SOAP updater update System Info. DS remote interface RMI DS2Broker TimerTask Connection starter Start task update SDE (BrokerSystemInfo ) SDE (DS2BrokerStatus) Page 15

16 How does it work? Grid environment MetBroker System Resource Engine Grid Service Container Create grid service instance Services ds-instance DiscoveryServiceFactory SOAP updater update System Info. DS remote interface RMI DS2Broker TimerTask Connection starter Start task update SDE (BrokerSystemInfo ) SDE (DS2BrokerStatus) Page 16

17 Information Grid Objective build frame work and infrastructure for integrating public information sources to support a problem solving environment Homogeneous information sources Other products like IBM s DB2II, Avaki Page 17

18 Scenario Marker Directory Marker Definition Language Information Broker Data Data MD Discovery Service IB IB Person Application process Data DS Data Data DS IB IB Data Data Data Data Page 18

19 Information Grid Implements Marker Directory Information Broker Discovery Service Application Standard Information Grid Framework Marker Definition Language Page 19

20 Conclusion Distributed MetBroker solve single-point of failure and bottle neck Broker scalability Each broker can manipulate all data by themselves Data discovery feature Important key for Information Grid Page 20

21 Thank you

22 Page 22

23 Discovery Service The best MetBroker Used for Multiple Broker project S i MB = i MB x i Rsrc x (W i region + W i users + W i net + W i CPU + ) n S best = Max (S 1 MB, S 2 MB,, S N MB) J.G. Wang (NARC) Page 23

24 Technologies related Grid globus 4.0 grid services Web Services Semantic web Resource Description frame work (RDF) Ontology Distributed MetBrokers Page 24