The JXTA way to Grid: a dead end?

Transcription

1 The JXTA way to Grid: a dead end? Marco Ferrante ferrante@disi.unige.it Dottorato in Informatica, XXII ciclo 21 Feb. 2008

2 What is JXTA? JXTA technology is a set of open protocols that enable any connected device on the network, ranging from cell phones and wireless PDAs to PCs and servers, to communicate and collaborate in a P2P manner. started by Sun Microsystems in 2001» now an open source community project» latest specification release 2.5.3, October 2007 ferrante@disi.unige.it, Dottorato in Informatica, XXII ciclo 2

3 Peers group JXTA building block a collection of peers that share service and message Advertisement an XML document which describes a resource (peer, group, pipe, service, etc...) in the P2P network advertisement are published via IP multicast on local networks and using a DHT-like [1] approach on internets JXTA socket and JXTA pipes Identifiers and security ferrante@disi.unige.it, Dottorato in Informatica, XXII ciclo 3

4 JXTA protocol suite source [12] Dottorato in Informatica, XXII ciclo 4

5 JXTA peer types [2] Peers can form both pure and structured P2P [3] networks Minimal-Edge peers Full-Edge peers Super-Peers (optionals):» Relay: stores and forwards messages between peers» Rendezvous: maintains global advertisement indexes and assists other peers with advertisement searches» Proxy: agent for minimal-edge peers Dottorato in Informatica, XXII ciclo 5

6 JXTA and Grid computing Al least 8 FOSS projects: P2P-MPI Jalapeno JNGI jxta-grid OurGrid P3: Personal Power Plant Triana Xeerkat others: NaradaBrokering? Codefarm Galapagos? ferrante@disi.unige.it, Dottorato in Informatica, XXII ciclo 6

7 P2P-MPI "P2P-MPI is a middleware framework which enables to form groups of computing resources to run parallel applications." it does not use JXTA anymore, since version , released in Sep ferrante@disi.unige.it, Dottorato in Informatica, XXII ciclo 7

8 Jalapeno Jalapeno is a distributed computing system utilizing the otherwise wasted idle CPU cycles of desktop PCs and workstations to solve problems too large for any single desktop computer. Jalapeno is the result of a Master's of Science thesis of Niklas Therning [4] no actively mantained ferrante@disi.unige.it, Dottorato in Informatica, XXII ciclo 8

9 JNGI "JNGI is a framework that users can use to submit jobs. These jobs are split and distributed among several peers. The use of JXTA peer groups helps us to localize communication, which in turn improves scaling. Also, by providing redundancy within peer groups, we ensure that failures do not affect job completion." [5] developing seems stopped in 2004 (SVN commit in Apr. 2007) ferrante@disi.unige.it, Dottorato in Informatica, XXII ciclo 9

10 jxta-grid The "JXTA Grid" objective is to enable turnkey JXTA Service managment and leverage when deployed on the SunGrid. vaporware Dottorato in Informatica, XXII ciclo 10

11 OurGrid OurGrid is a free-to-join peer-to-peer grid that has been in production since December is primarily a Grid implementation, not a Grid middleware OurGrid is no longer JXTA-based ferrante@disi.unige.it, Dottorato in Informatica, XXII ciclo 11

12 P3: Personal Power Plant P3 is middleware for distributed computing using volatile PCs, in which participants provide and also use other's computers. developing seems stopped in 2005 Dottorato in Informatica, XXII ciclo 12

13 Triana An open source problem solving environment developed at Cardiff University that combines an intuitive visual interface with powerful data analysis tools. Triana is a visual workflow environment, it uses the GridLab GAT API for job submission and file transfer to/from remote jobs latest release (3.2.3), April 2007 now it uses P2PS instead of JXTA ferrante@disi.unige.it, Dottorato in Informatica, XXII ciclo 13

14 Triana screenshot source [6] Dottorato in Informatica, XXII ciclo 14

15 Triana P2PS P2PS is a lightweight infrastructure for developing P2P style applications. Its architecture is inspired to and provides a subset of functionality of JXTA [7] ferrante@disi.unige.it, Dottorato in Informatica, XXII ciclo 15

16 JXTA vs. P2PS advertisements publishing and queries use separate protocols queries are restricted to predefined advertisement types routing across multiple protocols is expressed explicitly in an XML message envelope allows remote services but also enables service code to be imported by a peer via module implementations queries are themselves advertisements a more expressive discovery language, peers can query for arbitrary advertisement types routing is an endpoint resolver implementation issue all services are remote instances contacted using pipes ferrante@disi.unige.it, Dottorato in Informatica, XXII ciclo 16

17 Xeerkat Xeerkat is a P2P Grid computing project that uses a worker/hiring analogy to establish computational grids. the project switched to XMPP protocol in 2006:» there is a lot more infrastructure support (e.g. Google talk uses XMPP)» easy setup: all you need is a Jabber id on a federated server» there are plenty of implementation for XMPP ferrante@disi.unige.it, Dottorato in Informatica, XXII ciclo 17

18 Summary At least 8 projects started using JXTA to build computational Grid: 1 does nothing 3 are not developed from 2 years or more 4 switched to other protocols Is JXTA not suitable to Grid? ferrante@disi.unige.it, Dottorato in Informatica, XXII ciclo 18

19 Discovery protocol scalability JXTA offers no guarantee about neither the number of peers it will discover, nor the time the discovery is about to take. [8] Dottorato in Informatica, XXII ciclo 19

20 Topology awareness JXTA is an abstract overlay with no knowledge of network topology. [10] For grid users locality latency bandwidth matters Dottorato in Informatica, XXII ciclo 20

21 Performances... evaluations have revealed some weaknesses of JXTA in both the SAN and WAN areas.. [11] Dottorato in Informatica, XXII ciclo 21

22 Others and minors JXTA pipes only handles maximal 64 kbyte per message, so it needs a mechanism to handle large job resource JXTA Sockets have no limit Platform startup was long (about 30s) JXTA bootstrap depends on Rendezvous JXTA based Grids seem fit for problems that can be divided into bag of tasks (no interaction during computation) [9] ferrante@disi.unige.it, Dottorato in Informatica, XXII ciclo 22

23 Acknowledgements Special thanks to Stéphane Genaud (University Robert Schuman of Strasbourg, France) for the precious suggestion and for providing feedback. Thanks to Walfredo Cirne (Universidade Federal de Campina Grande, Brasil). Dottorato in Informatica, XXII ciclo 23

24 References [1] Bernard Traversat, Mohamed Abdelaziz, Eric Pouyoul Bernard. Project JXTA: A Loosely-Consistent DHT Rendezvous Walker. Project JXTA, Sun Microsystems, Inc. [2] Brendon J.Wilson. JXTA. New Riders Publishing, June Available on line (last access ): [3] Jörg Eberspächer and Rüdiger Schollmeier. First and Second Generation of Peer-to-Peer Systems. Peer-to-Peer Systems and Applications, Springer, ISBN [4] Niklas Therning. Jalapeno Decentralized Grid Computing using Peer-to- Peer Technology. Chalmers University of Technology, Department of Computer Engineering, Göteborg, [5] Jean-Baptiste Ernst-Desmulier, Julien Bourgeois, Minh Thanh Ngo, Francois Spies, and Jerome Verbeke2. Simulating and Optimizing A Peer-to-Peer Computing Framework. Parallel and Distributed Processing Symposium, IPDPS th International ferrante@disi.unige.it, Dottorato in Informatica, XXII ciclo 24

25 References [6] Triana User Guide, Available on line (last access ): [7] Ian Wang. P2PS (Peer-to-Peer Simplified). In Proceedings of 13th Annual Mardi Gras Conference - Frontiers of Grid Applications and Technologies. Louisiana State University, pages 54-59, February Available on line (last access ): [8] Gabriel Antoniu, Loïc Cudennec, Mike Duigou, and Mathieu Jan. Performance scalability of the JXTA P2P framework in Proc. 21st IEEE International Parallel & Distributed Processing Symposium (IPDPS 2007). Long Beach, CA, USA. Preliminary version available on line (last access ): [9] Henri Mikkonen. Enabling Computational Grids Using JXTA-technology. Helsinki University of Technology T , Apr Available on line (last access ): ferrante@disi.unige.it, Dottorato in Informatica, XXII ciclo 25

26 References [10] Stéphane Genaud, Choopan Rattanapoka. Large-Scale Experiment of Coallocation Strategies for Peer-to-Peer SuperComputing in P2P-MPI. 22 nd IEEE International Parallel and Distributed Processing Symposium, Fifth High- Performance Grid Computing Workshop, Miami, USA, 14/04/2008. Submitted version available on line (last access ): [11] Gabriel Antoniu, Mathieu Jan, David A. Noblet. Enabling JXTA for High Performance Grid Computing. Rapport de recherche de l'inria RR-5488, Feb 2005, available on line (last access ): [12] Geoffrey Fox, Shrideep Pallickara and Xi Rao. Towards Enabling Peer to Peer Grids. Journal of Concurrency and Computation: Practice & Experience. ACM JavaGrande ISCOPE Special Issue. Volume 17, Issue 7-8, Pages , available on line (last access ): Dottorato in Informatica, XXII ciclo 26