UCLA Grid Portal (UGP) A Globus Incubator Project

Transcription

1 UCLA Grid Portal (UGP) A Globus Incubator Project OGF 2007 Documentation at: Prakashan Korambath & Joan Slottow Research Computing Technologies UCLA Academic Technology Services

2

3 UGP (UCLA Grid Portal) Joins computational clusters into a Grid Built on top of: Globus Toolkit 4.n GridSphere Portlet Framework 2.n (production systems) and 3.n (under development) Zimbra, YUI, and GWT toolkits Shibboleth Tomcat MySQL

4 Motivation Need to share resources among the campus clusters: Diverse cluster ownership and operation A number of users have login ids on multiple clusters

5 Design Goals: Do not change the way individuallymanaged clusters do business. Web Portal: Hide certificates and the complexity of the Grid from users. No software for users to install. Single sign on. Common web interface to all clusters.

6 Single Campus Architecture Head node Cluster I Credential mapped to local ID Grid Portal Grid Appliance https Uniform browser based interface Head node Cluster II Credential mapped to local ID MyProxy Server Storage Server ION Visualization Server Grid Appliance

7 Demo 1. 2.

8 UC Grid Multi-Campus Architecture UC Grid CA UC Register Service UC User Database UC MyProxy Single CA is shared among all campuses UC Portal A C Storage Server UCLA Portal UCLA MyProxy A C C A C A C C A A UCSB MyProxy UCSB Portal Storage Server All appliances talk to both their campus portal and the UC portal UCI Portal UCI MyProxy Storage Server

9 The UC Grid Each user of a Campus Grid can also use the UC Grid Portal Users can: work with clusters from all the campuses transfer files across the campuses. Use pooled resources across the campuses.

10 Demo

11 User Types vs. Portals Portal View Campus Portal UC Portal U s e r T y p e Pool-only User Cluster User Can submit jobs to the campus pool Can use those clusters on campus he/she can access Can submit jobs to the campus pool Can submit jobs to campus and UC pools Best choice for those with access to clusters on different campuses -- can use all clusters, UC-wide, he/she can Access Can submit jobs to campus and UC pools

12 Grid Portal Services and User Interface Resource Discovery Data Manager (includes editor, visualization, upload/download, and ftp) Grid Development Environment Job Services Submit Job, view status, process output Applications vs. Generic jobs appform Interactive: interactive apps, xterm, ssh Other Grids: access to Teragrid

13 Demo

14 Pool Job Submission UGP: Chooses the best cluster for the job Maps the portal user to a guest user Generates the proxy certificate for the guest user Stages the input files to the target cluster Submits the job to the target cluster Retrieves the output for downloading

15 Demo

16 Interactive Applications via VNC Pioneers in this area are: Purdue University s nanohub University of Florida s In-VIGO University of Texas Advanced Computer Center (TACC)

17 There is 1 Grid Portal One Grid Appliance per cluster Multiple VNC servers can be Running on an Appliance simultaneously Firewall User Portal Web Server Grid Appliance Compute Node Web Browser VNC Viewer applet Serve Applet Because of Applet security, the Applet can only talk to the Portal machine Tomcat UGP iptables Port forwarding GRAM Globus Public Network Fork Job iptables Port forwarding SSH Private Network VNC server Runs Under theuser s id GUI App

18 Demo

19 appform Previous Work Purdue/nanoHub Rappture San Diego Supercomputer Center (SDSC) and National Biomedical Computation Resource (NBCR) Project Gemstone

20

21 Files Needed for appform app_job.xml rsl.xsl app_form.xml Job Parameters Tab HTML + JavaScript + YUI for tabbed page Input Generator Tab app_form_input.xsl File.txt Input file for app trans.xsl app_job.xml, app_form.xml and app_forrm_input.xsl must be written for each app.

22 Demo

23 Want to see more? Need more info? Want to try UGP hands on? Come to our talk 5:00-6:30 in Leonesa II UGP (the UCLA GRID Portal Software and the UC System Grid Portals