UCLA Grid Portal (UGP) A Globus Incubator Project OGF 2007 Documentation at: http://www.ucgrid.org Prakashan Korambath & Joan Slottow Research Computing Technologies UCLA Academic Technology Services
UGP (UCLA Grid Portal) Joins computational clusters into a Grid Built on top of: Globus Toolkit 4.n GridSphere Portlet Framework 2.n (production systems) and 3.n (under development) Zimbra, YUI, and GWT toolkits Shibboleth Tomcat MySQL
Motivation Need to share resources among the campus clusters: Diverse cluster ownership and operation A number of users have login ids on multiple clusters
Design Goals: Do not change the way individuallymanaged clusters do business. Web Portal: Hide certificates and the complexity of the Grid from users. No software for users to install. Single sign on. Common web interface to all clusters.
Single Campus Architecture Head node Cluster I Credential mapped to local ID Grid Portal Grid Appliance https Uniform browser based interface Head node Cluster II Credential mapped to local ID MyProxy Server Storage Server ION Visualization Server Grid Appliance
Demo 1. 2.
UC Grid Multi-Campus Architecture UC Grid CA UC Register Service UC User Database UC MyProxy Single CA is shared among all campuses UC Portal A C Storage Server UCLA Portal UCLA MyProxy A C C A C A C C A A UCSB MyProxy UCSB Portal Storage Server All appliances talk to both their campus portal and the UC portal UCI Portal UCI MyProxy Storage Server
The UC Grid Each user of a Campus Grid can also use the UC Grid Portal Users can: work with clusters from all the campuses transfer files across the campuses. Use pooled resources across the campuses.
Demo
User Types vs. Portals Portal View Campus Portal UC Portal U s e r T y p e Pool-only User Cluster User Can submit jobs to the campus pool Can use those clusters on campus he/she can access Can submit jobs to the campus pool Can submit jobs to campus and UC pools Best choice for those with access to clusters on different campuses -- can use all clusters, UC-wide, he/she can Access Can submit jobs to campus and UC pools
Grid Portal Services and User Interface Resource Discovery Data Manager (includes editor, visualization, upload/download, and ftp) Grid Development Environment Job Services Submit Job, view status, process output Applications vs. Generic jobs appform Interactive: interactive apps, xterm, ssh Other Grids: access to Teragrid
Demo
Pool Job Submission UGP: Chooses the best cluster for the job Maps the portal user to a guest user Generates the proxy certificate for the guest user Stages the input files to the target cluster Submits the job to the target cluster Retrieves the output for downloading
Demo
Interactive Applications via VNC Pioneers in this area are: Purdue University s nanohub University of Florida s In-VIGO University of Texas Advanced Computer Center (TACC)
There is 1 Grid Portal One Grid Appliance per cluster Multiple VNC servers can be Running on an Appliance simultaneously Firewall User Portal Web Server Grid Appliance Compute Node Web Browser VNC Viewer applet Serve Applet Because of Applet security, the Applet can only talk to the Portal machine Tomcat UGP iptables Port forwarding GRAM Globus Public Network Fork Job iptables Port forwarding SSH Private Network VNC server Runs Under theuser s id GUI App
Demo
appform Previous Work Purdue/nanoHub Rappture San Diego Supercomputer Center (SDSC) and National Biomedical Computation Resource (NBCR) Project Gemstone
Files Needed for appform app_job.xml rsl.xsl app_form.xml Job Parameters Tab HTML + JavaScript + YUI for tabbed page Input Generator Tab app_form_input.xsl File.txt Input file for app trans.xsl app_job.xml, app_form.xml and app_forrm_input.xsl must be written for each app.
Demo
Want to see more? Need more info? Want to try UGP hands on? Come to our talk 5:00-6:30 in Leonesa II UGP (the UCLA GRID Portal Software and the UC System Grid Portals