Virtual Organizations in Academic Settings

Transcription

1 Virtual Organizations in Academic Settings Alan Sill Senior Scientist, Texas Internet Grid for Research and Education and Adjunct Professor of Physics Texas Tech University Dec. 6, 2006 Internet2 Fall Members Meeting Chicago, Illinois, USA

2 Outline Large-scale grid organizations Local Regional National and International Interface between Virtual Organizations and Academic institutions Identity management and trust federation issues Examples from state-wide and regional projects

3 Large-scale Grid Organizations Just a sampling here of the most generalpurpose ones. Tip of the iceberg. There are hundreds of large-scale grids, and thousands of general participating gridoriented organizations....

4 TAG PMA, the International Grid Trust Federation, and the CA TAGPMA APGridPMA Accreditation Process Alan Sill Texas Tech University on behalf of The Americas Grid Policy Management Authority (TAG PMA) Internet2 Members Meeting April 24-26, 2006

5 Identity Management for Large-Scale Grids International projects coordinate through IGTF. TAGPMA covers North, South and Central America. Extending this to mesh with local campus IdM systems is a challenge to be solved. Charter includes non-pki The Americas Grid Policy Management Authority 18 members 7 countries + LAC catch-all CA

6 Large-scale Grid Successes Well over 1 M jobs/month run successfully through LCG and OSG on a regular basis. No large-scale security incidents. Teragrid serving 1000s of VO/PI groups, want 10^4. Web services, science portals growing rapidly. Educational applications growing rapidly. Increasing sophistication of user community.

7 Local, Regional and State- Wide Grids Local campus grids can represent a significant resource. Generally, these are not operated for the benefit of non-campus organizations. Attempts to capture these and represent them to offcampus organizations present significant challenges. Security, access and identity management issues.

8 Local Campus Cycle Scavenging Example: TTU has had a campusbased compute and data grid since early Condor pools easy to set up, share between and among campuses. BLAST ATLC/ BA Zones BLAST 325+ Windows Nodes 228 Windows Nodes Math Zone PRIMES Primes, other apps Reese High-Performance Computing Center HPCC Zone Linux Clusters (132 nodes) APPS TechGrid Bootstrap Server Batch Queue Server Batch Queue Server Texas Tech Compute Grid (Interfaces to other campus grids...) BOINC, etc. also a significant source of CPU. Interfacing to meta-scheduler is the primary issue.

9 Regional and State-Wide Projects I will give several examples from Texas-based and SURA efforts. Aggregation of significant resources in terms of cpu, data and intellectual capital is possible. Campus-based efforts interfacing to state-wide and regional projects represent the lowest tier in our cross-institutional virtual organization interface.

10 High Performance Computing Across Texas Membership consists of high performance computing facilities across academic, commercial and research fields. Has existed since 1999 to provide a forum for discussion and common projects. Includes highest-performance computing and data facilities in the state.

11 HiPCAT Projects Texas Internet Grid for Research and Education: HiPCAT High Performance Computing Across Texas TIGRE General-purpose grid infrastructure and middleware. Texas High Energy Grid: User community for high energy physics, nuclear physics, astrophysics and nuclear medicine.

12 Lone Star Education and Research Network (LEARN) Funded by same legislative bill as TIGRE. Connects superset of 33 Texas Higher Education institutions, consortia and university systems. Manages relationship with Internet2, NLR, other regional and commercial providers. 2,100 miles, POPs in 13 cities so far. 10 GbE, 1GbE and lambda service.

13 LEARN Topology As of May 2006: OPERATIONAL: Denton - Dallas - College Station - Houston - Austin - San Antonio TESTING: Dallas - Fort Worth - Waco - Austin DESIGNING: Austin - San Antonio (backup service) UNDER CONTRACT El Paso - San Antonio (10 Gbps lambda on NLR) & Houston - Corpus Christi (LEARN Dark Fiber)

14 SURAGrid Extends beyond original SURA geographic region. Includes many states and universities not otherwise covered by existing OSG and other funded efforts. Received significant IBM equipment donation. Coastal ocean-surge modeling (SCOOP) among primary application development/deployment efforts.

15 Other Constituent Communities Texas Digital Library Project: Self-funded effort on comprising institutions that participate in TIGRE. Interested in many similar networking, connectivity and identity-management issues. Partnership potential on data curation, transfer, access and secured storage. Also beginning connections to Health Sciences Centers and medical facilities throughout the state. Some of the most exciting applications of TIGRE so far involve medical work.

16 TIGRE Application Areas Steering-committee selected targeted application areas in Biosciences and medicine, Atmospheric / Air quality modeling, Energy exploration / Geosciences. Demo applications done or in progress so far in biomaterials analysis, cancer radiation modeling, weather model data transfer, etc.

17 Example from Cancer Radiation Therapy Modeling Excellent interaction with Health Sciences Center and medical education fields. Good fit to grid computing methods. Designed to support new proton beam therapy at MD Anderson Cancer Center in Houston. Involvement from local Radiation Oncology and Medical Physics communities. Identity management, security, privacy, license and export control requirements.

18 Other Application Areas (Science Driven) Ultra-centrifuge data analysis. Chemical modeling. Weather atmospheric modeling and redundant data backup. Science portal development. Metascheduling for broad science use of shared resources across all machine and queue types.

19 TIGRE STATUS AND PROGRESS TIGRE Deliverables: Quick Build YEAR 1 Q1: Project plan Web site Certificate Authority Minimum testbed requirements Select 3 driving applications Q2: Alpha portal Q3:... IN PROGRESS NOW! Define software stack Distribution Mechanism Simple demo of 1 TIGRE app Q4: Alpha client software distributed YEAR 2 Q1: Alpha customer management services system deployed & demonstrated Q2: Global grid scheduler deployed Q3: Stable software available (only bug fixes after this) Required services TIGRE specified Q4: Complete hardening of software Complete documentation Finalized procedures and policies to join TIGRE & document Demonstrate TIGRE at SC... Making Excellent Progress!

20 Virtual Organizations With Which We Interact High Energy Physics experiments National Institutes of Health CaBiG (Cancer BioInformatics Group) Industry organizations Individual universities University systems Private organizations Individual research groups Collections of the above

21 We need tools with which we can interact with the above organizations in terms of identity management, privacy, security and virtual organization management.

22 Tools we use to accomplish this: VOMS/VOMRS (virtual organization management). GridSphere (portal development). Virtual Data Toolkit (grid middleware; web-services only deployment for TIGRE). Mailing list, Plone and wiki software. Tools we are looking closely at: GridShib and equivalents. (Note UT system has a Shibboleth deployment.) CaGrid. MyVOCS.

23 We should remember why we are here: Organizing work and enabling people to work in discipline-specific ways across organizational boundaries. Another word for this is academics. This is the core function of our individual institutions and of our collective research efforts. It is NOT optional, and to do it we need good tools.