(0 of 12) High Performance λnetworking for Grid Applications. Cees de Laat

Transcription

1 High Performance λnetworking for Grid Applications Cees de Laat (0 of 12)

2 λeu High Performance Networking for Grid Applications Cees de Laat λaat SURFnet University of Amsterdam SARA NIKHEF NCF (1 of 12)

3 Contents of this talk λ This slide is intentionally left blank

4 (2 of 12) I am not going to talk about this here, it feels like preaching to the pope VLBI λ

5 # u s e r s A. Lightweight users, browsing, mailing, home use Need full Internet routing, one to many B. Business applications, multicast, streaming, VPN s, mostly LAN Need VPN services and full Internet routing, several to several + uplink C. Special scientific applications, computing, data grids, virtual-presence Need very fat pipes, limited multiple Virtual Organizations, few to few A ADSL B GigE λbw requirements F(t) C

6 So λwhat are the facts Costs of fat pipes (fibers) are one/third of equipment to light them up Is what Lambda salesmen tell me Costs of optical equipment 10% of switching 10 % of full routing equipment for same throughput 100 Byte 40 Gb/s -> 20 ns to look up in 140 kentries routing table (light speed from me to you!) Big sciences need fat pipes Bottom line: create a hybrid architecture which serves all users in one consistent cost effective way (4 of 12)

7 (5 of 12) λ Scale

8 # λ The only formula s λ 200 e(t 2002) rtt Now, as having been a High Energy Physicist we set c = 1 e = 1 h = 1 and the formula reduces to: # λ 200 e(t 2002) rtt (6 of 12)

9 CLASS A B C # λ SCALE 200 e(t 2002) rtt λservices 2 Metro Switching/ routing VPN s, (G)MPLS dark fiber Optical switching 20 National/ regional Routing VPN s Routing Lambda switching 200 World ROUTER$ Routing Sublambdas, ethernetsdh (7 of 12)

10 SURFnetλ Lambda s fibers (old already) (8 of 12) See Erik s talk

11 Current technology λ+ (re)definition Current (to me) available technology consists of SONET/SDH switches, 10 gig ethernet and dark fiber environments Optical switch on the way (customs)! DWDM+switching included Starlight/NetherLight deploy VLAN s on Ethernet switches to connect [exactly two] ports (but also routing) We want to understand routerless limited environments So redefine a λ as: (9 of 12) a λ is a pipe where you can inspect packets as they enter and when they exit, but principally not when in transit. In transit one only deals with the parameters of the pipe: number, color, bandwidth

12 Long haul λ TDM λ R Architectures - L1 - L3 Internet Internet R SW L2 VPN s R (10 of 13) R Bring plumbing to the users, not just create sinks in the middle of nowhere

13 How low can you go? (11 of 13) Application Endpoint A Router Ethernet SONET DWDM fiber Local Ethernet POS NetherLight MEMS Regional dark fiber Application ONS Endpoint B Trans-Atlantic TransLight

14 (12 of 14) Application Middleware Transport Application Middleware Transport High bandwidth app UvA SURFnet5 3 rd party carriers UBC Vancouver ams chi λ Switch lambda for high bandwidth 2.5Gb Router lambda applications GbE Bypass of production network Middleware may request (optical) Router Lambda pipe Switch Router RATIONALE: GbE Lower the cost of transport per Router packet Lambda Switch Router GbE Router Switch

15 (13 of 15) Layer 2 VPN Univ B Univ A λdistributed L2 SN5 CHICAGO lambda Univ X SN5 A DAM Univ Y

16 (14 of 15) NetherLight DAS: 32*2cpu s IBM Myrinet 1 Gbs 100Mbs SURFnet backbone Lambda s to Chicago, Geneve, Praha, NYC London calient 10 Gbs F O R C E 1 0 Fat pc server E X T R E M E Dark fiber To Dwingeloo 1 Gbs 4 HP servers UvA/NikHEF/SARA

17 (14b of 15) Problem Solving Environment Applications and Supporting Tools Application Development Support High performance computing and Processor memory co-allocation Security and Generic AAA Optical Networking Researched in other programlines Imported from the Globus toolkit Collective Grid Services Brokering Global Queuing Co- Scheduling Data Cataloguing Auditing Authorization Monitoring Fault Management Common Grid Services Grid Information Service Uniform Resource Access Global Event Services Uniform Data Access Data Replication Communicatio n Services Grid Security Infrastructure (authentication, proxy, secure transport) Communication Fabric Grid task initiation Grid access (proxy authentication, authorization, initiation) Local Resources Resource Manager CPUs Resource Manager Monitors layers of increasing abstraction taxonomy Resource Manager On-Line Storage Resource Manager Scientific Instruments Resource Manager Tertiary Storage Resource Manager Highspeed Data Transport Resource Manager net QoS

18 4 λpolicy API Generic AAA server Rule based engine 2 Application Specific Module 5 Service Starting point 3 Accounting Metering 3 RFC , 3334, policy draft 5 3 Data Policy Data Acct Data (14c of 15) PDP PEP

19 (Future) λprojects National: NCF Grid project VLE GigaPort-NG LOFAR European DataGrid DataTAG International NetherLight StarLight AnyLight, LowLight, BackLight Optiputer Research: (14d of 15) Models of Lambda networking Transport AAA

20 BW*RTT C Transport λin the corners Needs more App & Middleware interaction B For what current Internet was designed? Full optical future A # FLOWS (14e of 15)

21 (15 of 15) λ The END Thanks to SURFnet: Kees Neggers UIC&iCAIR: Tom DeFanti, Joel Mambretti CANARIE: Bill St. Arnaud This work is supported by: SURFnet EU-IST project DATATAG