DWDM-RAM: DARPA-Sponsored Research for Data Intensive Service-on-Demand Advanced Optical Networks

Transcription

1 DWDM-RAM: DARPA-Sponsored Research for Intensive -on-demand Advanced Optical Networks DWDM

2 Optical Abundant Bandwidth Meets Grid The Intensive App Challenge: Emerging data intensive applications in the field of HEP, astro-physics, astronomy, bioinformatics, computational chemistry, etc., require extremely high performance and long term data flows, scalability for huge data volume, global reach, adjustability to unpredictable traffic behavior, and integration with multiple Grid resources. Response: DWDM-RAM An architecture for data intensive Grids enabled by next generation dynamic optical networks, incorporating new methods for lightpath provisioning. DWDM-RAM is designed to meet the networking challenges of extremely large scale Grid applications. Traditional network infrastructure cannot meet these demands, especially, requirements for intensive data flows PBs Storage -Intensive s DWDM-RAM Abundant Optical Bandwidth Tbs on single fiber strand

3 DWDM-RAM Architecture The DWDM-RAM architecture identifies two distinct planes over the dynamic underlying optical network: 1) the Grid Plane that speaks for the diverse requirements of a dataintensive application by providing generic data-intensive interfaces and services and 2) the Network Grid Plane that marshals the raw bandwidth of the underlying optical network into network services, within the OGSI framework, and that matches the complex requirements specified by the Grid Plane. At the application middleware layer, the Transfer (DTS) presents an interface between the system and an application. It receives high-level client requests, policy-and-access filtered, to transfer specific named blocks of data with specific advance scheduling constraints. The network resource middleware layer consists of three services: the Handler (DHS), the Network Resource (NRS) and the Dynamic Lambda Grid (DLGS). s of this layer initiate and control sharing of resources.

4 DWDM-RAM Architecture Information -Intensive s DTS API Middleware Layer NRS Grid API Network Resource Middleware Layer OGSI-ification API Connectivity and Fabric Layers Handler Transfer Basic Network Resource Network Resource Network Resource Scheduler Dynamic Lambda, Optical Burst, etc., Grid services Optical path control Center 1 1 n n Dynamic Optical Network OMNInet Center

5 DWDM-RAM vs. Layered Grid Architecture Layered DWDM-RAM Layered Grid DTS API Middleware Layer NRS Grid API Network Resource Middleware Layer OGSI-ification API Transfer Network Resource Path Coordinating multiple resources : ubiquitous infrastructure services, app-specific distributed services Sharing single resources : negotiating access, controlling use Talking to things : communication (Internet protocols) & security Collective Resource Connectivity & Fabric Layer Optical Plane Connectivity s ling things locally : Access to, & control of, resources Fabric

6 DWDM-RAM Architecture DATA DATA GRID GRID SERVICE SERVICE PLANE PLANE GRID Request NETWORK NETWORK SERVICE SERVICE PLANE PLANE Network Request ODIN OmniNet Plane ODIN Center Path storage switch L2 switch UNI-N Optical Optical Network Network Connection Transmission Plane 1 n 1 n 1 n UNI-N L3 router Path Path Center

7 OMNInet Core Nodes UIC Northwestern U Cluster 8x1GE 4x10GE Passport OPTera Metro 5200 Optical Switching Platform Optical Switching Platform 4x10G E Passport 8x1GE Cluster StarLight CA*net3--Chicago 8x1GE 4x10GE 4x10GE 8x1GE Loop Cluster Passport Optical Switching Platform Optical Switching Platform Passport Closed loop A four-node multi-site optical metro testbed network in Chicago -- the first 10GE service trial! A test bed for all-optical switching and advanced high-speed services OMNInet testbed Partners: SBC, Nortel, icair at Northwestern, EVL, CANARIE, ANL

8 10/100/ GIGE PP W Taylor 10 GE 10 GE Optera Gb/s TSPR Photonic Node OMNInet NWUEN-1 Sheridan Photonic 10 GE Node PP 10/100/ 10 GE GIGE Optera Gb/s TSPR Grid Clusters CAMPUS FIBER (16) CAMPUS FIBER (4) EVL/UIC OM5200 INITIAL CONFIG: 10 LAMBDA (all GIGE) LAC/UIC OM5200 Optera 5200 OFA NWUEN-3 NWUEN-4 NWUEN-2 Photonic Node NWUEN OFA 5200 OFA 5200 OFA 8x8x8 Scalable photonic switch Photonic Trunk side 10 G WDM Node OFA on all trunks NWUEN-9 NWUEN-5 Lake Shore 10 GE 10 GE Optera Gb/s TSPR PP S. Federal 10 GE 10 GE Optera Gb/s TSPR NWUEN-6 PP Optera Metro 5200 OFA 10/100/ GIGE NWUEN-7 10GE LAN PHY (Dec 03) 10/100/ GIGE StarLight Interconnect with other research networks To Ca*Net nm 10 GbE WAN PHY interfaces CAMPUS FIBER (4) INITIAL CONFIG: 10 LAMBDAS (ALL GIGE) TECH/NU-E OM5200 Fiber NWUEN Span Length Link KM MI 1* * * Fiber in use Fiber not in use

9 DWDM-RAM Components Management s OGSA/OGSI compliant, capable of receiving and understanding application requests, have complete knowledge of network resources, transmit signals to intelligent middleware, understand communications from Grid infrastructure, adjust to changing requirements, understands edge resources, on-demand or scheduled processing, support various models for scheduling, priority setting, event synchronization Intelligent Middleware for Adaptive Optical Networking OGSA/OGSI compliant, integrated with Globus, receives requests from data services and applications, knowledgeable about Grid resources, has complete understanding of dynamic lightpath provisioning, communicates to optical network services layer, can be integrated with GRAM for co-management, architecture is flexible and extensible Dynamic Lightpath Provisioning s Optical Dynamic Intelligent Networking (ODIN), OGSA/OGSI compliant, receives requests from middleware services, knowledgeable about optical network resources, provides dynamic lightpath provisioning, communicates to optical network protocol layer, precise wavelength control, intradomain as well as interdomain, contains mechanisms for extending lightpaths through E-Paths - electronic paths, incorporates specialized signaling, utilizes IETF GMPLS for provisioning, new photonic protocols

10 Design for Scheduling Network and Transfers scheduled Management schedule coordinates network, retrieval, and sourcing services (using their schedulers) Scheduled data resource reservation service ( Provide 2 TB storage between 14:00 and 18:00 tomorrow ) Network Management has own schedule Variety of request models: Fixed at a specific time, for specific duration Under-constrained e.g. ASAP, or within a window Auto-rescheduling for optimization Facilitated by under-constrained requests Management reschedules for its own requests or on request of Network Management

11 Example: Lightpath Scheduling Request for 1/2 hour between 4:00 and 5:30 on Segment D granted to User W at 4:00 3:30 4:00 W 4:30 5:00 5:30 New request from User X for same segment for 1 hour between 3:30 and 5:00 Reschedule user W to 4:30; user X to 3:30. Everyone is happy. 3:30 3:30 4:00 4:00 X 4:30 5:00 5:30 W X 4:30 5:00 5:30 Route allocated for a time slot; new request comes in; 1st route can be rescheduled for a later slot within window to accommodate new request

12 End-to-end Transfer Time F i l e t r a n s f e r r e q u e s t a r r i v e s 20GB File Transfer Set up: 29.7s Transfer: 174.0s Tear down: 11.3s F i l e t r a n s f e r d o n e, p a t h r e l e a s 0.5s 3.6s 0.5s 25s 0.14s 174s 0.3s 11s P a t h A l l o c a t i o n r e q u e s t O D I N S e r v e r P r o c e s s P a t h i I n D g r e t u r n e d N e t w o r k r e c o n f i g u r a t i o n F T P s e t u p t i me D a t a T r a n s f e r 2 0 G B P a t h D e a l l o c a t i o n r e q u e s t O D I N S e r v e r P r o c e s s i n g

13 20GB File Transfer