Petr Holub <hopet@ics.muni.cz> Laboratory of Advanced Networking Technologies CESNET, Czech Republic Masaryk University Internet2 Spring Member Meeting 2010 Washington, DC, 2010 04 26 1/15
Motivation High-definition collaborative environments Using high-quality, high-definition media streams to build collaborative environment bandwidth demands comparable to network link speeds (10 GbE) requires careful planing and configuration of infrastructure: UltraGrid: DXT-compressed HD video over IP: 250 Mbps uncompressed 4:2:2 HD video over IP: 1.5 Gbps uncompressed 4:2:2 4K video over IP: 6 Gbps lacks adaptivity to changing networking conditions Large numbers of components needed to build the environment 2/15
Motivation & E2E Networks On-demand circuits require allocation Application-driven network allocation if we can control applications, why not the network? user should not be forced to allocate it manually is ideal for implementing this it s just another component to orchestrate framework is general enough to implement it 3/15
Design Principles Coming from low-latency high-bandwidth multi-point media transmission systems maximization of quality at given instant support for user-driven multi-point data distribution Application abstraction producers distributors consumers consumers specify source site (distribution) tree-placement problem replaceable as plug-in: custom application description & scheduler 4/15
Design Principles Ad hoc orchestration Bitrate comparable to link capacity N P-complete problem constraint-based or MIP solvers for full problem research on approximations End-to-end perspective the system has to work just based the configuration of nodes additional information may be provided (e.g., topology) (n 2 n) end-to-end links 5/15
Design Principles User-empowered operation without administrative privileges on the infrastructure Self-organization and adaptivity immediate stabilizing reactions to disruptive changes of infrastructure prudent reactions to any non-disruptive change Support for legacy applications Modularity 6/15
Building Blocks... yes, network is there, but it s (n 2 n) links, thus only schematics 7/15
Self-organization in Dynamic media streams scheduling: Schedule media streams produced by media applications on particular network links (plan step) scheduling media streams using bandwidth close to physical link capacity is hard scheduling based on set of constraints producer constraints, consumer constraints, data distribution constraints, network link constraints Resilience: ability to react to changes/failures in the network infrastructure, media applications etc. achieved by monitoring, infrastructure changes and/or failures lead to new media streams schedule 8/15
& DCN DCN interfaces web interface for humans web service interface (w/ security!) for machines Initializing and tearing circuits network link can have associated one or more lambda links DCN-specific lambda link: two endpoints (including identification, IDC and (tagged untagged) interface) and requested bandwidth Integration of on-demand circuits with brings another level of uncertainty into scheduling should I count on a network link I m uncertain to get? should I preallocate the network? (but there are n2 n 2 bidirecitonal links!) 9/15
Node Operations Diagram join join U isagc init Multiverse Universe U send topology start monitoring!isagc AGC joinagc after joining a universe, an exsting AGC is either joined or new one is created sends topology to the AGC, including end-to-end network topology node configuration (site membership, interfaces, network connections, available applications) requested sites for receiver applications waits for a new events from AGC (e.g., new plan) and monitors infrastructure to send updates to AGC 10/15
AGC Diagram init configure monitoring topology change topology monitor MatchMaker init network plan distribution wait for stabilization better plan parallel circuit monitor node implements plan MatchMaker finds suitable source based on configuration of each receiver (if possible) builds plan based on available network features (links, reflectors) network initialization added for end-to-end circuit initialization blocking stage to make sure we have the network prior to application startup 11/15
Sample Applications CINEPOST movie post-production 12/15
Sample Applications Telemedicine usecase NLM demo DCN - Presentation With Just-In-Time Medical demos National LIbrary of Medicine Bethesda, MD 20 Memorial Hermann Texas Medical Center location Houston, TX VLAN 3105 - Ultragrid Video (10.1.1.0/24) VLAN 3205 - Monitoring (10.10.10.0/24) VLAN 3305 Polycom/Ultragrid (10.20.20.0/24) 21 4 static VLAN config Crystal Gateway Marriott Arlington, VA Ultragrid Sender Polycom 30 vlan 3305 29 Ultragrid Receiver static VLAN config vlan 3305 NLM darma-sw1 Switch NLM darma-sw2 Switch DRAGON clpk-raptor Switch 51 52 static VLAN config DRAGON mcln-raptor Switch vlan 3205 LEARN DCN Switch I2 DCN Washington DCN I2 DCN Houston Internet2 1 Ann Arbor monitoring Polycom vlan 3305 Hotel HP2848 Switch MAX clpk-6509 Switch production IP VLANs: 246,247,248 IP IDC circuit endpoints: tagged nlm.nih.gov or urn:ogf:network:domain=dragon.maxgigapop.net:node=clpk:port=1-3-3:link=* tagged smm09.internet2.edu or urn:ogf:network:domain=dragon.maxgigapop.net:node=clpk6509:port=0-4-16:link=* untagged utest.anna.internet2.edu or urn:ogf:network:domain=anna.internet2.edu:node=raptor1:port=utest:link=* untagged memorialhermann.org or urn:ogf:network:domain=gigapop.gen.tx:node=switch1:port=0-1-22:link=* MAX clpk-t640 Router MAX lvl3-t640 Router I2 Router Washington MAX/DRAGON IDC URL: https://idc.dragon.maxgigapop.net/axis2/services/oscars Wed Apr 22 2009 13/15
Notes on Implementation State of the goal is to have usable proof-of-concept implementation research on self-organization, application orchestration, scheduling real-life applications (science, education) https://www.sitola.cz/ Open-source, Java, JXTA Mapping to EAGER producer: data source distributors: viz computation nodes consumers: viz machines 14/15
Thank you for your attention! Q?/A! <hopet@ics.muni.cz> 15/15