Software solutions for Virtual Infrastructures provisioning and management

Transcription

1 Software solutions for Virtual Infrastructures provisioning and management Pascale Vicat-Blanc Primet With the participation of Guilherme Koslovski, Fabienne Anhalt, Sébastien Soudan, Romaric Guillier, Philippe Martinez INRIA University of Lyon 1 Context (1): Infrastructure as a Service Convergence of computing and communication Expansion of cloud computing New models and tools are needed to help users & service providers to specify, configure, deploy, manage their virtual infrastructures and their applications

2 Context (2): Network virtualization Decouples the physical hardware from the service level M-to-N mapping (M real resources, N virtual resources) to deliver greater resource/infrastructure utilization and flexibility Solid basement for customized «network buildings» Parallel networks with customized routing, traffic engineering, protocols Parallel virtual networks, slices, or VPXI Tube TeleP P2P Game HTCP RCP IP IP IMG CDN Chat Grid BIC cubic TCP VoD UDT IP IP IPv4 IPv6 Virtualisation layer Physical layer Lyon Amsterdam Berlin Palo Alto Genève Tokyo Bengalore Benjing

3 Virtual Infrastructures Framework VPXI editor VPXI admin HIPerNet engine HIPerNet software principle VPXI A VPXI B HIPerNET engine: select, allocate, schedule nodes&channels

4 Virtual Infrastructures Software solutions IT & Network resource virtualisation VPXI: Virtual Private execution Infrastructure VXDL: Virtual Infrastructure description Time-aware Virtual Infrastructure Allocation Security model Scenario description Execute a distributed application in a virtual infrastructure Application: NAS benchmark (version 3.3) MPI 7 applications: bt, cg, ep, is, lu, mg, sp Physical substrate: Grid 5000 platform Steps: 1 Create a substrate of virtualized resources 2 VPXIs specification 3 VPXIs allocation and deployment 4 Execution

5 G5K: large scale experimental facility (since 2005) See Private link 10Gb/s to NL (Geysers project) Private 10Gb/s link to JP (Petaflow project) 5000 cores, distributed over 9 sites in France Various types of servers Sophia 10 Gbps connections over RENATER network DWDM + 10GE in the core Different local network technologies 570 users 17 laboratories involved 1) Bootstrap: virtualized substrate creation Underlying physical ICT infrastructure Virtualized substrate: VXspace 10

6 Virtual infrastructures: VPXI concept We define a VPXI as a time-limited interconnection of virtual computing resources through a virtual private network Application-mapping principles 12

7 2) VPXI specification VXDL language Specification of virtual resources sets Specification of virtual topology Specification of time line Example: Specification of three VPXIs : Same resource set & topology, different link rates 4 virtual resources: VN 1, VN 2, VN 3, VN 4 2 virtual routers: VR 5 and VR 6 VN 1 VN 2 VN 3 VN 4 VPXI-3 VPXI-2 VPXI-1 VN X VR Y VR 5 VR Mbps 200 Mbps 75 Mbps 150 Mbps 50 Mbps 100 Mbps 13 3) Allocation and creation VXDL VN 1 VN 2 file VXDL VN 1 VN 2 VN 1 file VXDL VN 2 file submit VN 3 VN 4 VN 3 VN 4 VN 3 VN 4 HIPerNet engine HIPerNET framework is a component-based software technology. Set of independant & replaceable modules to: Parse VXDL requests Allocate & schedule VPXIs Control of VPXIs & Virtual resources Manage users & security

8 4) VPXI deployment & configuration VN 1 VN 2 HIPerNET framework: combines system and network virtualization provisions and configures virtual resources creates and manages VPXIs VN 3 HIPerNet VN 4 engine Virtualized resources 15 5) VPXI & application deployment VXDL file HIPerNet engine VN 1 VN 2 VN 3 VN 4 VPXI deployment VN 1 VR 5 VN 3 VN 2 VR 6 VN 4

9 6) Execution Execution of NAS with different bandwidth setups VN X VR X VR 5 VR Mbps 200 Mbps 75 Mbps 150 Mbps 50 Mbps 100 Mbps Conclusions VXDL is a powerfull language to specify flexible and personalized virtual infrastructures (VPXIs) Execution using the modular HIPerNet framework is straightforward for our users. Resource virtualisation & dynamic reconfiguration complexity is hidden. Grid 5000 platform is a powerfull physical underlying infrastructure for VPXI functionalities, performance s as well as scalability s experiments and demonstrations More features are beeing integrated in HIPerNet (security, OpenFlow interface, performance measurement, GUI ) VPXI can be applied to a large variety of usages (new services test and deployment, high throughput applications ) Collaboration and partnership : FP7 GEYSERS, FP7 SAIL, OrangeLabs, DocomoNTT, OpenFlow group

10 Annexe: Some of our references on network virtualisation 1. Julien Laganier and Pascale Vicat-Blanc Primet. HIPernet: a decentralized security infrastructure for large scale grid environments. In 6th IEEE/ACM International Conference on Grid Computing (GRID 2005), November 13-14, 2005, Seattle, Washington, USA, Proceedings, pages , Fabienne Anhalt, Guilherme Koslovski, Pascale Vicat-Blanc Primet Specifying and provisioning Virtual Infrastructures with HIPerNET. International Journal of Network Management (IJNM) - special issue on Network Virtualization and its Management, Pascale Vicat-Blanc Primet, Sebastien Soudan, and Dominique Verchere. Virtualizing and scheduling optical network infrastructure for emerging IT services. Optical Networks for the Future Internet (special issue of Journal of Optical Communications and Networking (JOCN)), 1(2):A121-A132, Guilherme Koslovski, Tram Truong Huu, Johan Montagnat, and Pascale Vicat-Blanc Primet. Executing distributed applications on virtualized infrastructures specified with the VXDL language and managed by the HIPerNET framework. In First International Conference on Cloud Computing (CLOUDCOMP 2009), Munich, Germany, October Pascale Vicat-Blanc Primet, Fabienne Anhalt, and Guilherme Koslovski. Exploring the virtual infrastructure service concept in Grid'5000. In 20th ITC Specialist Seminar on Network Virtualization, Hoi An, Vietnam, May Pascale Vicat-Blanc Primet, Jean-Patrick Gelas, Olivier Mornard, Guilherme Koslovski, Vincent Roca, Lionel Giraud, Johan Montagnat, and Tram Truong Huu. A scalable security model for enabling Dynamic Virtual Private Execution Infrastructures on the Internet. In IEEE/ACM International Conference on Cluster Computing and the Grid (CCGrid2009), Shanghai, May Guilherme Koslovski, Pascale Vicat-Blanc Primet, and Andrea Schwertner Char. VXDL: Virtual Resources and Interconnection Networks Description Language. In GridNets 2008, Oct