Enabling High Performance Data Centre Solutions and Cloud Services Through Novel Optical DC Architectures. Dimitra Simeonidou

Transcription

1 Enabling High Performance Data Centre Solutions and Cloud Services Through Novel Optical DC Architectures Dimitra Simeonidou

2 Challenges and Drivers for DC Evolution Data centres are growing in size and complexity to accommodate the ever-increasing demand for cloud services: Volume of users and cloud applications, High Performance Computing, Big Data applications, etc. One of the most challenging issues when scaling out a data centre is its network infrastructure, specifically the inter-rack connections Data throughput and port capacity scalability Low latency Dynamic bandwidth services Low power consumption

3 Typical DC Applications and Traffic Characteristics Long lived connections Virtual data centers (VDC) Connections among nodes QoS Priority traffic Real-time traffic sensitive to delays d Short lived connections Interoute MPLS/IP network Scientific applications communicate at certain periods of time wait collective compute

4 Current DC Architecture Multi-tier hierarchical architecture Based on commodity Ethernet/ InfiniBand switch fabrics Main drawbacks Scalability, latency, power consumption Current management and control functions almost static requiring manual intervention more flexible, automated and programmable solutions needed core aggregation access 4

5 Optics in DCN solutions Optical DCN architecture, based on optical switching technologies Ultra-high bandwidth provided by WDM technology Enhanced scalability, transmission rate, lower power consumption Architecture Year Elect./Opt. Circuit/Packet Scalability Cap. Limit Prototype c-through 2010 Hybrid Hybrid Low Tx/Rx Yes Helios 2010 Hybird Hybrid Low Tx/Rx Yes Proteus 2010 All-optical Circuit Medium Tx/Rx Yes LIONS 2012 All-optical Packet Medium twc, awgr Yes Petabit, IRIS 2010 All-optical Packet Medium twc, awgr No Cascaded AWGRs 2013 All-optical Circuit High twc, awgr Yes OSMOSIS 2004 All-optical Packet Low soa Yes Data Vortex 2006 All-optical Packet Low soa Yes 5

6 Optical Datacentre Network Design a new flattened optical intra data centre network Hybrid OPS/OCS Fabric (Optical Packet/Circuit Switching, Hybrid ) SDN-based Control Plane for heterogeneous network technologies Data Centre Management Cloud-to-Network Interface LIGHTNESS Control Plane Inter-DC Control Interface Operator Network Control OPS Region Data Centre Network OCS Region Operator Network Hybrid ToR switch Hybrid ToR switch Hybrid ToR switch Data Centre

7 DCN architecture and interfaces

8 Hours-Days-Weeks DC Evolution Manual, Painful, Error-prone Workload deployment requires time and intervention of different admin roles Connectivity of workload components is static Performance is achieved with over provisioning, questionable scaling characteristics App level request Infrastructure Reconfigured Orchestrated Management Plan Deploy Operate Automated, Streamlined, Optimized Rapid and flexible workload management On demand resource allocation and release Scalable and efficient virtualized workload components connectivity Discrete, Heterogeneous, Complex Multiple management roles and domains Unable to make global decisions efficiently and dynamically Requires expertise in different vendor technologies Control Plane Consolidated, Converged, Programmable Unified IT and SDN orchestrator Converged IT + Network Unified Control Plane virtualization for data centers Efficient and optimized virtual resource utilization and allocation Enhanced abstraction mechanisms for emerging optical technologies Traditional fat-tree designs Over provisioned Inefficient for east-west communications Restricts (virtual) server placement decisions High-performance optical solutions Flattened DC network architecture Fast switch 3D stacked transceiver InP fast switch Low loss beam-streering switch Hollow-core and Multi-core fibers Cabling mess Many different incompatible interconnects FC HBA FC HBA NIC NIC NIC NIC HCA Data Plane CNA CNA Converged DCN interconnect

9 Use Case-Virtual Datacentre Provisioning Virtualized on demand, resource allocation and release Unified control Control plan Plane Ressource abstraction OpenFlow interfaces Ressource abstraction OpenFlow interfaces Ressource abstraction OpenFlow interfaces Beamstreering 800x800 mechanical switch All optical datacenter network with highly dynamic interconnection of 800 switches

10 Research topics Overall architecture design Technology availability Unified Control Plane design for hybrid technologies (SDN) Virtualisation Convergence of network+it Highly Flexible Traffic-aware topology reconfiguration Highly Programmable Energy efficiency Cost efficiency

11 The End