Linkedin Open19 Deep Dive

Size: px

Start display at page:

Download "Linkedin Open19 Deep Dive"

Isaac Grant
5 years ago
Views:

1 Linkedin Open19 Deep Dive Yuval Bachar Principal Engineer, Global Infrastructure & Strategy at

2 Data Center Philosophy Every element in the data center is a server Appliance free data centers Multi-Supplier for every component in the data centers Solve in software what you can Flash for storage Scale Out Disaggregation Cost Optimized

3 The Open19 Project

4 Open19 Project Goals Create an open standard that can fit any 19 Rack environment for server, storage, and networking Create a solution that will have applicability for large, medium, and small scale data centers RACK DEPLOYMENT COST OPTIMIZATION ENABLE FASTER RACK INTEGRATION CONSOLIDATE REQUIREMENTS Reduce commons by 50% 3-5x faster integration time Eco system with high adoption level

5 Open19 Project Non-Goals Create a proprietary form factor Low adoption level Create restrictive development environment Minimized defined specification Build a heavy bureaucratic organization Minimal organization that will enable collaboration Engineering focused first Business partners next

6 Platform Building Blocks Brick Cage Double Wide Brick Network Switch Power Shelf Double High Brick Brick

7 Blind mate Power Connectors Blind mate 100G data cables and Connector

8 Open19 in real life HPe Flex Inspur SuperMIcro Linkedin

9 Brick Cage Passive mechanical cage 12RU and 8RU options 2RU modularity 4x Bricks 2x Double High Half Width 2x Double wide 1x Double High Snap-on rear opening

10 Rack View:

11 Full Cable without Rack: Plastic spine snaps around main cable breakout

12 Close-Up Cable 4X2 Impel breakouts remain flexible Length of 4X2 Impel optimized so that cable will sit closer to the rack

13 Bricks Form Factors Four brick form factors Brick (½ wide 1RU) Double High Half Width (2RU) Double Wide Brick (1RU) Double High Brick (2RU) Linear power and data growth Self Sustained EMI & Safety & cooling 100G Blind Mate network

14 Servers in design Dell, HPe, SuperMicro, Flex, Celestica and Inspur are actively working on Open19 server White boxes in development by Linkedin: Quad socket Broadwell-DE in a half width 1RU (brick) Dual socket High-end Skylake with up to 1.5T memory in 1RU Storage Servers Single socket up to 32 drives per 1RU One clarification about the high density solution To get to the full capacity 19.2Kw) the core count will only be 3000

15 Open19 Switch 3.2T Switch Dual switch: Data Path & Management (OOB) 50G per server data path 1G per server management (optional) Console port per server (optional) 12v input (no power supplies) Up to 8x100G uplinks or local switching ports Broadwell-DE CPU with BMC Linkedin white box design

16 Open19 Power shelf Two configurations: 1RU 9.6KW per leaf zone 2RU 19.2KW per leaf zone Shared power modules Management via GE port Full AC and DC range Multi-Source for the shelf and modules Per server protection and monitoring OPTIONAL BBU Optional rack level battery back unit

17 Fast Installation Process Any 19 Rack Install the cages: 4 screws each, front only Install the power shelf: 2 screws, front only Install the two switches: 2 screws each, front only Snap-on cables to the back of the cages: Tool-less Plug the power shelf: Snap-on cable, tool-less Connect the switch: Snap-on + optics, tool-less Blind-mate install the bricks: Tool-less Connect the power feed to the power shelf: Tool-less GO: The rack is integrated, up and running!

18 Open19 & OCP OCP is an organization that allows hardware and software specification contributions, with propriety form factor per solution from the rack to the server. Open19 defines an architecture and standard form factor for compute and storage in any 19 rack environment with fully cross supplier interoperable environment

19 Open19 & OCP - Features Feature Open Compute Project - OCP Required rack Requires a variety of noncompatible special racks like the FB OCP rack, the Google 48v rack, etc. Form Factor Server & Storage Non-Standard equipment Specialty or 19 racks with OU and RU form factors Pre-designed servers by the data centers operators and manufactured by single or multiple ODMs Does not allow a mix with non- OCP gear in the same rack Open19 ANY standard EIA 19 rack 19 Rack with 1RU (1.75 ) building blocks Open design for innovation by all server design teams and manufacturers in the industry into a shared form factor Allows full integration of Open19 gear and standard 19 gear in the same rack

20 Open19 vs. OCP Detailed Features Feature Open Compute Project - OCP Open19 Disaggregation Cooling and airflow Power EMI and Safety Networking Disaggregated solution with a rack level cooling/power/and controllers in place Centralized cooling fan door or localized large fan trays. Specialty site airflow requirements (like hot/cold isle isolation) Centralized power distribution using bus bars No element or rack level EMI containment, rack level safety Per server networking connectivity DAC cables Fully disaggregated solution each element is self-sustained with common power conversion Disaggregation Each element in the system is self sustained. With per location optional cooling assist (like fan doors, self cooling racks) Centralized power distribution leveraging low cost connectivity Disaggregation Each element in the system is self-certified and responsible for safety and EMI certification Blind mate cost effective 100G/every ½ wide 1RU slot.

21 Open19 vs. OCP Eco-System Feature Open Compute Project - OCP Eco System Built out of a collection of design teams and manufacturing ODMs operating in isolation and contributing specifications IP protection Drivers and supporters Manufacturing hardware suppliers Limited to no IP protection for OCP contributions Mostly mega data centers operators and some service providers Mostly ODMs 1-2 suppliers for each element including commons, servers, and storage Open19 Form factor centralized and common to all solutions. Compatible elements designed by ODM/OEM suppliers Full IP protection, the designs are not required to be open their IP Mostly mid to large size data center operators with some service providers OEMs and ODMs 2-3 sources for every common element in the platform and 4-10 suppliers for unique servers and storage

22 Platform Benefits ANY19 RACK FULLY REDUNDANT INFRA DISAGGREGATION Any location A/B 2N power redundancy No central controllers Self sustained servers SHORT INTEGRATION TIME LEVERAGE EXISTING SERVERS 5-6x faster rack level integration Bricks form factor fit most existing motherboards EFFICIENT POWER MULTI-SERVER TIERS COST EFFECTIVE Single stage 96% power conversation No server power supplies Four form factors Server IP protection and innovation Rack level cost reduction Solution cost savings

23 Open19 Deployment Models Traditional: Data center operators Bare metal cloud service: Lease a slot - Emerging High efficiency offsite integration Edge platform cloud optimization

24 Future Developments for Open19 Open orchestration & management software Different cage form factors New server models Automated data center deployment model Optical snap-on data cabling Liquide cooling integration Automated data center Any other crazy idea

25 Linkedin Deployment Model

26 Staged Datacenter Deployment Stage1 Pre-Server Stage Build out to site/suite capacity of empty cages Power shelf and cables integration Switching integration with optical uplinks Move to warm deployment state Cost effective Accelerating date center deployments

27 Staged Datacenter Deployment Stage2 Server Integration Insertion of servers on demand Fully automated provisioning and deployment Deploy 1000s of severs in days not months Create an elastic data center model with fix low cost infra

28 Staged Datacenter Deployment Stage3 Sustaining & Operations Never touch infra Server only blind mate insertion removal Full monitoring and automation

29 Open19 Foundation

30 Open19 Foundation Established in May 2017 and open for business Launch event 5/23/2017 Check out our YouTube channel A community based organization for open source hardware and software, Open19 project is one of many 5 Founding members, 27 members, 1200 individual members growing daily In forming stages and establishing very fast very special community and IP sharing rules Join

31 Summary Open19 is about defining a common form factor Open19 is about community collaboration The Open19 community is established now: over 75 companies involved Data center Operators and integrators Systems Suppliers Components suppliers Open19 technology will be ready for production Q Go to open19.org and join us individuals and companies

32 Yuval Bachar

Linkedin Open19 Deep Dive

Linkedin Open19 Deep Dive Yuval Bachar Principal Engineer, Global Infrastructure & Strategy at Data Center Philosophy Every element in the data center is a server Appliance free data centers Multi-Supplier