SUSE High Performance Computing Eduardo Diaz PreSales SUSE Linux Enterprise ediaz@suse.com Alberto Esteban Territory Manager North-East SUSE Linux Enterprise aesteban@suse.com
HPC Overview SUSE High Performance Computing Solving computational, data-intensive, or numerically-intensive tasks Reducing the time and effort required to set-up and maintain HPC clusters Ensuring that all components of the HPC stack work together 2
SUSE Strong in HPC Market! SUSE HPC MULTI- and MANY-CORE PROCESSOR SUPPORT TECHNOLOGY Kernel 3.x Lustre File System Ceph storage platform Highly scalable - up to 4096 cores.. Intel, AMD, POWER.. SUSE Since 1992 Strong Presence in Top500 COOPERATION IBM SGI HP Dell.. Bull NEC Cray Cisco.. HIGH PRODUCTIVITY COMPUTING Total Baker Hughes Texas Instruments.. ACADEMIC AND RESEARCH LRZ / SuperMUC BSC / MareNostrum Tokyo Institute of Technology Beijing Computing Center NASA.. 3
Why SUSE Linux Enterprise Server For High Performance Computing Early player in HPC, pushing innovation and new technologies Highly reliable, interoperable and manageable server operating system Built to power mission-critical workloads in physical, virtual and cloud environments The natural successor to UNIX, backed by proven services for UNIX migration Special features to improve performance Backed by established ecosystem support and certificates The only Linux recommended by Microsoft 4
SUSE Additional Features SUSE High Performance Computing Up-to-date 3.0 Linux Kernel for optimal performance CPU Management and System Activity CPUset System, CPUset command line tool Sysstat package IRQbalance OpenFabrics Enterprise Distribution (OFED) Remote Direct Memory Access (RDMA) switched fabric technologies, high-speed data transport technologies for server and storage connectivity SystemTap, LTTng 2.0 Packaged Lustre 5
Recent Enhancements SUSE High Performance Computing Storage Support for btrfs Improved support for iscsi and FCoE Major filesystem performance increases Management Faster, more powerful control groups for resource isolation Improved power management Kernel Newest processors and chipsets Better idle-load balancing Transparent huge pages Improved scaling of incoming network traffic Network Higher network throughput Added tunables in the IP stack (for lower latency) 6
HPC Stack SUSE High Performance Computing Application Queuing / Management Software & Tools PBS Pro Moab IBM LSF Bright CM Storage EXT3 XFS BTRFS OCFS2 NFS pnfs 10G Network OFED Message Passing Interface MPI Parastation Intel TCP offload MPICH openmpi HP SGI IBRIX Lustre GPFS cephfs pnfs SUSE Linux Enterprise Server Hardware = SUSE supported = SUSE Partner = SUSE future 7
SUSE Studio Onsite HPC Image Creator, use for free in: www.susestudio.com SUSE Studio Onsite is a web application for building and testing software appliances in a web browser build your own application images or appliances based on SUSE Linux Enterprise test-drive your software appliances acts as a web UI to KIWI image builder with multi-user support 8
SUSE Manager Manage both SUSE Linux Enterprise and Red Hat Enterprise Linux and Centos servers with a single centralized solution SUSE Manager Automated and cost-effective software management, system provisioning/configuration/auditing and monitoring capabilities Manage Linux server deployments across physical, virtual and cloud environments 9
SUSE Cloud 2.0 Overview Based on OpenStack Grizzly New features and fixes Mixed hypervisor support Use existing infrastructure and lower costs Enhanced set-up and management capabilities Improves ease of use and installation Plug-in model for vendor integration Storage: Ceph, NetApp, EMC Networking: Cisco, Open vswitch, VLAN bridging Suse Coud 3.0 Beta 1 now (Havana) 10
11 SUSE Cloud 2.0
File Systems Today SUSE High Performance Computing Local storage Maintain existing capabilities (e.g. EXT3, XFS) Full btrfs support, improving manageability Maximum flexibility for customers Expand network filesystem capabilities (NFSv4.x/pNFS) Improve performance, reliability and security pnfs client support, server support for later version of SUSE Linux Enterprise 12
File Systems BTRFS SUSE High Performance Computing Integrated Volume Management Support for copy on write Powerful snapshot capabilities Scalability Other Capabilities: Compression Data integrity (checksums) SSD optimization Status: SLE 11: Fully supported SLE 12:Planned as default file system 13
File Systems Cluster SUSE High Performance Computing OCFS2 Superior cluster file system for up to 32 nodes Scalable network access via CTDB Used for big storage and user directories GPFS 3 rd party offering by IBM IBRIX 3 rd party offering by HP 14
Community Lustre SUSE High Performance Computing SUSE sponsored and developed Maintenance Release 2.1 Available for SUSE Linux Enterprise Server 11 SP1+ Maintenance Release 2.4 Aailable for SUSE Linux Enterprise Server 11 SP2+ Client already accepted by Whamcloud (http://downloads.whamcloud.com) http://drivers.suse.com/lustre/ 15
Storage Options
File Systems CEPH SUSE High Performance Computing Ceph is a scalable open source storage platform comprised of an object store (Rados), block store (RDB),a POSIX-compatible distributed file system (Ceph FS), and an Amazon S3 integration Ceph has been integrated with OpenStack and is included in the Linux kernel 17
File Systems Lustre SUSE High Performance Computing Maintenance Release 2.1 Available for SUSE Linux Enterprise Server 11 SP1+ Maintenance Release 2.4 Available for SUSE Linux Enterprise Server 11 SP2+ Client already accepted by Whamcloud (http://downloads.whamcloud.com) SUSE sponsored and developed port provided to the community http://drivers.suse.com/lustre/ 18
Learn more www.suse.com/products/server/hpc.html Thank you. 19
Corporate Headquarters Maxfeldstrasse 5 90409 Nuremberg Germany +49 911 740 53 0 (Worldwide) www.suse.com Join us on: www.opensuse.org 20