WHEN CONTAINERS AND VIRTUALIZATION DO - AND DON T - WORK TOGETHER Jeremy Eder, Sr Principal Performance Engineer LinuxCon/ContainerCon NA 2016
Agenda 2 Technology Trends Container and VM technical Overview Performance Data Round-up Workload Classification
Why listen to me... Co-team lead for container performance and scale team at Red Hat. Architect of Red Hat tuned project. Authored many blogs and whitepapers on container performance, tuning for high frequency trading. 3
But really, don t listen to me: Listen to your apps. 4
Key Technology Trends 5
Red Hat Container Solutions DEVELOPER SOLUTIONS CONTAINER CONTAINER CONTAINER CONTAINER CONTAINER SELF-SERVICE Developer Studio CDK Tools CloudForms Satellite Ansible SERVICE CATALOG (LANGUAGE RUNTIMES, MIDDLEWARE, DATABASES, ) BUILD AUTOMATION DEPLOYMENT AUTOMATION APPLICATION LIFECYCLE MANAGEMENT (CI / CD) CONTAINER ORCHESTRATION & CLUSTER MANAGEMENT (KUBERNETES) NETWORKING STORAGE REGISTRY LOGS & METRICS INFRASTRUCTURE AUTOMATION & COCKPIT CONTAINER RUNTIME & PACKAGING (DOCKER) ATOMIC HOST RED HAT ENTERPRISE LINUX 6 MANAGEMENT SOLUTIONS SECURITY
Containers are an OS Technology TRADITIONAL OS 7 CONTAINERS
It s all about the workloads... Some don t care where they run Batch workloads Some care greatly Security, Isolation Uptime Performance Proximity/Locality to data 8
What is a workload? Subsystems 9
What is a workload? Business Requirements 10
11
CONTAINERS AND VIRTUALIZATION: PERFORMANCE DATA ROUND-UP
Network Latency and Throughput 13
Performance of Large Expensive Apps :-) Virt 14
RHEL7 + Containerized Solarflare OpenOnload 15
Network Function Virtualization (NFV) Throughput and Packets/sec (RHEL7.x+DPDK) 16
Speedups for Virtual Machines 17
What is tuned? Tuning profile delivery mechanism 18
Tuned Profiles throughout Red Hat Products RHEL7 Desktop/Workstation RHEL7 Server/HPC balanced throughput-performance RHEL6/7 KVM Host, Guest RHEV Virtual-host/guest virtual-host Red Hat Storage RHEL OSP (compute node) rhs-high-throughput, virt virtual-host RHEL Atomic OpenShift atomic-host, atomic-guest openshift-master,node
Tuned Profiles throughput-performance governor energy_perf_bias c/pstates readaheads kernel.sched_min/wakeup_granularity_ns vm.dirty_background/ratio vm.swappiness future tcp_fastopen multiqueue virtio limitnofile=n for node pty_max=n RFS? 20 VM/Cloud virtual-guest vm.dirty_ratio vm.swappiness Ba re atomic-openshift-node M et al Avc_cache_threshold nf_conntrack_hashsize kernel.pid_max net.netfilter.nf_conntrack_max
KVM vs Container Performance (HP results) Distributed Environment Java application server Internet Message Access Protocol (IMAP) server Batch server http://h20195.www2.hpe.com/v 2/getpdf.aspx/4AA6-2761ENW. pdf 21
Workload Infrastructure Mapping Workload CPU Intensive Memory Intensive Color Meaning Disk I/O Latency Mature No Perf Concerns Immature Limited Perf Concerns Disk I/O Throughput Network Latency Network Throughput Difficult/Impossible (currently) Security Uptime (Live Migration) Deployment Speed Alternative OS 22 Bare Metal Containers Virt
Workload Infrastructure Mapping: Build Farm Icon Meaning Mature and/or No Perf Concerns Immature and/or Limited Perf Concerns Mixed Concerns Not Applicable 23 Attribute Build Farm CPU Intensive Memory Intensive Disk I/O Latency Low Disk I/O Throughput Network Latency Low Network Throughput Security Low Uptime (Live Migration) N/A Deployment Speed Alternative OS N/A
Workload Infrastructure Mapping: memcached Icon Meaning Mature and/or No Perf Concerns Immature and/or Limited Perf Concerns Mixed Concerns Not Applicable 24 Attribute memcached CPU Intensive Medium Memory Intensive Medium Disk I/O Latency Low Disk I/O Throughput Low Network Latency Network Throughput Security N/A Uptime (Live Migration) N/A Deployment Speed Low Alternative OS N/A
Workload Infrastructure Mapping: Stock Trading Icon Attribute Stock Trading CPU Intensive Memory Intensive Disk I/O Latency Low Disk I/O Throughput Low Network Latency Immature and/or Limited Perf Concerns Network Throughput Security Low Mixed Concerns Uptime (Live Migration) N/A Deployment Speed N/A Alternative OS N/A Meaning Mature and/or No Perf Concerns Not Applicable 25
Workload Infrastructure Mapping: Gluster Icon Meaning Mature and/or No Perf Concerns Immature and/or Limited Perf Concerns Mixed Concerns Not Applicable 26 Attribute Gluster CPU Intensive Low Memory Intensive Low Disk I/O Latency Disk I/O Throughput Network Latency Network Throughput Security N/A Uptime (Live Migration) N/A Deployment Speed Low Alternative OS N/A
Workload Infrastructure Mapping: Animation Icon Attribute Animation CPU Intensive Memory Intensive Medium Disk I/O Latency Medium Disk I/O Throughput Network Latency Medium Immature and/or Limited Perf Concerns Network Throughput Security Low Mixed Concerns Uptime (Live Migration) Low Deployment Speed Alternative OS N/A Meaning Mature and/or No Perf Concerns Not Applicable 27
It s all about the workloads. 28
THANK YOU plus.google.com/+redhat facebook.com/redhatinc linkedin.com/company/red-hat twitter.com/redhatnews youtube.com/user/redhatvideos