WHEN CONTAINERS AND VIRTUALIZATION DO AND DON T - WORK TOGETHER JEREMY EDER

Size: px

Start display at page:

Download "WHEN CONTAINERS AND VIRTUALIZATION DO AND DON T - WORK TOGETHER JEREMY EDER"

Frederica Carson
5 years ago
Views:

1 WHEN CONTAINERS AND VIRTUALIZATION DO AND DON T - WORK TOGETHER JEREMY EDER

2 Agenda 2 Technology Trends Container and VM technical Overview Performance Data Round-up Workload Classification

3 Why listen to me... Co-team lead for container performance and scale team at Red Hat. Architect of Red Hat tuned project. Authored many blogs and whitepapers on container performance, tuning for high frequency trading. 3

4 But really, don t listen to me: Listen to your apps. 4

5 Containers are an OS Technology VIRTUALIZATION 5 CONTAINERS

6 It s all about the workloads... Some don t care where they run Batch workloads Some care greatly Security, Isolation Uptime Performance Proximity/Locality to data 6

7 What is a workload? Subsystems 7

8 What is a workload? Business Requirements 8

9 9

10 CONTAINERS AND VIRTUALIZATION: PERFORMANCE DATA ROUND-UP 10

11 Network Latency and Throughput 11

12 Performance of Large Expensive Apps :-) Virt 12

13 RHEL7 + Containerized Solarflare OpenOnload 13

14 Network Function Virtualization (NFV) Throughput and Packets/sec (RHEL7.x+DPDK) 14

15 Speedups for Virtual Machines 15

16 What is tuned? Tuning profile delivery mechanism 16

17 Tuned Profiles throughout Red Hat Products RHEL7 Desktop/Workstation RHEL7 Server/HPC balanced throughput-performance RHEL6/7 KVM Host, Guest RHEV Virtual-host/guest virtual-host Red Hat Storage RHEL OSP (compute node) rhs-high-throughput, virt virtual-host RHEL Atomic OpenShift atomic-host, atomic-guest openshift-master,node

18 Tuned Profiles throughput-performance governor energy_perf_bias c/pstates readaheads kernel.sched_min/wakeup_granularity_ns vm.dirty_background/ratio vm.swappiness future tcp_fastopen multiqueue virtio limitnofile=n for node pty_max=n RFS? 18 VM/Cloud virtual-guest vm.dirty_ratio vm.swappiness Ba re atomic-openshift-node M et al Avc_cache_threshold nf_conntrack_hashsize kernel.pid_max net.netfilter.nf_conntrack_max

19 KVM vs Container Performance (HP results) Distributed Environment Java application server Internet Message Access Protocol (IMAP) server Batch server 2/getpdf.aspx/4AA6-2761ENW. pdf 19

20 Workload Infrastructure Mapping Workload CPU Intensive Memory Intensive Color Meaning Disk I/O Latency Mature No Perf Concerns Immature Limited Perf Concerns Disk I/O Throughput Network Latency Network Throughput Difficult/Impossible (currently) Security Uptime (Live Migration) Deployment Speed Alternative OS 20 Bare Metal Containers Virt

21 Workload Infrastructure Mapping: Build Farm Icon Meaning Mature and/or No Perf Concerns Immature and/or Limited Perf Concerns Mixed Concerns Not Applicable 21 Attribute Build Farm CPU Intensive Memory Intensive Disk I/O Latency Low Disk I/O Throughput Network Latency Low Network Throughput Security Low Uptime (Live Migration) N/A Deployment Speed Alternative OS N/A

22 Workload Infrastructure Mapping: memcached Icon Meaning Mature and/or No Perf Concerns Immature and/or Limited Perf Concerns Mixed Concerns Not Applicable 22 Attribute memcached CPU Intensive Medium Memory Intensive Medium Disk I/O Latency Low Disk I/O Throughput Low Network Latency Network Throughput Security N/A Uptime (Live Migration) N/A Deployment Speed Low Alternative OS N/A

23 Workload Infrastructure Mapping: Stock Trading Icon Attribute Stock Trading CPU Intensive Memory Intensive Disk I/O Latency Low Disk I/O Throughput Low Network Latency Immature and/or Limited Perf Concerns Network Throughput Security Low Mixed Concerns Uptime (Live Migration) N/A Deployment Speed N/A Alternative OS N/A Meaning Mature and/or No Perf Concerns Not Applicable 23

24 Workload Infrastructure Mapping: Gluster Icon Meaning Mature and/or No Perf Concerns Immature and/or Limited Perf Concerns Mixed Concerns Not Applicable 24 Attribute Gluster CPU Intensive Low Memory Intensive Low Disk I/O Latency Disk I/O Throughput Network Latency Network Throughput Security N/A Uptime (Live Migration) N/A Deployment Speed Low Alternative OS N/A

25 Workload Infrastructure Mapping: Animation Render Farm Icon Attribute Animation CPU Intensive Memory Intensive Medium Disk I/O Latency Medium Disk I/O Throughput Network Latency Medium Immature and/or Limited Perf Concerns Network Throughput Security Low Mixed Concerns Uptime (Live Migration) Low Deployment Speed Alternative OS N/A Meaning Mature and/or No Perf Concerns Not Applicable 25

26 It s all about the workloads. 26

FUTURE OPPORTUNITIES Red Hat Performance Engineering Blogs https://developers.redhat.

27 FUTURE OPPORTUNITIES Red Hat Performance Engineering Blogs Red Hat Performance Tuning Guide e_tuning_guide/ Learn more about Red Hat Summit at redhat.com/summit 27

28 THANK YOU 28

WHEN CONTAINERS AND VIRTUALIZATION DO - AND DON T - WORK TOGETHER

WHEN CONTAINERS AND VIRTUALIZATION DO - AND DON T - WORK TOGETHER Jeremy Eder, Sr Principal Performance Engineer LinuxCon/ContainerCon NA 2016 Agenda 2 Technology Trends Container and VM technical Overview