A Whirlwind Tour of Apache Mesos

Transcription

1 A Whirlwind Tour of Apache Mesos

2 About Herdy Senior Software Engineer at Citadel Technology Solutions (Singapore) The eternal student Find me on the internet: _hhandoko hhandoko hhandoko

3 Presentation Overview Problem Domains Mesos Fundamentals Mesos Frameworks Mesos in the Real-World Demo! Image source:

4 Once Upon a Tweet I ve heard of: LAMP WIMP MEAN But what is SMACK? Source:

5 Mesos in One Paragraph Apache Mesos abstracts CPU, memory, storage, and other compute resources away from machines (physical or virtual), enabling fault-tolerant and elastic distributed systems to easily be built and run effectively. Image source:

6 Mesos in One Sentence Operations / DevOps Developers / Data Scientist Next-Generation Cluster Manager Distributed Systems SDK

7 Mesos in One Sentence (cont d) Datacentre timesharing Image source:

8 Problem Domain: Static Partitioning Many and complex provisioning scripts Snowflake servers No automated failure handling Repartition takes hours or days

9 Problem Domain: Resource Management Low utilisation rate (i.e. waste) Hard to predict workload Application performance jitter Scale and capacity are coupled Image source:

10 The Inspiration: Google Borg Top Secret orchestration system (in use since ~2004) Efficiently parcels work across Google s vast fleet of computer servers Google is building Omega (Borg vnext) Source:

11 The Birth of Apache Mesos A research project at the University of California Berkeley Hindman s initial ideas from working with many-cores Intel processor ( cores) Hindman teamed up with Kowinski and Zaharia who was working on software platform that work on massive data centres Twitter took a keen interest and further developed Mesos (as an opensource project) Becomes an Apache project in 2013 Source:

12 Mesos Analogy to an Operating System Linux Mesos

13 Mesos vs Virtualization Virtualization Mesos

14 Mesos Architecture ZooKeeper coordinate master nodes and elect leader Mesos master manage agents and schedule Tasks Mesos agents make Offers and run Tasks

15 Key Concepts Frameworks Mesos understands the technical primitives of distributed computing but have no intelligence on how to do it Frameworks tell Mesos (kernel) how to run the applications A framework comprises of Scheduler and Executor Resource offers Agents advertise available resources Offers can contain user-defined attributes Resource isolation via LXC Resource allocation Roles Weights Resource Reservations

16 Two-tier Scheduling 1. Agents offer resources 2. Allocator decides where to offer the resources 3. Framework may accept an offer and execute a task in an agent, or 4. Framework may reject the offer and it will be passed along

17 App Specific Frameworks

18 General Purpose Framework: Marathon Container and framework orchestration platform Runs long running services (`init.d`), e.g. web applications Features High availability (active / passive) Service discovery & load balancing Health checks Event subscription REST API Image source:

19 General Purpose Framework: Chronos Fault-tolerant jobs scheduler for Mesos Distributed `cron` Features Distributed and fault-tolerant Supports bash and custom executor Schedules based on ISO8601 repeating interval notation Handles jobs dependencies Image source:

20 Framework: Aurora Service orchestration framework Functionality-wise, combined Marathon + Chronos, and so much more Twitter wanted an all-in-one framework for total control Image source:

21 BYO Framework Existing frameworks provide good coverage of most use cases (80/20) Hadoop: Batch processing Storm: Stream processing Chronos: Task scheduling Marathon / Aurora: long-running services

22 Custom Framework Demo!

23 Demo Resources Rendler Code:

24 Mesos in Production Today

25 Mesos and Mesosphere Mesos is the name of the opensource Apache project Mesosphere (Mesosphere Inc.) is the company which commercializes the open source project and provides consulting services

26 DC/OS Demo!

27 Demo Resources DC/OS Installation Instructions: Packet Hosting: Hashicorp s Terraform: Mesosphere Tweeter App:

28 Predictive Scheduler: Quasar Resource efficient and QoSaware cluster manager Uses fast classification techniques in Machine Learning to profile workloads Image source:

29 Mesos on Windows Mesosphere is working with Microsoft to port Apache Mesos to work with Windows Servers Platform-specific tasks will be run on the supported nodes Image source:

30 Fit for Purpose? Good Fit Stateless systems Web applications Spark Hadoop Poor Fit Stateful systems* Relational Database Distributed systems Cassandra *Note: Support for persistent storage volumes is under active development

31 Whitepapers Hindman, B., Konwinski, A., Zaharia, M., Ghodsi, A., Joseph, A.D., Katz, R.H., Shenker, S. and Stoica, I., 2011, March. Mesos: A Platform for Fine-Grained Resource Sharing in the Data Center. In NSDI (Vol. 11, pp ). Verma, A., Pedrosa, L., Korupolu, M., Oppenheimer, D., Tune, E. and Wilkes, J., 2015, April. Large-scale cluster management at Google with Borg. In Proceedings of the Tenth European Conference on Computer Systems (p. 18). ACM.

32 Books

33 Last But Not Least

34 Thanks!