Mesosphere and Percona Server for MongoDB. Peter Schwaller, Senior Director Server Eng. (Percona) Taco Scargo, Senior Solution Engineer (Mesosphere)

Transcription

1 Mesosphere and Percona Server for MongoDB Peter Schwaller, Senior Director Server Eng. (Percona) Taco Scargo, Senior Solution Engineer (Mesosphere)

2 Mesosphere DC/OS MICROSERVICES, CONTAINERS, & DEV TOOLS DATA SERVICES, MACHINE LEARNING, & AI 1 Broad workload coverage 20+ MORE 100+ MORE Run today & tomorrow s applications including traditional J2EE, containers, analytics & ML Application-Aware Automation Security & Compliance Hybrid Cloud Management Multitenancy 2 Application-aware automation Automate workload-specific operating procedures to as-a- Service anything from Kubernetes to data services Datacenter and Cloud as a Single Computing Resource Powered by Apache Mesos 3 Intelligent resource pooling Optimize workload density for highest utilization with resource guarantees PHYSICAL INFRASTRUCTURE VIRTUAL MACHINES PUBLIC CLOUDS 4 Unified hybrid cloud operations Edge Datacenter Securely manage cloud, datacenter, and edge infrastructures from a single control plane

3 Mesos Architecture Spark Scheduler Cassandra Scheduler Container Scheduler Two-level Scheduling 1. Agents advertise resources to Master 2. Master offers resources to Framework 3. Framework rejects / uses resources 4. Agent reports task status to Master Mesos Master Mesos Master Mesos Master Mesos Agent Mesos Agent Service Mesos Agent Mesos Agent Service Spark Executor Docker Executor Spark Executor Cassandra Executor Spark Task Docker Task Spark Task Cassandra Task 3 3

4 Stateful Problems Preparation before the main task Runtime execution against state once scheduled user-defined arguments maintenance 4

5 Stateful Problems Conditional recovery scenarios Cassandra: replacing a dead node or dead seed node HDFS: replacing a dead name node HDFS: replacing a dead journal node Conditional deployment scenarios HDFS: deployment 5

6 DC/OS Commons SDK Services SDK Platform Mongo Kafka Elastic Best Practices Platform Feature Integration Apache Mesos API Tools and Utilities Documentation DC/OS Finite State Machine Execution Plans Automated Recovery Universe Packaging App Configuration Networking & Discovery Storage Security Monitoring Offer Evaluation Resource Accounting Task Reconciliation Developer Environment Integration Test Framework Developer Guide Tutorials & Code Samples API Reference 6

7 DC/OS SDK A declarative orchestration abstraction for Apache Mesos and DC/OS. An Apache Mesos scheduler factory. Use Cases MongoDB! Kubernetes Kafka Cassandra Elastic HDFS EdgeLB many more... 7

8 DC/OS SDK Features Rolling configuration / software updates Separate deployment / update plans Easy Mesos feature consumption CNI, rlimits, readiness checks, running and finished goal states, discoverability of dns, persistent volumes, security features (proprietary) 8

9 DC/OS SDK Features Horizontal scale out Vertical scaling Service discovery Virtual Networks (CNI) Readiness checks Health checks Custom recovery Persistent volumes Resource sets Operator friendly tools (API) Sidecars Placement constraints Configuration templating Rolling updates (configuration) Rolling upgrades (binaries) GPUs Fine-grained plan control Secrets (EE) Security (EE) TLS provisioning (EE) 9

10 Percona Server for MongoDB COMMUNITY EDITION Free and open source Free and open source ENTERPRISE Subscription ($) LDAP Authentication Log Redaction Database Auditing COMMUNITY EDITION Percona Memory Engine Hot Backups MongoDB Community Edition plus: Red Hat identity management certification Kerberos & LDAP authentication Auditing SNMP support Encrypted storage engine In-memory storage engine Platform certifications: Windows, RedHat/CentOS, Ubuntu, Amazon Linux Commercial licenses, warranty, and indemnification 10

11 Percona Server for MongoDB on DC/OS Simple installation of MongoDB via UI or CLI Single-command installation for rapid provisioning Multiple MongoDB Replica Sets within a single DC/OS cluster Storage volumes for enhanced data durability, known as Mesos Dynamic Reservations and Persistent Volumes Support for all Percona Server for MongoDB storage engines, including the WiredTiger, MongoRocks, InMemory, and MMAPv1 storage engines Auto-configuration of MongoDB Replica Set Configuration Auto-configuration of system-level users for backups and user management CLI actions for Add/Update/Remove of MongoDB Users Logical backup support with Amazon Web Services S3 remote upload Support for auto-deploy of Hidden Replica Set Member for zero-impact backups Percona Server for MongoDB Auditing support 11

12 12

13 13

14 14

15 Use PSMDB on DC/OS! 1.Install DC/OS ( or contact for an evaluation license for the DC/OS Enterprise edition 2.Search the DC/OS Catalog for percona-server-mongodb 3.Install the percona-server-mongodb package 4.Provide feedback to NOTE: Replica sets today, sharding in the future 15

16 Resources Documentation: SDK

17 Thank You Sponsors!! 18

18 Thank You!