Issues Fixed in DC/OS

Transcription

1 Release Notes for These are the release notes for DC/OS DOWNLOAD DC/OS OPEN SOURCE Issues Fixed in DC/OS CORE Docker executor does not hang due to lost messages. DOCS Updated ports list for DC/OS. ENTERPRISE DCOS DC/OS CA certificate bundle now gets propagated to public slaves. DCOS Diagnostics bundles no longer contain sensitive cluster configuration values related to Cloudformation templates. DCOS Marathon now supports upgrading to JDK 1.8.0_152. DCOS_OSS Prometheus plugin now authenticates on master nodes. DCOS_OSS DC/OS CLI can now retrieve metrics for Dockerized tasks. DCOS_OSS Prometheus plugin now has permissions to access file socket. Notable Changes in DC/OS Updated to Marathon (changelog).

2 DC/OS Java Developer Kit updated to the latest version: JDK 8u152. DC/OS is compatible with the newest Docker version: Issues Fixed in DC/OS Fixed an issue related to a failure mode in IAM (Identity and Access Manager), which can cause DC/OS master nodes not to come online for a period of time after failover or restart. ENTERPRISE Issues Fixed in DC/OS DCOS_OSS The DC/OS CLI now ignores output when opening a browser window so that users do not see error information when prompted for the authentication token. DCOS_OSS Removed sensitive config values from diagnostics bundles and build output. DCOS_OSS DC/OS Metrics now sanitizes metrics names. DCOS_OSS DC/OS layer 4 load balancer now periodically checks that the IPVS configuration matches the desired configuration and reapplies if the configuration is absent. DCOS When using a custom CA certificate, the DC/OS bootstrap no longer stores the cluster private key in ZooKeeper as an operator is responsible for copying the private key to all master nodes. ENTERPRISE DCOS The DC/OS CLI can now retrieve metrics for DC/OS data services. DCOS Fixed undocumented privilege being required for setting up CLI access for a non-superuser. ENTERPRISE DCOS UI: Secrets are no longer removed from an app when nonsuperusers edit a Marathon service that uses secrets. ENTERPRISE

3 DCOS The DC/OS OpenSSL library is now configured to not support TLS compression anymore (compression allows for the CRIME attack). ENTERPRISE Notable Changes in DC/OS Support for RHEL 7.4. Updated to Mesos (changelog). Updated to Marathon (changelog). DCOS Updated configuration example for a cluster that uses custom Docker credentials. DCOS Added clarifications to the custom CA certificate installation documentation. DOCS Clarified how operators can recover from a full agent disk. DOCS Updated Metrics names. Issues Fixed in DC/OS COPS Master node fails to start after configuration change. This was was due to tmp mountpoints being marked as noexec. Bug fixed. COPS Timeout creating service account. The timeout was due to tmp mountpoints being marked as noexec. Bug fixed. ENTERPRISE DCOS Fix security CLI secret creation following wrong secret schema. This fix clarifies which fields the secrets service stores. ENTERPRISE DCOS In the UI, the name of the containerizer runtime in the service creation form has been changed from MESOS RUNTIME to UNIVERSAL CONTAINER RUNTIME (UCR). DCOS DC/OS authenticator fails to cache Bouncer s public key,

4 causing an increase in request rates against Bouncer s JWKS endpoint. Bug fixed. ENTERPRISE DCOS Pod Endpoints protocol json parser adds 0 to json. Bug fixed. DCOS The JSON editor duplicates and fails to properly parse app definition. Bug fixed. DCOS DC/OS UI deletes environment variables with non-string values from Marathon app/pod definitions. Bug fixed. DCOS_OSS Installer prints large traceback when checks fail during --postflight. A clearer error message is now provided. DOCS DC/OS 1.10 Custom Installation documentation: clarified where the /opt/mesosphere directory must be. Notable Changes in DC/OS Support for Docker CE Marathon and Mesos rc4 are integrated with DC/OS DCOS Improvements for deployment behavior in Catalog. You now have a Review & Run button that allows you to cancel, modify your configuration, or install with defaults. Support for Centos 7.4. Issues Fixed in DC/OS CASSANDRA Redirect deprecated /v1/nodes/connect to /v1/co nnect. CORE Support DC/OS commons services on public agents. DCOS Filter/Search Design Update. DCOS Addition of new pullconfig properties break validation.

5 DCOS Launch containers on DockerContainerizer if network mode is NONE. DCOS_OSS Spartan autoip DNS should resolve to host IP for UCR in bridge network. ENTERPRISE INFINITY Update / Uninstall. DSE does not support rolling upgrade. ENTERPRISE MARATHON_EE Marathon needs to support a default bridge network for UCR. About DC/OS 1.10 DC/OS includes many new capabilities for Operators and expands the collection of Data & Developer Services with a focus on: Core DC/OS service continuity - System resilience, IAM scalability & simplified upgrades. Robust security - Custom CA certificate & file-based secrets support. ENTERPRISE Enterprise-ready networking - New DC/OS Edge-LB for higher availability and security. ENTERPRISE Kubernetes is now available on DC/OS. Data services enhancements across the board. Rolling configuration update and upgrade support via the CLI. ENTERPRISE Ability to deploy Data Services into folders to enable multi team deployments. ENTERPRISE Ability to deploy to CNI-Based virtual networks. Please try out the new features and updated data services. Provide any feedback through our support channel: support.mesosphere.com. Contents

6 Contents New Features and Capabilities Breaking Changes Known Issues and Limitations New Features and Capabilities Apache Mesos 1.4 and Marathon 1.5 Integrated. DC/OS is based on Mesos 1.4.0, here using master branch (prerelease) SHA 013f7e21, with over 1200 commits since the previous Mesos version. View the changelog. DC/OS is integrated with the latest release of Marathon, version 1.5. Resulting breaking changes and new features are documented below. For more information about Marathon 1.5, consult the Marathon changelog. Networking Configurable Spartan upstreams for domains (dnames). You can now configure Spartan to delegate a particular domain (e.g. *.foo.company.com ) to a particular upstream. Increased CNI network support. DC/OS now supports any type of CNI network. View the documentation.

7 Edge-LB load balancer. ENTERPRISE Edge-LB load balances Mesos tasks. Not supported in strict security mode. View the documentation. Security ENTERPRISE Custom CA certificate support. Installation time configuration options have been added that allow you to configure DC/OS Enterprise to use a custom CA certificate and corresponding private key, which DC/OS then uses for issuing all component certificates. The custom CA certificate can be an intermediate CA certificate so that that all certificates used within the DC/OS cluster derive from your organization s X.509 certification hierarchy. Enhanced secrets management with file-based secrets. You can now make a secret available to your service in the sandbox of the task. View the documentation. Vastly improved IAM scalability and performance characteristics. The new system removes hard limits on the number of users, groups, and permissions that can be stored, and shows stable read and write performance as the dataset grows. Docker pullconfig parameter. Use this parameter in your service definition to authenticate to a private Docker registry. View the documentation. Enterprise CLI permissions management commands. It is now possible to manage permissions to protect resources using the DC/OS Enterprise CLI. Kubernetes on DC/OS

8 Kubernetes on DC/OS is beta with DC/OS Install from the DC/OS Service Catalog or use the quickstart. Updated DC/OS Data Services Rolling Configuration Update and Upgrades support via the CLI. ENTERPRISE Ability to deploy Data Services into Folders to enable multi team deployments. ENTERPRISE Ability to deploy to CNI-Based Virtual Networks. The following updated data services packages are compatible with DC/OS Cassandra. Documentation. Release Notes. Elastic. Documentation. Release Notes. HDFS. Documentation. Release Notes. Kafka. Documentation. Release Notes. Apache Spark. Documentation. Release Notes. Platform Node and cluster health checks. Write your own custom health checks or use the predefined checks to access and use information about your cluster, including available ports, Mesos agent status, and IP detect script validation. View the documentation. Enhanced upgrades with backup and restore, and pre/post flight checks. ENTERPRISE

9 Universal Container Runtime (UCR). Adds port mapping support for containers running on the CNI network. Port mapping support allows UCR to have a default bridge network, similar to Docker s default bridge network. This gives UCR feature parity with Docker Engine enabling use of Mesos Runtime as the default container runtime. Scale and performance limits. CLI DC/OS requires DC/OS CLI 0.5.x. DC/OS CLI 0.5.x adds multi-cluster support with dcos cluster commands. Multi-cluster support has a number of consequences: DC/OS CLI 0.4.x and 0.5.x use a different structure for the location of configuration files. DC/OS CLI 0.4.x has a single configuration file, which by default is stored in ~/.dcos/dcos.toml. DC/OS CLI 0.5.x has a configuration file for each connected cluster, which by default are stored in ~/.dcos/clusters/<cluster_id>/dcos.toml. DC/OS CLI 0.5.x introduces the dcos cluster setup command to configure a connection to a cluster and log into the cluster. Note: Updating to the DC/OS CLI 0.5.x and running any CLI command triggers conversion from the old to the new configuration structure. After you call dcos cluster setup, (or after conversion has occurred), if you attempt to update the cluster configuration using a dcos config set command, the command prints a warning message saying the command is deprecated and cluster configuration state may now be corrupted. If you have the DCOS_CONFIG environment variable configured: After conversion to the new configuration structure, DCOS_CONFIG is no longer honored. Before you call dcos cluster setup, you can change the

10 configuration pointed to by DCOS_CONFIG using dcos config set. This command prints a warning message saying the command is deprecated and recommends using dcos cluster se tup. CLI modules are cluster-specific and stored in ~/.dcos/clusters/<cl uster_id>/subcommands. Therefore you must install a CLI module for each cluster. For example, if you connect to cluster 1, and install the Spark module, then connect to cluster 2 which is also running Spark, Spark CLI commands are not available until you install the module for that cluster. GUI The GUI sidebar tabs have been updated to offer a more intuitive experience. The Deployments subpage under the Services tab has been moved to a toggle-able modal in the Services page. The Security tab has been removed. The Secrets tab that used to be under Security is now a top-level tab. ENTERPRISE The Universe tab has been renamed to Catalog and the Installed subpage has been removed. The System Overview tab has been renamed to Overview. Breaking Changes Marathon Networking API Changes in 1.5. The networking section of the Marathon API has changed significantly in version 1.5. Marathon can still accept requests using the 1.4 version of

11 the API, but it will always reply with the 1.5 version of the app definition. This will break tools that consume networking-related fields of the service definition. View the documentation. TLS 1.0 is no longer enabled by default in Admin Router. ENTERPRISE TLS 1.0 no longer meets common minimum security requirements. To use TLS 1.0, set adminrouter_tls_1_0_enabled to true in your config. yaml at install time. The default is false. Latest version of Marathon-LB is required for DC/OS Before upgrading to DC/OS , uninstall your existing Marathon-LB package and reinstall the updated version. REX-Ray configuration change. DC/OS upgrades REX-Ray from v0.3.3 to v0.9.0 and the REX-Ray configuration format has changed. If you have specified custom REX-Ray configuration in the rexray_config parameter of your config.yaml file, either update the configuration to the new format or remove rexray _config and set the parameter to rexray_config_preset: aws, which configures the rexray_config parameter to the default REX-Ray configuration bundled with DC/OS. This option has the benefit of automatically upgrading your cluster s REX-Ray configuration when you upgrade to a newer version of DC/OS. Note: The rexray_config_prese t: aws option is only relevant to DC/OS clusters running on AWS. New flow to change the dcos_url and log in. The new command to set up your cluster URL is dcos cluster setup < dcos_url>. For details, see CLI. Hard CFS CPU limits enabled by default. DC/OS 1.10 enforces hard CPU limits with CFS isolation for both the Docker and Universal Container Runtimes. This will give more predictable performance across all tasks but might lead to a slowdown for tasks (and thereby also deployments) who have previously have consumed more

12 CPU cycles than allocated. See MESOS-6134 for more details. Known Issues and Limitations Upgrade: During upgrade to DC/OS 1.10, there is a brief moment when the DNS resolution does not work. If a health check runs at that moment, it will fail and services will be reported as unhealthy. CORE Docker image pull config is re-used. DCOS Task state does not update after the agent running it was removed from the cluster. INFINITY [Data Svc] DC/OS Service Update / Config Update / Maintenance. ENTERPRISE MARATHON Marathon Client Java library does NOT work with Marathon 1.5.