HAProxy configuration

Transcription

1 Marathon LB Reference HAProxy configuration Marathon-LB works by automatically generating configuration for HAProxy and then reloading HAProxy as needed. Marathon-LB generates the HAProxy configuration based on application data available from the Marathon API. It can also subscribe to the Marathon Event Bus for real-time updates. When an application starts, stops, relocates or has any change in health status, Marathon-LB will automatically regenerate the HAProxy configuration and reload HAProxy. Components Statistics Statistics CSV Health check Configuration file view Get vhost to backend map Get app ID to backend map Reload configuration Host:Port/URI/ <public-node>:9090/haproxy?stats <public-node>:9090/haproxy?stats;csv <public-node>:9090/_haproxy_health_che ck <public-node>:9090/_haproxy_getconfig <public-node>:9090/_haproxy_getvhostma p <public-node>:9090/_haproxy_getappmap <public-node>:9090/_mlb_signal/hup*

2 Templates Marathon-LB has a templating feature for specifying custom HAProxy configuration parameters. Templates can be set either globally (for all apps), or on a per-app basis using labels. Let s demonstrate an example of how to specify our own global template. Here s the template we ll use: Global Template To specify a global template: 1. On your local machine, create a file called HAPROXY_HEAD in a directory called templates with the contents below: global daemon log /dev/log local0 log /dev/log local1 notice maxconn 4096 tune.ssl.default-dh-param 2048 defaults log global retries 3 maxconn 3000 timeout connect 5s timeout client 30s timeout server 30s option redispatch listen stats bind :9090 balance mode http stats enable monitor-uri /_haproxy_health_check In the code above, the following items have changed from the default: m axconn, timeout client, and timeout server.

3 2. Tar or zip the file. Here s a handy script you can use to do this. Take the file you created ( templates.tgz if you use the script), and make it available from an HTTP server. If you d like to use the sample one, use this URI: 3. Augment the Marathon-LB config by saving the following JSON in a file called options.json : { "marathon-lb": { "template-url":" 4. Launch the new Marathon-LB: dcos package install --options=options.json marathon-lb Your customized Marathon-LB HAProxy instance will now be running with the new template. A full list of the templates available can be found here. Per-app Templates To create a template for an individual app, modify the application definition. In the example below, the default template for the external NGINX application definition ( nginx-external.json ) has been modified to disable HTTP keep-alive. While this is an artificial example, there may be cases where you need to override certain defaults per-application. { "id": "nginx-external",

4 "container": { "type": "DOCKER", "docker": { "image": "nginx:1.7.7", "network": "BRIDGE", "portmappings": [ { "hostport": 0, "containerport": 80, "serviceport": ], "forcepullimage":true, "instances": 1, "cpus": 0.1, "mem": 65, "healthchecks": [{ "protocol": "HTTP", "path": "/", "portindex": 0, "timeoutseconds": 10, "graceperiodseconds": 10, "intervalseconds": 2, "maxconsecutivefailures": 10 ], "labels":{ "HAPROXY_GROUP":"external", "HAPROXY_0_BACKEND_HTTP_OPTIONS":" option forwardfor\n no option http-ke Other options you may want to specify include enabling the sticky option, redirecting to HTTPS, or specifying a vhost. "labels":{ "HAPROXY_0_STICKY":true, "HAPROXY_0_REDIRECT_TO_HTTPS":true, "HAPROXY_0_VHOST":"nginx.mesosphere.com" Another option you may want to specify when using a Java app is the following sticky option: "labels":{ "HAPROXY_GROUP": "external", "HAPROXY_0_MODE": "http", "HAPROXY_0_STICKY": true, "HAPROXY_0_BACKEND_STICKY_OPTIONS": " cookie JSESSIONID prefix nocache "

5 SSL Support Marathon-LB supports SSL, and you may specify multiple SSL certificates per frontend. Additional SSL certificates can be included by passing a list of paths with the extra --ssl-certs command line flag. You can inject your own SSL certificates into the Marathon-LB config by specifying the HAPROXY _SSL_CERT environment variable in your application definition. If you do not specify an SSL certificate, Marathon-LB will generate a selfsigned certificate at startup. If you are using multiple SSL certificates, you can select the SSL certificate per app service port by specifying the HAPROX Y_{n_SSL_CERT parameter, which corresponds to the file path for the SSL certificates specified. For example, you might have: "labels":{ "HAPROXY_0_VHOST":"nginx.mesosphere.com", "HAPROXY_0_SSL_CERT":"/etc/ssl/certs/nginx.mesosphere.com" The SSL certificates must be pre-loaded into the container for Marathon-LB to load them. You can do this by building your own image of Marathon-LB, rather than using the Mesosphere-provided image. Using HAProxy metrics HAProxy s statistics report can be used to monitor health, performance, and even make scheduling decisions. HAProxy s data consists of counters and 1-

6 second rates for various metrics. To illustrate how to use the metrics, we will use them to create an implementation of Marathon app autoscaling. For a given app, we can measure its performance in terms of requests per second for a given set of resources. If the app is stateless and scales horizontally, we can then scale the number of app instances proportionally to the number of requests per second averaged over N intervals. The autoscale script polls the HAProxy stats endpoint and automatically scales app instances based on the incoming requests.

7 The script takes the current RPS (requests per second) and divides that number by the target RPS per app instance. The result of this fraction is the number of app instances required (or rather, the ceiling of that fraction is the instances required).

8 To demonstrate autoscaling, we re going to use 3 separate Marathon apps: marathon-lb-autoscale - the script that monitors HAProxy and scales our app via the Marathon API. nginx - our demo app siege - a tool for generating HTTP requests 1. Begin by running marathon-lb-autoscale. The JSON app definition can be found here. Save the file and launch it on Marathon: dcos marathon app add The JSON app definition passes 2 important arguments to the tool: --ta rget-rps tells marathon-lb-autoscale identifies the target RPS and --a pps is a comma-separated list of the Marathon apps and service ports to monitor, concatenated with _. Each app could expose multiple service ports to the load balancer if configured to do so, and marathon-lbautoscale will scale the app to meet the greatest common denominator for the number of required instances. "args":[ "--marathon", " "--haproxy", " "--target-rps", "100", "--apps", "nginx_10000" ], Note: If you re not already running an external Marathon-LB instance, launch it with dcos package install Marathon-LB. 2. Launch your NGINX test instance. The JSON app definition can be found here. Save the file, and launch with:

9 dcos marathon app add 3. Launch siege, a tool for generating HTTP request traffic. The JSON app definition can be found here. Save the file, and launch with: dcos marathon app add Now, if you check the HAProxy status page, you should see requests hitting the NGINX instance: Under the Session rate section, you can see there are currently about 54 requests per second on the NGINX fronted. 4. Scale the siege app so that we generate a large number of HTTP requests:

10 dcos marathon app update /siege instances=15 After a few minutes you will see that the NGINX app has been automatically scaled up to serve the increased traffic. 5. Experiment with the parameters for marathon-lb-autoscale (which are [documented here][14]). Try changing the interval, number of samples, and other values until you achieve the desired effect. The default values are fairly conservative, which may or may not meet your expectations. It s suggested that you include a 50 percent safety factor in the target RPS. For example, if you measure your application as being able to meet SLAs at 1500 RPS with 1 CPU and 1GiB of memory, you may want to set the target RPS to 1000.