OPTIMISING PHP-FPM FOR PRODUCTION

Size: px

Start display at page:

Download "OPTIMISING PHP-FPM FOR PRODUCTION"

Nathan Flynn
5 years ago
Views:

1 OPTIMISING PHP-FPM FOR PRODUCTION

2 OPTIMISING PHP-FPM FOR PRODUCTION ARNE BLANKERTS Principal Consultant & Co-Founder thephp.cc SEBASTIAN HEUER Developer Advocate die kartenmacherei

3 "I DON'T THINK I HAVE EVER TOUCHED THE DEFAULT CONFIGURATION" ~ ANONYMOUS SCOTLANDPHP ORGANISER

4 WARNING: [pool www] server reached pm.max_children setting (50), consider raising it.

6 ANALYSING THE STATUS QUO

7 FPM ERROR LOG

8 WARNING: [pool www] seems busy (you may need to increase pm.start_servers, or pm.min/ max_spare_servers), spawning 32 children, there are 0 idle, and 67 total children

9 FPM STATUS PAGE

10 /etc/php-fpm.d/pool.conf pm.status_path = /status /nginx/sites-enabled/site.conf location /status { access_log off; allow ; deny all; include fastcgi_params; fastcgi_param SCRIPT_FILENAME $document_root$fastcgi_script_name; fastcgi_pass fpm:9000; }

14 MAX CHILDREN REACHED

15 POOL WORKER WORKER :9000 FPM MASTER PROCESS WORKER WORKER

16 dynamic vs. ondemand vs. static

17 /etc/php-fpm.d/pool.conf [poolname] ( ) pm = dynamic pm.start_servers = 2 pm.min_spare_servers = 1 pm.max_spare_servers = 3 pm.max_children = 5 ( )

18 /etc/php-fpm.d/pool.conf [poolname] ( ) pm = ondemand pm.start_servers = 2 pm.max_children = 5 pm.process_idle_timeout = 10s ( )

20 /etc/php-fpm.d/pool.conf [poolname] ( ) pm = static pm.max_children = 25 pm.max_requests = 500 ( )

22 Default PM 187 req/s Static PM, 25 children 335 req/s Static PM, 50 children 454 req/s AWS Instance c5.4xlarge (16 Cores, Intel Xeon Platinum 8000 series) Ubuntu LTS (ami-0bdf acdc4) RDS db.t2.small with MariaDB Benchmark command: ab -t60 -c Median taken from five runs per set

23 AVOID REDUNDANT LOGGING

24 OPCACHE

26 TUNE IT!

27 opcache.max_accelerated_files = opcache.memory_consumption = 512 opcache.validate_timestamps = 0 opcache.file_update_protection = 0 opcache.save_comments = 0 <= caution!

28 PRELOAD CODE

29 $ phpab -w -o warm.php src phpab Copyright (C) by Arne Blankerts and Contributors Scanning directory src Autoload file warm.php generated. $ cat warm.php <?php // this is an autogenerated file - do not edit opcache_compile_file( DIR. '/src/http/request.php'); opcache_compile_file( DIR. '/src/http/response.php'); opcache_compile_file( DIR. '/src/http/router.php'); opcache_compile_file( DIR. '/src/application.php'); opcache_compile_file( DIR. '/src/basket/basket.php'); opcache_compile_file( DIR. '/src/basket/persistence/basketrepository.php'); opcache_compile_file( DIR. '/src/basket/basketservice.php'); opcache_compile_file( DIR. '/src/basket/views/basketview.php'); opcache_compile_file( DIR. '/src/basket/views/flyoutview.php'); opcache_compile_file( DIR. '/src/catalog/catalogservice.php'); opcache_compile_file( DIR. '/src/catalog/product.php'); opcache_compile_file( DIR. '/src/catalog/persistence/productrepository.php'); opcache_compile_file( DIR. '/src/http/basket/actions/addtobasketcommand.php'); opcache_compile_file( DIR. '/src/http/basket/actions/basketquery.php'); opcache_compile_file( DIR. '/src/http/basket/actions/flyoutquery.php');

30 SESSION HANDLING

31 /etc/php/php.ini session_probability = 0

32 <?php session_start(); session_gc(); session_destroy();

33 USE REDIS SESSIONS

34 /etc/php/php.ini session.save_handler = redis session.save_path = unix:///var/run/redis.sock?persistent=1

35 Dev Default Without Xdebug Without FPM access log With OPCache Persistent Connections Tuned OPCache Redis Sessions Without Session GC 312 req/s 524 req/s 532 req/s 758 req/s 875 req/s 912 req/s 934 req/s 992 req/s Intel Core 2.60GHz NVM SSD PHP , nginx , MariaDB Custom PHP Application Benchmark command: ab -t60 -c100 -n <URL> - Median taken from three runs per set

36 MULTIPLE POOLS

37 WORKER WORKER POOL X WORKER :9000 FPM MASTER PROCESS WORKER WORKER WORKER WORKER POOL Y WORKER WORKER

38 WORKER WORKER POOL X WORKER :9001 FPM MASTER PROCESS WORKER WORKER WORKER WORKER POOL Y WORKER WORKER

39 OPTIMISED FOR USE CASES

40 [www] user = web-user group = web-user listen = :9000 listen.owner = web-user listen.group = web-user listen.mode = 0666 slowlog = /var/log/php7.2-fpm/slow.log request_slowlog_timeout = 1s pm = static pm.max_children = 200 pm.max_requests = pm.status_path = /status php_admin_value[memory_limit] = 32M

41 [backend] user = web-user group = web-user listen = :9001 listen.owner = web-user listen.group = web-user listen.mode = 0666 pm = static pm.max_children = 20 pm.max_requests = 500 pm.status_path = /status php_admin_value[memory_limit] = 256M

42 upstream php_get { server unix:/var/run/php-fpm/ } upstream php_post { server unix:/var/run/php-fpm/post.sock; } server { listen 80; server_name scotlandphp.local; root /webspace/cqrs/public; index index.html; location / { try_files } } { fastcgi_pass php_$request_method; include fastcgi_params; fastcgi_param REQUEST_URI $document_uri; fastcgi_param SCRIPT_FILENAME /webspace/cqrs/$request_method.php; }

43 SEPARATE POOL PER APPLICATION VERSION

44 REMOVE UNUSED EXTENSIONS

45 SEPARATE FPM MASTER PROCESSES

46 [Unit] Description=The PHP FastCGI Process Manager After=syslog.target network.target [Service] Type=notify ExecStart=/usr/sbin/php-fpm -c /etc/php-fpm.d/scotphp.ini -y /etc/php-fpm.d/scot-fpm.conf --nodaemonize ExecReload=/bin/kill -USR2 $MAINPID PrivateTmp=true RuntimeDirectory=php-fpm2 RuntimeDirectoryMode=0755 [Install] WantedBy=multi-user.target

47 SEPARATE MACHINES

48 FPM-1 SESSIONS WEBSERVER FPM-2 DATA FPM-N

49 upstream php-pool { server unix:/run/php-fpm/ max_cons=10; server :9000 weight=5; server :1345 max_fails=3 fail_timeout=30s; server :9000 down; } server :9000 backup;

50 FPM-1 DATA READ SLAVE SESSIONS WEBSERVER FPM-2 DATA READ SLAVE DATA FPM-N DATA READ SLAVE

51 OPTIMISING PHP-FPM FOR PRODUCTION

52 FPM SLOW LOG

53 [poolname] ( ) slowlog = /var/log/php-fpm/$pool.log.slow request_slowlog_timeout = 1s

54 [23-Nov :28:21] [pool www] pid 8992 script_filename = /var/www/example/web/app_dev.php [0x00007efe32a14a40] sleep() /var/www/example/src/appbundle/controller/defaultcontroller.php:18 [0x00007efe32a149d0] indexaction() /var/www/example/vendor/symfony/symfony/src/symfony/component/httpkernel/httpkernel.php:153 [0x00007efe32a14960] call_user_func_array() /var/www/example/vendor/symfony/symfony/src/symfony/component/httpkernel/httpkernel.php:153 [0x00007efe32a14470] handleraw() /var/www/example/vendor/symfony/symfony/src/symfony/component/httpkernel/httpkernel.php:68 [0x00007efe32a14320] handle() /var/www/example/vendor/symfony/symfony/src/symfony/component/httpkernel/kernel.php:169 [0x00007efe32a14250] handle() /var/www/example/web/app_dev.php:29

55 REDUCE APPLICATION I/O

56 USE PERSISTENT CONNECTIONS

57 <?php $pdo = new PDO( 'mysql:host',, [PDO::ATTR_PERSISTENT => true] );

58 <?php $mysql = new Mysqli('p:hostname', );

59 <?php $redis = new Redis(); $redis->pconnect( );

60 OFFLOAD WORK FROM FPM

61 X-ACCEL-REDIRECT

62 NGINX FILE UPLOAD EXAMPLE

63 location /upload { limit_except POST { deny all; } client_body_temp_path client_body_in_file_only /var/www/uploads; on; client_body_buffer_size 1024K; client_max_body_size 10G; fastcgi_pass include unix:/run/php-fpm/ fastcgi_params; fastcgi_pass_request_headers fastcgi_pass_request_body on; off; fastcgi_ignore_client_abort on; fastcgi_param X-FILE $request_body_file; fastcgi_index index.php; fastcgi_param SCRIPT_FILENAME /var/www/php/index.php; }

64 NEXT LEVEL: CQRS

65 Dev Default Without Xdebug Without FPM access log With OPCache Persistent Connections Tuned OPCache Redis Sessions Without Session GC CQRS 312 req/s 524 req/s 532 req/s 758 req/s 875 req/s 912 req/s 934 req/s 992 req/s req/s Intel Core 2.60GHz NVM SSD PHP , nginx , MariaDB Custom PHP Application Benchmark command: ab -t60 -c100 -n <URL> - Median taken from three runs per set

66 THANK YOU!

OPTIMIZING PHP-FPM FOR PRODUCTION

OPTIMIZING PHP-FPM FOR PRODUCTION OPTIMIZING PHP-FPM FOR PRODUCTION ARNE BLANKERTS Principal Consultant & Co-Founder thephp.cc SEBASTIAN HEUER Developer Advocate die kartenmacherei ANALYZING THE STATUS