Monitoring Open Source Databases with Icinga

Size: px
Start display at page:

Download "Monitoring Open Source Databases with Icinga"

Transcription

1 Percona Live Amsterdam Monitoring Open Source Databases with Icinga

2 Bernd Erk Icinga

3 Introduction to Icinga

4 Quick Poll

5 Icinga is a scalable and extensible monitoring system which checks the availability of your resources, notifies users of outages and provides extensive metrics.

6 Icinga Quality, Testing and Community Support Icinga.org, dev.icinga.org, social media channels Icinga Web 2 Icinga Reports Icinga Doc Icinga Web Icinga 2 Icinga Classic (CGI) Icinga 3 rd Party Tools

7 Introduction to Icinga2 Icinga2 - Architecture

8 Multithreaded Perfdata Graphite Livestatus Modular Features Zone support Notify Compat Secure Agent Checker Gelf IDO No Nagios

9 Availability and scaling zones s Automatic redistribution of checks Zones for multitenancy environments

10 Open Source Databases

11 MySQLis MariaDB Percona Server h PostgreSQL L MongoDB Firebird SQLite

12 Availability Troubleshooting Replication-Status Capacity Metrics and performance data

13 check_mongodb_py connect connections replicaton_lag memory memory_mapped lock flushing last_flush_time replset_state index_miss_ratio collections database_size database_indexes replica_primary

14 check_postgres.pl archive_ready autovac_freeze backends bloat checkpoint cluster_id commitratio connection custom_query disabled_triggers disk_space fsm_pages prepared_txns query_runtime query_time replicate_row same_schema sequence settings_checksum

15 check_mysql_health connection-time uptime threads-connected threadcache-hitrate qcache-hitrate qcache-lowmem-prunes bufferpool-hitrate bufferpool-wait-free log-waits tablecache-hitrate table-lock-contention index-usage tmp-disk-tables slow-queries

16 const MySQLIcingaUsername = "root const MySQLIcingaPassword = root template Host "base-host-mysql" { vars.mysql_health_username = MySQLIcingaUsername vars.mysql_health_password = MySQLIcingaPassword vars.os = "Linux Linu x } object Host "live-mysql-1" { import "base-host-mysql" check_command = "hostalive" address = " " vars.dbtype = "mysql l }

17 /* * Apply for MySQLish basic connection */ apply Service "mysql_connection" { import "generic-service" check_interval = 10s retry_interval = 30s check_command = "mysql_health" vars.mysql_health_username = host.vars.mysql_health_username vars.mysql_health_password = host.vars.mysql_health_password vars.mysql_health_mode = "connection-time" assign where (host.address host.address6) && host.vars.dbtype == "mysql l }

18 Demo

19 Is this all?

20 Old Fart

21 mysql_healt object CheckCommand "mysql_health" { h import "ipv4-or-ipv6" command = [ PluginContribDir + "/check_mysql_health" ] arguments = { "--hostname" = { value = "$mysql_health_hostname$" description = "the database server's hostname" } "--port" = { value = "$mysql_health_port$" description = "the database's port...

22 ITL (Icinga Template Library) mysql_health postgres mongodb mssql_health db2_health oracle_health elasticsearch redis /usr/share/icinga2/include/plugins-contrib.d/databases.conf

23 object Host "live-mysql-1" { import "base-host-mysql" check_command = "hostalive" address = " " vars.dbtype = "mysql" } /* database checks */ vars.databases["icinga"] = { s mysql_health_warning = 2048//MB mysql_health_critical = 4096//MB } vars.databases["icingaweb2"] = { mysql_health_warning = 4096 //MB mysql_health_critical = 8192 //MB }

24 /* * Apply for MySQLish database size */ apply Service "mysql_size_" for (db_name => config in host.vars.databases) { import "generic-service" check_interval = 10s retry_interval = 30s check_command = "mysql_health" vars.mysql_health_username = host.vars.mysql_health_username vars.mysql_health_password = host.vars.mysql_health_password vars.mysql_health_mode = "sql" vars.mysql_health_name = "select sum(data_length + index_length) / 1024 / 1024 from information_schema.tables where table_schema = '" + db_name + "';" vars.mysql_health_name2 = "db_size" vars.mysql_health_units = "MB" } assign where (host.address host.address6) && host.vars.dbtype == "mysql

25 Icinga2 - Metrics

26 New Graphite Schema icinga2.$host.name$.host.$host.check_command$ icinga2.$host.name$.services.$service.name$.$service.check_command$ Threshold metrics enable_send_thresholds Metadata metrics enable_send_metadata

27 Demo

28 Icinga2 - API

29

30 HTTP with RESTful RESTf Url Schema X.509 and/or Basic ul Auth Create, Modify and Delete objects Event Stream based on Types and Filters

31 Demo

32 Conclusion

33 Download Icinga 2 and Icinga Web 2 Play with the Vagrant Vagrant boxes boxes Rethink your configuration Give us feedback

34 Enjoy your day

35 Thank You! dev.icinga.org /icinga +icinga

36 Rate My Session! 36

Monitoring Open Source Databases with Icinga

Monitoring Open Source Databases with Icinga PGConf EU Warsaw 26.10.2017 Monitoring Open Source Databases with Icinga Blerim Sheqa Product Manager Working @netways @bobapple Introduction to Icinga2 Quick Poll Icinga is a scalable and extensible monitoring

More information

CURRENT STATE OF ICINGA

CURRENT STATE OF ICINGA www.icinga.org CURRENT STATE OF ICINGA #OSMC Nuremberg 11/17/2015 Bernd Erk Icinga co-founder Project organizer @gethash ICINGA - INTRODUCTION Quick Poll Open Source Enterprise Monitoring Icinga is a

More information

CURRENT STATE OF ICINGA

CURRENT STATE OF ICINGA FlossUK 2014 Brighton 20th March - TEAM ICINGA CURRENT STATE OF ICINGA WWW.ICINGA.ORG Agenda Introduction Tools & Platform Icinga project update New in Icinga 1.x Icinga 2 Icinga Web 2 What s next Questions

More information

ELK Stack Elasticsearch, Logstash, Kibana

ELK Stack Elasticsearch, Logstash, Kibana www.netways.de ELK Stack Elasticsearch, Logstash, Kibana Munich 19.10.2015 INTRODUCTION Bernd Erk CEO at NETWAYS GmbH Co-Founder Icinga @gethash info@netways.de NETWAYS GmbH Open Source Service Provider

More information

The Art of Container Monitoring. Derek Chen

The Art of Container Monitoring. Derek Chen The Art of Container Monitoring Derek Chen 2016.9.22 About me DevOps Engineer at Trend Micro Agile transformation Micro service and cloud service Docker integration Monitoring system development Automate

More information

Monitoring MySQL Performance with Percona Monitoring and Management

Monitoring MySQL Performance with Percona Monitoring and Management Monitoring MySQL Performance with Percona Monitoring and Management Your Presenters Michael Coburn - PMM Product Manager Working at Percona for almost 5 years Consultant, Manager, TAM, now Product Manager

More information

Monitoring MySQL Performance with Percona Monitoring and Management

Monitoring MySQL Performance with Percona Monitoring and Management Monitoring MySQL Performance with Percona Monitoring and Management Santa Clara, California April 23th 25th, 2018 MIchael Coburn, Product Manager Your Presenter Product Manager for PMM (also Percona Toolkit

More information

Icinga and Deutsche Welle

Icinga and Deutsche Welle Icinga and Deutsche Welle 21-03-12 FLOSS UK Bernd Erk INTRODUCTING NETWAYS NETWAYS Expertise OPEN SOURCE SYSTEMS MANAGEMENT OPEN SOURCE DATA CENTER Monitoring & Reporting Configuration Management Service

More information

Open Source Database Performance Optimization and Monitoring with PMM. Fernando Laudares, Vinicius Grippa, Michael Coburn Percona

Open Source Database Performance Optimization and Monitoring with PMM. Fernando Laudares, Vinicius Grippa, Michael Coburn Percona Open Source Database Performance Optimization and Monitoring with PMM Fernando Laudares, Vinicius Grippa, Michael Coburn Percona Fernando Laudares 2 Vinicius Grippa 3 Michael Coburn Product Manager for

More information

Purpose. Target Audience. Summary. Automation Overview. Nagios XI. Automated Host Management

Purpose. Target Audience. Summary. Automation Overview. Nagios XI. Automated Host Management Purpose This document describes how to automate adding and removing hosts and services in Nagios XI from the command line. Target Audience This document is intended for use by Administrators and Developers

More information

collectd An introduction

collectd An introduction collectd An introduction About me Florian "octo" Forster Open-source work since 2001 Started collectd in 2005 Agenda collectd Aggregation of metrics Alerting with Icinga Agenda collectd Aggregation of

More information

Amazon s Database Migration Service, a magical wand for moving from closed source solutions? Dimitri Vanoverbeke Solution Percona

Amazon s Database Migration Service, a magical wand for moving from closed source solutions? Dimitri Vanoverbeke Solution Percona Amazon s Database Migration Service, a magical wand for moving from closed source solutions? Dimitri Vanoverbeke Solution Engineer @ Percona Who Am I I am your innocent Percona Solution Engineer. Living

More information

MongoDB Monitoring and Performance for The Savvy DBA

MongoDB Monitoring and Performance for The Savvy DBA MongoDB Monitoring and Performance for The Savvy DBA Key metrics to focus on for day-to-day MongoDB operations Bimal Kharel Senior Technical Services Engineer Percona Webinar 2017-05-23 1 What I ll cover

More information

ProxySQL's Internals

ProxySQL's Internals ProxySQL's Internals What is ProxySQL? A "Layer 7" database proxy MySQL / ClickHouse protocol aware High Performance High Availability Architecture Overview Clients connect to ProxySQL Requests are evaluated

More information

Jailbreaking MySQL Replication Featuring Tungsten Replicator. Robert Hodges, CEO, Continuent

Jailbreaking MySQL Replication Featuring Tungsten Replicator. Robert Hodges, CEO, Continuent Jailbreaking MySQL Replication Featuring Tungsten Robert Hodges, CEO, Continuent About Continuent / Continuent is the leading provider of data replication and clustering for open source relational databases

More information

MySQL Cluster Ed 2. Duration: 4 Days

MySQL Cluster Ed 2. Duration: 4 Days Oracle University Contact Us: +65 6501 2328 MySQL Cluster Ed 2 Duration: 4 Days What you will learn This MySQL Cluster training teaches you how to install and configure a real-time database cluster at

More information

Plugin Monitoring for GLPI

Plugin Monitoring for GLPI Plugin Monitoring for GLPI Introduction 2 TOC 3 Contents Preface: Introduction...v Goals of this project... v Why is it revolutionnary?...v Links...v Internet site...v IRC-Channel...v Terms used in this

More information

Icinga Open Source Monitoring

Icinga Open Source Monitoring Icinga Open Source Monitoring Icinga Development Team @ Open Source Monitoring Conference 28.10.2009 - Nuremberg Agenda The Icinga Project Project Structure Tools and Plattform Icinga Development Team

More information

Application monitoring with BELK. Nishant Sahay, Sr. Architect Bhavani Ananth, Architect

Application monitoring with BELK. Nishant Sahay, Sr. Architect Bhavani Ananth, Architect Application monitoring with BELK Nishant Sahay, Sr. Architect Bhavani Ananth, Architect Why logs Business PoV Input Data Analytics User Interactions /Behavior End user Experience/ Improvements 2017 Wipro

More information

Amazon s Database Migration Service, a magical wand for moving from closed source solutions? Dimitri Vanoverbeke Solution Percona

Amazon s Database Migration Service, a magical wand for moving from closed source solutions? Dimitri Vanoverbeke Solution Percona Amazon s Database Migration Service, a magical wand for moving from closed source solutions? Dimitri Vanoverbeke Solution Engineer @ Percona Who Am I I am your innocent Percona Solution Engineer. Living

More information

Real Life Web Development. Joseph Paul Cohen

Real Life Web Development. Joseph Paul Cohen Real Life Web Development Joseph Paul Cohen joecohen@cs.umb.edu Index 201 - The code 404 - How to run it? 500 - Your code is broken? 200 - Someone broke into your server? 400 - How are people using your

More information

MySQL Performance Optimization and Troubleshooting with PMM. Peter Zaitsev, CEO, Percona Percona Technical Webinars 9 May 2018

MySQL Performance Optimization and Troubleshooting with PMM. Peter Zaitsev, CEO, Percona Percona Technical Webinars 9 May 2018 MySQL Performance Optimization and Troubleshooting with PMM Peter Zaitsev, CEO, Percona Percona Technical Webinars 9 May 2018 Few words about Percona Monitoring and Management (PMM) 100% Free, Open Source

More information

Ingest. David Pilato, Developer Evangelist Paris, 31 Janvier 2017

Ingest. David Pilato, Developer Evangelist Paris, 31 Janvier 2017 Ingest David Pilato, Developer Evangelist Paris, 31 Janvier 2017 Data Ingestion The process of collecting and importing data for immediate use in a datastore 2 ? Simple things should be simple. Shay Banon

More information

Relational Database Service. User Guide. Issue 05 Date

Relational Database Service. User Guide. Issue 05 Date Issue 05 Date 2017-02-08 Contents Contents 1 Introduction... 1 1.1 Concepts... 2 1.1.1 RDS... 2 1.1.2 DB Cluster... 2 1.1.3 DB Instance... 2 1.1.4 DB Backup... 3 1.1.5 DB Snapshot... 3 1.2 RDS DB Instances...

More information

Ingest. Aaron Mildenstein, Consulting Architect Tokyo Dec 14, 2017

Ingest. Aaron Mildenstein, Consulting Architect Tokyo Dec 14, 2017 Ingest Aaron Mildenstein, Consulting Architect Tokyo Dec 14, 2017 Data Ingestion The process of collecting and importing data for immediate use 2 ? Simple things should be simple. Shay Banon Elastic{ON}

More information

Using Percona Monitoring and Management to Troubleshoot MySQL Performance Issues

Using Percona Monitoring and Management to Troubleshoot MySQL Performance Issues Using Percona Monitoring and Management to Troubleshoot MySQL Performance Issues Michael Coburn, Product Manager PMM September 7th, 2017 1 Your presenter Michael Coburn - Product Manager PMM Working at

More information

How To Remove Information_schema From Sql File

How To Remove Information_schema From Sql File How To Remove Information_schema From Sql File Just remove TABLE_CATALOG from your query. exists ( select 1 from information_schema.tables where table_catalog = @dbname and table_schema = 'dbo' You can

More information

Plugin Monitoring for GLPI

Plugin Monitoring for GLPI Plugin Monitoring for GLPI Introduction 2 TOC 3 Contents Preface: Introduction...v Goals of this project... v Why is it revolutionary?...v Links...v Internet site...v IRC-Channel...vi Terms used in this

More information

Monitoring and Trending With MySQL. Michael DelNegro Principal Database Administrator AOL

Monitoring and Trending With MySQL. Michael DelNegro Principal Database Administrator AOL Monitoring and Trending With MySQL Michael DelNegro Principal Database Administrator AOL 1 Presentation Overview Introduction Monitoring Overview Monitoring@AOL Challenges Resources An Announcement 2 About

More information

How to store millions metrics per second. Vladimir Smirnov System Administrator

How to store millions metrics per second. Vladimir Smirnov System Administrator Graphite@Scale: How to store millions metrics per second Vladimir Smirnov System Administrator FOSDEM 2017 5 February 2017 Why you might need to store your metrics? Most common cases: Capacity planning

More information

Open Source Database Ecosystem in Peter Zaitsev 3 October 2016

Open Source Database Ecosystem in Peter Zaitsev 3 October 2016 Open Source Database Ecosystem in 2016 Peter Zaitsev 3 October 2016 Great things are happening with Open Source Databases It is great Industry and Community to be a part of 2 Why? 3 Data Continues Exponential

More information

Accelerate MySQL for Demanding OLAP and OLTP Use Case with Apache Ignite December 7, 2016

Accelerate MySQL for Demanding OLAP and OLTP Use Case with Apache Ignite December 7, 2016 Accelerate MySQL for Demanding OLAP and OLTP Use Case with Apache Ignite December 7, 2016 Nikita Ivanov CTO and Co-Founder GridGain Systems Peter Zaitsev CEO and Co-Founder Percona About the Presentation

More information

File system, 199 file trove-guestagent.conf, 40 flavor-create command, 108 flavor-related APIs list, 280 show details, 281 Flavors, 107

File system, 199 file trove-guestagent.conf, 40 flavor-create command, 108 flavor-related APIs list, 280 show details, 281 Flavors, 107 Index A Amazon AWS, 7, 10 Amazon RDS DBaaS solutions, 10 service vs. platform, 8 single-tenant DBaaS solution, 6 Amazon RedShift DBaaS solutions, 10 single-tenant DBaaS solution, 6 AMD-V, 17 AMQP server

More information

Manage MySQL like a devops sysadmin. Frédéric Descamps

Manage MySQL like a devops sysadmin. Frédéric Descamps Manage MySQL like a devops sysadmin Frédéric Descamps Webinar Oct 2012 Who am I? Frédéric Descamps @lefred http://about.be/lefred Managing MySQL since 3.23 (as far as I remember) devops believer www.percona.com

More information

Monitoring MySQL with Prometheus & Grafana

Monitoring MySQL with Prometheus & Grafana Monitoring MySQL with Prometheus & Grafana Julien Pivotto (@roidelapluie) Percona University Belgium June 22nd, 2017 SELECT USER(); Julien "roidelapluie" Pivotto @roidelapluie Sysadmin at inuits Automation,

More information

DataSunrise Database Security Suite Release Notes

DataSunrise Database Security Suite Release Notes www.datasunrise.com DataSunrise Database Security Suite 4.0.4 Release Notes Contents DataSunrise Database Security Suite 4.0.4... 3 New features...3 Known limitations... 3 Version history... 5 DataSunrise

More information

Run your own Open source. (MMS) to avoid vendor lock-in. David Murphy MongoDB Practice Manager, Percona

Run your own Open source. (MMS) to avoid vendor lock-in. David Murphy MongoDB Practice Manager, Percona Run your own Open source Click alternative to edit to Master Ops-Manager title style (MMS) to avoid vendor lock-in David Murphy MongoDB Practice Manager, Percona Who is this Person and What Does He Know?

More information

FUJITSU Software ServerView Cloud Monitoring Manager V1.1. Release Notes

FUJITSU Software ServerView Cloud Monitoring Manager V1.1. Release Notes FUJITSU Software ServerView Cloud Monitoring Manager V1.1 Release Notes J2UL-2170-01ENZ0(00) July 2016 Contents Contents About this Manual... 4 1 What's New?...6 1.1 Performance Improvements... 6 1.2

More information

Alerting With MySQL and Nagios

Alerting With MySQL and Nagios Alerting With MySQL and Nagios Sheeri Cabral Senior DB Admin/Architect Mozilla @sheeri What is Monitoring? Threshold alerting Graphing/trending Why Monitor? Problem alerting Find patterns Early warning

More information

Professional PostgreSQL monitoring made easy. Kaarel Moppel - p2d2.cz 2019 Prague

Professional PostgreSQL monitoring made easy. Kaarel Moppel - p2d2.cz 2019 Prague Professional PostgreSQL monitoring made easy Kaarel Moppel - p2d2.cz 2019 Prague Who? Kaarel Moppel Senior Database Consultant km@cybertec.at PostgreSQL Database Services Training Consulting High Availability

More information

Alerting With MySQL and Nagios

Alerting With MySQL and Nagios Alerting With MySQL and Nagios http://bit.ly/nagios_mysql2013 Sheeri Cabral Senior DB Admin/Architect Mozilla @sheeri What is Monitoring? Threshold alerting Graphing/trending Why Monitor? Problem alerting

More information

Advanced Topics on the Mirth Connect Interface Engine. July 6, 2016

Advanced Topics on the Mirth Connect Interface Engine. July 6, 2016 Advanced Topics on the Mirth Connect Interface Engine July 6, 2016 You have been automatically muted. Please use the Q&A panel to submit questions during the presentation PRESENTER Nate Bessa Technical

More information

CO MySQL for Database Administrators

CO MySQL for Database Administrators CO-61762 MySQL for Database Administrators Summary Duration 5 Days Audience Administrators, Database Designers, Developers Level Professional Technology Oracle MySQL 5.5 Delivery Method Instructor-led

More information

Mysql Workbench Doesn't Show

Mysql Workbench Doesn't Show Mysql Workbench Doesn't Show Information_schema Right now both on MySQL Workbench and also phpmyadmin I can see and view schema and the tables in side it. 'show create table 'actions'': Table 'resource.actions'

More information

Eduardo

Eduardo Eduardo Silva @edsiper eduardo@treasure-data.com About Me Eduardo Silva Github & Twitter Personal Blog @edsiper http://edsiper.linuxchile.cl Treasure Data Open Source Engineer Fluentd / Fluent Bit http://github.com/fluent

More information

MySQL for Database Administrators Ed 3.1

MySQL for Database Administrators Ed 3.1 Oracle University Contact Us: 1.800.529.0165 MySQL for Database Administrators Ed 3.1 Duration: 5 Days What you will learn The MySQL for Database Administrators training is designed for DBAs and other

More information

Delegates must have a working knowledge of MariaDB or MySQL Database Administration.

Delegates must have a working knowledge of MariaDB or MySQL Database Administration. MariaDB Performance & Tuning SA-MARDBAPT MariaDB Performance & Tuning Course Overview This MariaDB Performance & Tuning course is designed for Database Administrators who wish to monitor and tune the performance

More information

DBTuna 2.x Quick Start Guide 12 September 2012

DBTuna 2.x Quick Start Guide 12 September 2012 DBTuna 2.x Quick Start Guide 12 September 2012 This guide describes basic steps for starting the DBTuna server software, and configuring and running DBTuna monitoring Agents. The guide is intended for

More information

ITS. MySQL for Database Administrators (40 Hours) (Exam code 1z0-883) (OCP My SQL DBA)

ITS. MySQL for Database Administrators (40 Hours) (Exam code 1z0-883) (OCP My SQL DBA) MySQL for Database Administrators (40 Hours) (Exam code 1z0-883) (OCP My SQL DBA) Prerequisites Have some experience with relational databases and SQL What will you learn? The MySQL for Database Administrators

More information

Assuming you have Icinga 2 installed properly, and the API is not enabled, the commands will guide you through the basics:

Assuming you have Icinga 2 installed properly, and the API is not enabled, the commands will guide you through the basics: Icinga 2 Contents This page references the GroundWork Cloud Hub and the Icinga 2 virtualization environment. 1.0 Prerequisites 1.1 Enable the API The Icinga 2 system you run needs to have the API feature

More information

MarkLogic Server. Monitoring MarkLogic Guide. MarkLogic 5 October, Copyright 2012 MarkLogic Corporation. All rights reserved.

MarkLogic Server. Monitoring MarkLogic Guide. MarkLogic 5 October, Copyright 2012 MarkLogic Corporation. All rights reserved. Monitoring MarkLogic Guide 1 MarkLogic 5 October, 2011 Last Revised: 5.0-3, March, 2012 Copyright 2012 MarkLogic Corporation. All rights reserved. 1.0 Monitoring MarkLogic Server...4 1.1 Overview...4 1.2

More information

COSMOS. Controls Open Source MOnitoring System Project Status Report. Frank on behalf of the COSMOS core team BE-CO Technical Meeting:

COSMOS. Controls Open Source MOnitoring System Project Status Report. Frank on behalf of the COSMOS core team BE-CO Technical Meeting: COSMOS Controls Open Source MOnitoring System Project Status Report Frank Frank on behalf of the COSMOS core team BE-CO Technical Meeting: 09-11-2017 Laura Julien Luigi Felix Sergey Agenda ABACUS review

More information

VMware vrealize operations Management Pack FOR. PostgreSQL. User Guide

VMware vrealize operations Management Pack FOR. PostgreSQL. User Guide VMware vrealize operations Management Pack FOR PostgreSQL User Guide TABLE OF CONTENTS 1. Purpose... 3 2. Introduction to the Management Pack... 3 2.1 How the Management Pack Collects Data... 3 2.2 Data

More information

Monitor your containers with the Elastic Stack. Monica Sarbu

Monitor your containers with the Elastic Stack. Monica Sarbu Monitor your containers with the Elastic Stack Monica Sarbu Monica Sarbu Team lead, Beats team monica@elastic.co 3 Monitor your containers with the Elastic Stack Elastic Stack 5 Beats are lightweight shippers

More information

Trending with Purpose. Jason Dixon

Trending with Purpose. Jason Dixon Trending with Purpose Jason Dixon Monitoring Nagios Fault Detection Notifications Escalations Acknowledgements/Downtime http://www.nagios.org/ Nagios Pros Free Extensible Plugins Configuration templates

More information

Analyze MySQL Query Performance with Percona Cloud Tools

Analyze MySQL Query Performance with Percona Cloud Tools Analyze MySQL Query Performance with Percona Cloud Tools Vadim Tkachenko Percona, Co-founder /CTO www.percona.com cloud.percona.com www.mysqlperformanceblog.com 2 This webinar Performance Percona Cloud

More information

Beyond MySQL 5.1 What is happening in MySQL Space. Feb 16, 2011 Percona Live San Francisco,CA by Peter Zaitsev, Percona Inc

Beyond MySQL 5.1 What is happening in MySQL Space. Feb 16, 2011 Percona Live San Francisco,CA by Peter Zaitsev, Percona Inc What is happening in MySQL Space Feb 16, 2011 Percona Live San Francisco,CA by Peter Zaitsev, Percona Inc Welcome! Thanks to our sponsors for making Percona Live so wonderfully pleasant event! Clustrix

More information

Mega-scale Postgres How to run 1,000,000 Postgres Databases

Mega-scale Postgres How to run 1,000,000 Postgres Databases Mega-scale Postgres How to run 1,000,000 Postgres Databases Program What is Heroku & Heroku Postgres? Organizing principles for mega-scale operations Heroku Postgres Code deployment is good, but what

More information

MySQL InnoDB Cluster. New Feature in MySQL >= Sergej Kurakin

MySQL InnoDB Cluster. New Feature in MySQL >= Sergej Kurakin MySQL InnoDB Cluster New Feature in MySQL >= 5.7.17 Sergej Kurakin Sergej Kurakin Age: 36 Company: NFQ Technologies Position: Software Engineer Problem What if your database server fails? Reboot? Accidental

More information

Percona Software & Services Update

Percona Software & Services Update Percona Software & Services Update Q3 2016 Peter Zaitsev,CEO Percona Technical Webinars September 28, 2016 Why? Talking to Many Users and Customers Ge6ng What have you been up to? Ques@on This is a way

More information

Use Case: Scalable applications

Use Case: Scalable applications Use Case: Scalable applications 1. Introduction A lot of companies are running (web) applications on a single machine, self hosted, in a datacenter close by or on premise. The hardware is often bought

More information

Lanka Education and Research Network. Network Monitoring LEARN. 28 th November IT Center, University of Peradeniya Dilum Samarasinhe (LEARN)

Lanka Education and Research Network. Network Monitoring LEARN. 28 th November IT Center, University of Peradeniya Dilum Samarasinhe (LEARN) Lanka Education and Research Network Network Monitoring 28 th November 2017 IT Center, University of Peradeniya Dilum Samarasinhe () Overview Neywork Monitoring System Cacti LibreNMS What is Network Monitoring?

More information

To Shard or Not to Shard That is the question! Peter Zaitsev April 21, 2016

To Shard or Not to Shard That is the question! Peter Zaitsev April 21, 2016 To Shard or Not to Shard That is the question! Peter Zaitsev April 21, 2016 Story Let s start with the story 2 First things to decide Before you decide how to shard you d best understand whether or not

More information

DISQUS. Continuous Deployment Everything. David

DISQUS. Continuous Deployment Everything. David DISQUS Continuous Deployment Everything David Cramer @zeeg Continuous Deployment Shipping new code as soon as it s ready (It s really just super awesome buildbots) Workflow Commit (master) Integration

More information

MongoDB and Mysql: Which one is a better fit for me? Room 204-2:20PM-3:10PM

MongoDB and Mysql: Which one is a better fit for me? Room 204-2:20PM-3:10PM MongoDB and Mysql: Which one is a better fit for me? Room 204-2:20PM-3:10PM About us Adamo Tonete MongoDB Support Engineer Agustín Gallego MySQL Support Engineer Agenda What are MongoDB and MySQL; NoSQL

More information

Overview. SUSE OpenStack Cloud Monitoring

Overview. SUSE OpenStack Cloud Monitoring Overview SUSE OpenStack Cloud Monitoring Overview SUSE OpenStack Cloud Monitoring Publication Date: 08/04/2017 SUSE LLC 10 Canal Park Drive Suite 200 Cambridge MA 02141 USA https://www.suse.com/documentation

More information

Using DC/OS for Continuous Delivery

Using DC/OS for Continuous Delivery Using DC/OS for Continuous Delivery DevPulseCon 2017 Elizabeth K. Joseph, @pleia2 Mesosphere 1 Elizabeth K. Joseph, Developer Advocate, Mesosphere 15+ years working in open source communities 10+ years

More information

Conceptual Modeling on Tencent s Distributed Database Systems. Pan Anqun, Wang Xiaoyu, Li Haixiang Tencent Inc.

Conceptual Modeling on Tencent s Distributed Database Systems. Pan Anqun, Wang Xiaoyu, Li Haixiang Tencent Inc. Conceptual Modeling on Tencent s Distributed Database Systems Pan Anqun, Wang Xiaoyu, Li Haixiang Tencent Inc. Outline Introduction System overview of TDSQL Conceptual Modeling on TDSQL Applications Conclusion

More information

Mysql Cluster Global Schema Lock

Mysql Cluster Global Schema Lock Mysql Cluster Global Schema Lock This definitely was not the case with MySQL Cluster 7.3.x. (Warning) NDB: Could not acquire global schema lock (4009)Cluster Failure 2015-03-25 14:51:53. Using High-Speed

More information

MySQL Database Administrator Training NIIT, Gurgaon India 31 August-10 September 2015

MySQL Database Administrator Training NIIT, Gurgaon India 31 August-10 September 2015 MySQL Database Administrator Training Day 1: AGENDA Introduction to MySQL MySQL Overview MySQL Database Server Editions MySQL Products MySQL Services and Support MySQL Resources Example Databases MySQL

More information

Storing metrics at scale with. Gnocchi. Julien Danjou OpenStack Day France 22 November 2016

Storing metrics at scale with. Gnocchi. Julien Danjou OpenStack Day France 22 November 2016 Storing metrics at scale with Gnocchi Julien Danjou OpenStack Day France 22 November 2016 Hello! I am Julien Danjou Principal Software Engineer at Red Hat You can find me at @juldanjou 1 What s the problem?

More information

OpenStack Trove Open Source DBaaS for the Cloud

OpenStack Trove Open Source DBaaS for the Cloud OpenStack Trove Open Source DBaaS for the Cloud Bartosz Żurkowski Samsung R&D Institute Poland SOSCON 2018 SAMSUNG OPEN SOURCE CONFERENCE 2018 Outline Database as a Service introduction Solutions available

More information

Utilizing Databases in Grid Engine 6.0

Utilizing Databases in Grid Engine 6.0 Utilizing Databases in Grid Engine 6.0 Joachim Gabler Software Engineer Sun Microsystems http://sun.com/grid Current status flat file spooling binary format for jobs ASCII format for other objects accounting

More information

Percona XtraDB Cluster

Percona XtraDB Cluster Percona XtraDB Cluster Ensure High Availability Presenter Karthik P R CEO Mydbops www.mydbops.com info@mydbops.com Mydbops Mydbops is into MySQL/MongoDB Support and Consulting. It is founded by experts

More information

WMLUG July Nagios, PNP4Nagios, and NConf by Patrick TenHoopen

WMLUG July Nagios, PNP4Nagios, and NConf by Patrick TenHoopen WMLUG July 2015 Nagios, PNP4Nagios, and NConf by Patrick TenHoopen What is Nagios? Nagios is an IT infrastructure monitoring and alerting tool. The free Nagios DIY Core provides the central monitoring

More information

IT Certification Exams Provider! Weofferfreeupdateserviceforoneyear! h ps://www.certqueen.com

IT Certification Exams Provider! Weofferfreeupdateserviceforoneyear! h ps://www.certqueen.com IT Certification Exams Provider! Weofferfreeupdateserviceforoneyear! h ps://www.certqueen.com Exam : 005-002 Title : Certified MySQL 5.0 DBA Part I Version : Demo 1 / 10 1. Will the following SELECT query

More information

MarkLogic Server. Monitoring MarkLogic Guide. MarkLogic 8 February, Copyright 2015 MarkLogic Corporation. All rights reserved.

MarkLogic Server. Monitoring MarkLogic Guide. MarkLogic 8 February, Copyright 2015 MarkLogic Corporation. All rights reserved. Monitoring MarkLogic Guide 1 MarkLogic 8 February, 2015 Last Revised: 8.0-1, February, 2015 Copyright 2015 MarkLogic Corporation. All rights reserved. Table of Contents Table of Contents Monitoring MarkLogic

More information

Could Not Fetch Schema Routine Status Mysql

Could Not Fetch Schema Routine Status Mysql Could Not Fetch Schema Routine Status Mysql BEGIN and END are keywords but not reserved, so their use as identifiers does not require quoting. INTERVAL is a reserved keyword and must be quoted to be. Modyllic

More information

A Nagios Plugin for monitoring SAP HANA. This turns your Nagios into a powerful monitoring for SAP HANA.

A Nagios Plugin for monitoring SAP HANA. This turns your Nagios into a powerful monitoring for SAP HANA. SAP HANA Monitoring A Nagios Plugin for monitoring SAP HANA. This turns your Nagios into a powerful monitoring for SAP HANA. This Plugin allows to monitor CPU Usage Memory Usage Volume Usage License (Valid

More information

The Care and Feeding of a MySQL Database for Linux Adminstrators. Dave Stokes MySQL Community Manager

The Care and Feeding of a MySQL Database for Linux Adminstrators. Dave Stokes MySQL Community Manager The Care and Feeding of a MySQL Database for Linux Adminstrators Dave Stokes MySQL Community Manager David.Stokes@Oracle.com Simple Introduction This is a general introduction to running a MySQL database

More information

70-532: Developing Microsoft Azure Solutions

70-532: Developing Microsoft Azure Solutions 70-532: Developing Microsoft Azure Solutions Exam Design Target Audience Candidates of this exam are experienced in designing, programming, implementing, automating, and monitoring Microsoft Azure solutions.

More information

Mysql Create Table With Multiple Index Example

Mysql Create Table With Multiple Index Example Mysql Create Table With Multiple Index Example The same process can be applied to all data types, for example numeric data will be CREATE TABLE 'students' ( 'id' int(11) NOT NULL AUTO_INCREMENT, a little

More information

What s New in MySQL and MongoDB Ecosystem Year 2017

What s New in MySQL and MongoDB Ecosystem Year 2017 What s New in MySQL and MongoDB Ecosystem Year 2017 Peter Zaitsev CEO Percona University, Ghent June 22 nd, 2017 1 In This Presentation Few Words about Percona Few Words about Percona University Program

More information

Exam C IBM Cloud Platform Application Development v2 Sample Test

Exam C IBM Cloud Platform Application Development v2 Sample Test Exam C5050 384 IBM Cloud Platform Application Development v2 Sample Test 1. What is an advantage of using managed services in IBM Bluemix Platform as a Service (PaaS)? A. The Bluemix cloud determines the

More information

Harvesting Logs and Events Using MetaCentrum Virtualization Services. Radoslav Bodó, Daniel Kouřil CESNET

Harvesting Logs and Events Using MetaCentrum Virtualization Services. Radoslav Bodó, Daniel Kouřil CESNET Harvesting Logs and Events Using MetaCentrum Virtualization Services Radoslav Bodó, Daniel Kouřil CESNET Campus network monitoring and security workshop Prague 2014 Agenda Introduction Collecting logs

More information

Percona Server for MySQL 8.0 Walkthrough

Percona Server for MySQL 8.0 Walkthrough Percona Server for MySQL 8.0 Walkthrough Overview, Features, and Future Direction Tyler Duzan Product Manager MySQL Software & Cloud 01/08/2019 1 About Percona Solutions for your success with MySQL, MongoDB,

More information

How do we build TiDB. a Distributed, Consistent, Scalable, SQL Database

How do we build TiDB. a Distributed, Consistent, Scalable, SQL Database How do we build TiDB a Distributed, Consistent, Scalable, SQL Database About me LiuQi ( 刘奇 ) JD / WandouLabs / PingCAP Co-founder / CEO of PingCAP Open-source hacker / Infrastructure software engineer

More information

MaDDash: Monitoring and Debugging Dashboard

MaDDash: Monitoring and Debugging Dashboard MaDDash: Monitoring and Debugging Dashboard john hess, CENIC PRP FIONA Workshop February 5-6, 2018 CENIC, La Mirada MaDDash - Monitoring and Debugging Dashboard Orchestrates regular testing among several

More information

Icinga at Hyves.nl. Jeffrey Lensen System Engineer

Icinga at Hyves.nl. Jeffrey Lensen System Engineer Icinga at Hyves.nl Jeffrey Lensen System Engineer Hyves Dutch social network website 3 billion pageviews / month 10M dutch members (17M population) ~7M unique visitors / month (Comscore 09/2011) ~2.3M

More information

Realtime visitor analysis with Couchbase and Elasticsearch

Realtime visitor analysis with Couchbase and Elasticsearch Realtime visitor analysis with Couchbase and Elasticsearch Jeroen Reijn @jreijn #nosql13 About me Jeroen Reijn Software engineer Hippo @jreijn http://blog.jeroenreijn.com About Hippo Visitor Analysis OneHippo

More information

Best Practices in Monitoring. Lars Vogdt Team Lead SUSE DevOPS

Best Practices in Monitoring. Lars Vogdt Team Lead SUSE DevOPS Best Practices in Monitoring Lars Vogdt Team Lead SUSE DevOPS About Lars Vogdt Co-developer of the SUSE Schoolserver Team lead opensuse Education since 2006 Team lead internal IT

More information

Professional PostgreSQL monitoring made easy. Kaarel Moppel Kaarel Moppel

Professional PostgreSQL monitoring made easy. Kaarel Moppel  Kaarel Moppel Professional PostgreSQL monitoring made easy Kaarel Moppel Kaarel Moppel Why to monitor Failure / Downtime detection Slowness / Performance analysis Proactive predictions Maybe wasting money? Kaarel Moppel

More information

MySQL High Availability

MySQL High Availability MySQL High Availability And other stuff worth talking about Peter Zaitsev CEO Moscow MySQL Users Group Meetup July 11 th, 2017 1 Few Words about Percona 2 Percona s Purpose To Champion Unbiased Open Source

More information

MySQL Replication : advanced features in all flavours. Giuseppe Maxia Quality Assurance Architect at

MySQL Replication : advanced features in all flavours. Giuseppe Maxia Quality Assurance Architect at MySQL Replication : advanced features in all flavours Giuseppe Maxia Quality Assurance Architect at VMware @datacharmer 1 About me Who s this guy? Giuseppe Maxia, a.k.a. "The Data Charmer" QA Architect

More information

Hynek Schlawack. Get Instrumented. How Prometheus Can Unify Your Metrics

Hynek Schlawack. Get Instrumented. How Prometheus Can Unify Your Metrics Hynek Schlawack Get Instrumented How Prometheus Can Unify Your Metrics Goals Goals Goals Goals Goals Service Level Service Level Indicator Service Level Indicator Objective Service Level Indicator Objective

More information

Numara FootPrints Changelog January 26, 2009

Numara FootPrints Changelog January 26, 2009 Numara FootPrints 9.0.3 Changelog January 26, 2009 Address Book The logo in the Address Book always pointed to the Numara Software URL. Address book fields were missing from a number of features in FootPrints

More information

MySQL: Scaling & High Availability

MySQL: Scaling & High Availability MySQL: Scaling & High Availability Production experience for the last decade(s) Peter Zaitsev, CEO, Percona June 19, 2018 Percona Technical Webinars 1 Lets go to the start of my MySQL story Going back

More information

Storage Manager 2018 R1. Installation Guide

Storage Manager 2018 R1. Installation Guide Storage Manager 2018 R1 Installation Guide Notes, Cautions, and Warnings NOTE: A NOTE indicates important information that helps you make better use of your product. CAUTION: A CAUTION indicates either

More information

MySQL Performance Optimization and Troubleshooting with PMM. Peter Zaitsev, CEO, Percona

MySQL Performance Optimization and Troubleshooting with PMM. Peter Zaitsev, CEO, Percona MySQL Performance Optimization and Troubleshooting with PMM Peter Zaitsev, CEO, Percona In the Presentation Practical approach to deal with some of the common MySQL Issues 2 Assumptions You re looking

More information

trbmeetup Fast fulltext search in Ruby, without Java -Groonga, Rroonga and Droonga-

trbmeetup Fast fulltext search in Ruby, without Java -Groonga, Rroonga and Droonga- trbmeetup Fast fulltext search in Ruby, without Java -Groonga, Rroonga and Droonga- YUKI Hiroshi ClearCode Inc. Abstract Fulltext search? Groonga and Rroonga easy fulltext search in Ruby Droonga scalable

More information