Fluentd. Open Source Data Collector. Eduardo Jan 23, 2016 Scale14x, Pasadena!
|
|
- Dominic Osborne
- 6 years ago
- Views:
Transcription
1 Fluentd Open Source Data Collector Jan 23, 2016 Scale14x, Pasadena! Eduardo
2 spread the word! #scale14x
3 About Me Eduardo Silva Github & Twitter Personal Treasure Data Open Source Engineer Fluentd / Fluent Bit Projects Monkey HTTP Server Duda I/O
4 Logging
5 Logging Matters Pros Application status Debugging General information about anomalies: errors Troubleshooting / Support Local or Remote (network)
6 Logging Matters From a business point of view Input data Analytics User interaction / behaviors Improvements
7 Assumptions
8 Logging Matters Assumptions I have enough disk space I/O operations will not block Log messages are human readable My logging mechanism scale
9 Logging Matters Assumptions Basically, yeah.. it should work.
10 Concerns
11 Logging Matters Concerns Logs increase = data increase Message format get more complex Did the Kernel flush the buffers? (sync(2)) Multi-thread application?, locking? Multiple Applications = Multiple Logs
12 Logging Matters Concerns If Multiple Applications = Multiple logs Multiple Hosts x Multiple Applications =???
13 OK, so: 1. Logging matters 2. It's really beneficial 3. but...
14 It needs to be done right.
15 Logging Common sources & inputs Application Logs Apache NginX Syslog (-ng) Custom applications / Languages C, Ruby, Python, PHP, Perl, NodeJS, Java, etc.
16 In a galaxy not so far away...
17
18 How to parse/store multiple data sources? note: performance matters!
19
20 Fluentd is an open source data collector It let's you unify the data collection for a better use and understanding of data.
21 before
22 after
23 Fluentd Highlights High Performance Built-in Reliability Structured Logs Pluggable Architecture More than 300 plugins! (input/filtering/output)
24 Fluentd Architecture
25 Fluentd Internals simplified
26 Fluentd Input plugins
27 Fluentd Output plugins
28 Fluentd Buffer plugins
29 Fluentd Buffer plugins
30
31 MxN M+N
32 Fluentd Simple Forwarding
33 Fluentd Simple Forwarding: configuration # logs from a file <source> type tail path /var/log/httpd.log format apache2 tag backend.apache </source> # logs from client libraries <source> type forward port </source> # store logs to MongoDB <match backend.*> type mongo database fluent collection test </match>
34 Fluentd Less Simple Forwarding
35 Fluentd Lambda Architecture
36 Fluentd # logs from a file <source> type tail path /var/log/httpd.log format apache2 tag backend.apache </source> # store logs to MongoDB <match *.*> type copy <store> type elasticsearch logstash_format true </store> # logs from client libraries <source> type forward port </source> <store> type host port path </store> </match> webhdfs 192.x.y.z /path/to/hdfs
37 Who uses Fluentd in production?
38
39
40 We collect 1M events per second!
41 Internet of Things
42 Internet of Things Facts IoT will grow to many billions of devices over the next decade. Now it's about device to device connectivity. Different frameworks and protocols are emerging. It needs Logging.
43 Internet of Things Alliances Vendors formed alliances to join forces and develop generic software layers for their products:
44 Internet of Things Solutions provided Alliance Framework
45 IoT & Big Data Analytics IoT requires a generic solution to collect events and data from different sources for further analysis. Data can come from a specific framework, radio device, sensor or other. How do we collect and unify data properly?
46 @fluentbit
47 Fluent Bit is an open source data collector It let's you collect data from IoT/Embedded devices and transport It to third party services.
48 Fluent Bit Targets Services Sensors / Signals / Radios Operating System information Automotive / Telematics
49 Fluent Bit Requirements IoT and Embedded environment requires special handling, specifically on performance and resource utilization: Lightweight Written in C Language Customizable, pluggable architecture Full integration with Fluentd
50 Fluent Bit Integration
51 Fluent Bit Direct Output
52 Fluent Bit Elastic Search support
53 Fluent Bit Elastic Search: Dashboard
54 Containers
55
56 Docker Logging driver Docker v1.6 released the concept of logging drivers Route container output Fluentd?
57 Docker
58 Docker v1.8 Fluentd Logging driver!
59 Docker Data Stream
60 Docker Data Stream
61
62 NodeJS Fluent-Logger (NPM)
63 We Love Data! Thank you!
Unifying Events & Logs into the Cloud
Unifying Events & Logs into the Cloud October 05, 2015 CloudOpen/LinuxCon, Dublin Eduardo Silva eduardo@treasuredata.com @edsiper About Me Eduardo Silva Github & Twitter Personal Blog @edsiper http://edsiper.linuxchile.cl
More informationEduardo
Eduardo Silva @edsiper eduardo@treasure-data.com About Me Eduardo Silva Github & Twitter Personal Blog @edsiper http://edsiper.linuxchile.cl Treasure Data Open Source Engineer Fluentd / Fluent Bit http://github.com/fluent
More informationSave All or Save Costs? Big Data Universe 2018 Peter Czanik / Balabit
Save All or Save Costs? Big Data Universe 2018 Peter Czanik / Balabit ABOUT ME Peter Czanik from Hungary Evangelist at Balabit: syslog-ng upstream syslog-ng packaging, support, advocacy Balabit is now
More informationFluentd + MongoDB + Spark = Awesome Sauce
Fluentd + MongoDB + Spark = Awesome Sauce Nishant Sahay, Sr. Architect, Wipro Limited Bhavani Ananth, Tech Manager, Wipro Limited Your company logo here Wipro Open Source Practice: Vision & Mission Vision
More informationApplication monitoring with BELK. Nishant Sahay, Sr. Architect Bhavani Ananth, Architect
Application monitoring with BELK Nishant Sahay, Sr. Architect Bhavani Ananth, Architect Why logs Business PoV Input Data Analytics User Interactions /Behavior End user Experience/ Improvements 2017 Wipro
More informationNetwork Automation using modern tech. Egor Krivosheev 2degrees
Network Automation using modern tech Egor Krivosheev 2degrees Key parts of network automation today Streaming Telemetry APIs SNMP and screen scraping are still around NETCONF RFC6241 XML encoding Most
More informationrun your own search engine. today: Cablecar
run your own search engine. today: Cablecar Robert Kowalski @robinson_k http://github.com/robertkowalski Search nobody uses that, right? Services on the Market Google Bing Yahoo ask Wolfram Alpha Baidu
More informationUsing Node-RED to build the internet of things
IBM Bluemix Using Node-RED to build the internet of things Ever had one of those days Where the Application works! And then Can we also get some data from the this whatchamacallit? And send the logs off
More informationAWS 101. Patrick Pierson, IonChannel
AWS 101 Patrick Pierson, IonChannel What is AWS? Amazon Web Services (AWS) is a secure cloud services platform, offering compute power, database storage, content delivery and other functionality to help
More informationsqlite wordpress 06C6817F2E58AF4319AB84EE Sqlite Wordpress 1 / 6
Sqlite Wordpress 1 / 6 2 / 6 3 / 6 Sqlite Wordpress Run WordPress with SQLite instead of MySQL database and how to install and set it up, this is a great way to get WordPress setup running on small web
More informationA Glance Over the Serverless Framework
A Glance Over the Serverless Framework Rafael Zotto Senior Software Architect, HP Inc. Short Bio Rafael Zotto Holds a master degree in Computer Science focused in high performance computing. Specialized
More informationDocker for Development: Getting Started
Docker for Development: Getting Started Lisa H. Ridley Savas Labs DrupalCamp Chattanooga November 5, 2016 Who am I? Lisa Ridley, Director of Client Success, Savas Labs Lead Developer and Project Manager
More informationCloud platforms. T Mobile Systems Programming
Cloud platforms T-110.5130 Mobile Systems Programming Agenda 1. Motivation 2. Different types of cloud platforms 3. Popular cloud services 4. Open-source cloud 5. Cloud on this course 6. Mobile Edge Computing
More informationMonitor your infrastructure with the Elastic Beats. Monica Sarbu
Monitor your infrastructure with the Elastic Beats Monica Sarbu Monica Sarbu Team lead, Beats team Email: monica@elastic.co Twitter: 2 Monitor your servers Apache logs 3 Monitor your servers Apache logs
More informationIngest. David Pilato, Developer Evangelist Paris, 31 Janvier 2017
Ingest David Pilato, Developer Evangelist Paris, 31 Janvier 2017 Data Ingestion The process of collecting and importing data for immediate use in a datastore 2 ? Simple things should be simple. Shay Banon
More informationIngest. Aaron Mildenstein, Consulting Architect Tokyo Dec 14, 2017
Ingest Aaron Mildenstein, Consulting Architect Tokyo Dec 14, 2017 Data Ingestion The process of collecting and importing data for immediate use 2 ? Simple things should be simple. Shay Banon Elastic{ON}
More informationPercona Live September 21-23, 2015 Mövenpick Hotel Amsterdam
Percona Live 2015 September 21-23, 2015 Mövenpick Hotel Amsterdam MongoDB, Elastic, and Hadoop: The What, When, and How Kimberly Wilkins Principal Engineer/Database Denizen ObjectRocket/Rackspace kimberly@objectrocket.com
More informationOpenNTI Collect and visualize KPI from Networks devices
OpenNTI Collect and visualize KPI from Networks devices Open Network Telemetry Insights Efrain Gonzalez (efrain@juniper.net) Pablo Sagrera (psagrera@juniper.net) Version 3.0 / Oct 2017 OpenNTI / Dashboard
More informationThe complete set of technical, security & automation tools on one platform. March 2018 Update
The complete set of technical, security & automation tools on one platform Plesk Updated Onyx March Overview 2018 March 2018 Update What is Plesk Onyx? Plesk is the leading WebOps and Web Hosting platform
More informationAn OpenEdge Developer Getting Started with Modulus and MongoDB
An OpenEdge Developer Getting Started with Modulus and MongoDB Prepared especially for: 8 June 2015 Agenda Background The Integration Challenge Implementing our Integration Platform Our Learning Experience
More informationLOG AGGREGATION. To better manage your Red Hat footprint. Miguel Pérez Colino Strategic Design Team - ISBU
LOG AGGREGATION To better manage your Red Hat footprint Miguel Pérez Colino Strategic Design Team - ISBU 2017-05-03 @mmmmmmpc Agenda Managing your Red Hat footprint with Log Aggregation The Situation The
More informationSCALING YOUR LOGGING INFRASTRUCTURE USING SYSLOG-NG. FOSDEM 2017 Peter Czanik / Balabit
SCALING YOUR LOGGING INFRASTRUCTURE USING SYSLOG-NG FOSDEM 2017 Peter Czanik / Balabit ABOUT ME Peter Czanik from Hungary Community Manager at Balabit: syslog-ng upstream syslog-ng packaging, support,
More informationCloud platforms T Mobile Systems Programming
Cloud platforms T-110.5130 Mobile Systems Programming Agenda 1. Motivation 2. Different types of cloud platforms 3. Popular cloud services 4. Open-source cloud 5. Cloud on this course 6. Some useful tools
More informationMonitoring system for geographically distributed datacenters based on Openstack. Gioacchino Vino
Monitoring system for geographically distributed datacenters based on Openstack Gioacchino Vino Tutor: Dott. Domenico Elia Tutor: Dott. Giacinto Donvito Borsa di studio GARR Orio Carlini 2016-2017 INFN
More informationDeep Dive Amazon Kinesis. Ian Meyers, Principal Solution Architect - Amazon Web Services
Deep Dive Amazon Kinesis Ian Meyers, Principal Solution Architect - Amazon Web Services Analytics Deployment & Administration App Services Analytics Compute Storage Database Networking AWS Global Infrastructure
More informationSTATE OF MODERN APPLICATIONS IN THE CLOUD
STATE OF MODERN APPLICATIONS IN THE CLOUD 2017 Introduction The Rise of Modern Applications What is the Modern Application? Today s leading enterprises are striving to deliver high performance, highly
More informationCloud Foundry Bootcamp
Cloud Foundry Bootcamp GOTO 2012 Josh Long Spring Developer Advocate josh.long@springsource.com 2012 VMware, Inc. All rights reserved Josh Long Spring Developer Advocate josh.long@springsource.com About
More informationThe SMACK Stack: Spark*, Mesos*, Akka, Cassandra*, Kafka* Elizabeth K. Dublin Apache Kafka Meetup, 30 August 2017.
Dublin Apache Kafka Meetup, 30 August 2017 The SMACK Stack: Spark*, Mesos*, Akka, Cassandra*, Kafka* Elizabeth K. Joseph @pleia2 * ASF projects 1 Elizabeth K. Joseph, Developer Advocate Developer Advocate
More informationSteven Edouard SDET, US - DX Audience West Microsoft Bruno Terkaly Principal Software Engineer - Microsoft
Steven Edouard SDET, US - DX Audience West Microsoft Bruno Terkaly Principal Software Engineer - Microsoft Steven and Bruno Info Section 3 Software Architecture Section 7 The Protocol challenge Progress
More informationHTML presentation, positioning and designing responsive web applications.
Hi I am Rodolfo. I put to life to MEAN Stack development and Serverless applications in Amazon and Google Cloud. My passion revolves around helping clients solve very complex problems using cool technologies
More informationPersonal Statement. Skillset I MongoDB / Cassandra / Redis / CouchDB. My name is Dale-Kurt Murray. I'm a Solutiof
My name is Dale-Kurt Murray. 'm a Solutiof +1 876 345 7375 Architect who loves new challenging probl :i "rite hello@dalekurtmurray.com which allows me to think outside of the box. visit www.dalekurtmurray.com
More informationDisclaimer This presentation may contain product features that are currently under development. This overview of new technology represents no commitme
SER1912BE VMware Open-Source SDKs From Getting Started to Web App in One Hour Alan Renouf Sr Product Line Manager, Vmware Steve Trefethen Sr. Manager R&D, VMware VMworld 2017 Content: Not for publication
More informationIBMi in the IT infrastructure of tomorrow
IBMi in the IT infrastructure of tomorrow This is a two day workshop squeezed into 60 minutes!! For: itour - Common Denmark By: Niels Liisberg IBMi in the IT infrastructure of tomorrow Introduction to
More informationDistributed Architectures & Microservices. CS 475, Spring 2018 Concurrent & Distributed Systems
Distributed Architectures & Microservices CS 475, Spring 2018 Concurrent & Distributed Systems GFS Architecture GFS Summary Limitations: Master is a huge bottleneck Recovery of master is slow Lots of success
More informationMySQL Performance Optimization and Troubleshooting with PMM. Peter Zaitsev, CEO, Percona
MySQL Performance Optimization and Troubleshooting with PMM Peter Zaitsev, CEO, Percona In the Presentation Practical approach to deal with some of the common MySQL Issues 2 Assumptions You re looking
More informationTechnologies for the future of Network Insight and Automation
Technologies for the future of Network Insight and Automation Richard Wade (ricwade@cisco.com) Technical Leader, Asia-Pacific Infrastructure Programmability This Session s Context Service Creation Service
More informationHigh-Performance Distributed DBMS for Analytics
1 High-Performance Distributed DBMS for Analytics 2 About me Developer, hardware engineering background Head of Analytic Products Department in Yandex jkee@yandex-team.ru 3 About Yandex One of the largest
More informationIntroducing Jaeger 1.0
Introducing Jaeger 1.0 Yuri Shkuro (Uber Technologies) CNCF Webinar Series, Jan-16-2018 1 Agenda What is distributed tracing Jaeger in a HotROD Jaeger under the hood Jaeger v1.0 Roadmap Project governance,
More informationMicroservices log gathering, processing and storing
Microservices log gathering, processing and storing Siim-Toomas Marran Univeristy of Tartu J.Liivi 2 Tartu, Estonia siimtoom@ut.ee ABSTRACT The aim of this work is to investigate and implement one of the
More informationPractical Node.js. Building Real-World Scalable Web Apps. Apress* Azat Mardan
Practical Node.js Building Real-World Scalable Web Apps Azat Mardan Apress* Contents About the Author About the Technical Reviewer Acknowledgments Introduction xv xvii xix xxi Chapter 1: Setting up Node.js
More informationData 101 Which DB, When. Joe Yong Azure SQL Data Warehouse, Program Management Microsoft Corp.
Data 101 Which DB, When Joe Yong (joeyong@microsoft.com) Azure SQL Data Warehouse, Program Management Microsoft Corp. The world is changing AI increased by 300% in 2017 Data will grow to 44 ZB in 2020
More informationGetting Started With Serverless: Key Use Cases & Design Patterns
Hybrid clouds that just work Getting Started With Serverless: Key Use Cases & Design Patterns Jennifer Gill Peter Fray Vamsi Chemitiganti Sept 20, 2018 Platform9 Systems 1 Agenda About Us Introduction
More informationZombie Apocalypse Workshop
Zombie Apocalypse Workshop Building Serverless Microservices Danilo Poccia @danilop Paolo Latella @LatellaPaolo September 22 nd, 2016 2015, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
More informationOpenAPI-based Message Router for Mashup Service Development
OpenAPI-based Message Router for Mashup Service Development Doyoung Lee, Seyeon Jeong, James Won-Ki Hong Department of Computer Science and Engineering, POSTECH, Korea {dylee90, jsy0906, jwkhong}@postech.ac.kr
More informationPrincipal Software Engineer Red Hat Emerging Technology June 24, 2015
USING APACHE SPARK FOR ANALYTICS IN THE CLOUD William C. Benton Principal Software Engineer Red Hat Emerging Technology June 24, 2015 ABOUT ME Distributed systems and data science in Red Hat's Emerging
More informationThe Evolution of a Data Project
The Evolution of a Data Project The Evolution of a Data Project Python script The Evolution of a Data Project Python script SQL on live DB The Evolution of a Data Project Python script SQL on live DB SQL
More informationTransitioning from C# to Scala Using Apache Thrift. Twitter Finagle
Transitioning from C# to Scala Using Apache Thrift and Twitter Finagle Steven Skelton September 19, 2013 Empathica Empathica provides Customer Experience Management programs to more than 200 of the world's
More informationThe Hardware & Software Implications of Microservices and How Big Data Can Help
The Hardware & Software Implications of Microservices and How Big Data Can Help Christina Delimitrou Cornell University with Yu Gan, Yanqi Zhang, Shuang Chen, Neeraj Kulkarni, Ariana Bruno, Justin Hu,
More informationAWS Lambda. 1.1 What is AWS Lambda?
Objectives Key objectives of this chapter Lambda Functions Use cases The programming model Lambda blueprints AWS Lambda 1.1 What is AWS Lambda? AWS Lambda lets you run your code written in a number of
More informationGlobal Servers. The new masters
Global Servers The new masters Course so far General OS principles processes, threads, memory management OS support for networking Protocol stacks TCP/IP, Novell Netware Socket programming RPC - (NFS),
More informationHitchhikers Guide To Modern Enterprise JavaScript. Jay Balunas Senior Engineering Manager May 4th, 2017
Hitchhikers Guide To Modern Enterprise JavaScript Jay Balunas Senior Engineering Manager May 4th, 2017 Jay Balunas Citation: Adams, D. (1980). The hitchhiker's guide to the galaxy. New York: Harmony Books.
More informationApache Beam. Modèle de programmation unifié pour Big Data
Apache Beam Modèle de programmation unifié pour Big Data Who am I? Jean-Baptiste Onofre @jbonofre http://blog.nanthrax.net Member of the Apache Software Foundation
More informationSQL Server on Linux and Containers
http://aka.ms/bobwardms https://github.com/microsoft/sqllinuxlabs SQL Server on Linux and Containers A Brave New World Speaker Name Principal Architect Microsoft bobward@microsoft.com @bobwardms linkedin.com/in/bobwardms
More informationBut before understanding the Selenium WebDriver concept, we need to know about the Selenium first.
As per the today s scenario, companies not only desire to test software adequately, but they also want to get the work done as quickly and thoroughly as possible. To accomplish this goal, organizations
More informationElasticsearch Search made easy
Elasticsearch Search made easy Alexander Reelsen Agenda Why is search complex? Installation & initial setup Importing data Searching data Replication & Sharding Plugin-based
More informationgrpc - A solution for RPCs by Google Distributed Systems Seminar at Charles University in Prague, Nov 2016 Jan Tattermusch - grpc Software Engineer
grpc - A solution for RPCs by Google Distributed Systems Seminar at Charles University in Prague, Nov 2016 Jan Tattermusch - grpc Software Engineer About me Software Engineer at Google (since 2013) Working
More informationUsing Fluentd as an alternative to Splunk
Using Fluentd as an alternative to Splunk As infrastructure within organizations grows in size and the number of hosts, the cost of Splunk may become prohibitive. I created this document to demonstrate,
More information@joerg_schad Nightmares of a Container Orchestration System
@joerg_schad Nightmares of a Container Orchestration System 2017 Mesosphere, Inc. All Rights Reserved. 1 Jörg Schad Distributed Systems Engineer @joerg_schad Jan Repnak Support Engineer/ Solution Architect
More informationAWS IoT Overview. July 2016 Thomas Jones, Partner Solutions Architect
AWS IoT Overview July 2016 Thomas Jones, Partner Solutions Architect AWS customers are connecting physical things to the cloud in every industry imaginable. Healthcare and Life Sciences Municipal Infrastructure
More informationRealtime visitor analysis with Couchbase and Elasticsearch
Realtime visitor analysis with Couchbase and Elasticsearch Jeroen Reijn @jreijn #nosql13 About me Jeroen Reijn Software engineer Hippo @jreijn http://blog.jeroenreijn.com About Hippo Visitor Analysis OneHippo
More informationReal Life Web Development. Joseph Paul Cohen
Real Life Web Development Joseph Paul Cohen joecohen@cs.umb.edu Index 201 - The code 404 - How to run it? 500 - Your code is broken? 200 - Someone broke into your server? 400 - How are people using your
More informationC++ Developer Survey "Lite": C++ and Cloud
Q1 This month we focus on how C++ is used, or could be better for use, in cloud-related applications and environments. In what (if any) kinds of cloud computing-related workloads do you use C++? (select
More informationGoals Pragmukko features:
Pragmukko Pragmukko Pragmukko is an Akka-based framework for distributed computing. Originally, it was developed for building an IoT solution but it also fit well for many other cases. Pragmukko treats
More informationHow A Website Works. - Shobha
How A Website Works - Shobha Synopsis 1. 2. 3. 4. 5. 6. 7. 8. 9. What is World Wide Web? What makes web work? HTTP and Internet Protocols. URL s Client-Server model. Domain Name System. Web Browser, Web
More informationAsanka Padmakumara. ETL 2.0: Data Engineering with Azure Databricks
Asanka Padmakumara ETL 2.0: Data Engineering with Azure Databricks Who am I? Asanka Padmakumara Business Intelligence Consultant, More than 8 years in BI and Data Warehousing A regular speaker in data
More informationHow to Route Internet Traffic between A Mobile Application and IoT Device?
Whitepaper How to Route Internet Traffic between A Mobile Application and IoT Device? Website: www.mobodexter.com www.paasmer.co 1 Table of Contents 1. Introduction 3 2. Approach: 1 Uses AWS IoT Setup
More informationMonitor your containers with the Elastic Stack. Monica Sarbu
Monitor your containers with the Elastic Stack Monica Sarbu Monica Sarbu Team lead, Beats team monica@elastic.co 3 Monitor your containers with the Elastic Stack Elastic Stack 5 Beats are lightweight shippers
More informationThe Art of Container Monitoring. Derek Chen
The Art of Container Monitoring Derek Chen 2016.9.22 About me DevOps Engineer at Trend Micro Agile transformation Micro service and cloud service Docker integration Monitoring system development Automate
More informationKdb+ Transitive Comparisons
Kdb+ Transitive Comparisons 15 May 2018 Hugh Hyndman, Director, Industrial IoT Solutions Copyright 2018 Kx Kdb+ Transitive Comparisons Introduction Last summer, I wrote a blog discussing my experiences
More informationElasticsearch. Presented by: Steve Mayzak, Director of Systems Engineering Vince Marino, Account Exec
Elasticsearch Presented by: Steve Mayzak, Director of Systems Engineering Vince Marino, Account Exec What about Elasticsearch the Company?! Support 100s of Companies in Production environments Training
More informationThe InfluxDB-Grafana plugin for Fuel Documentation
The InfluxDB-Grafana plugin for Fuel Documentation Release 0.8.0 Mirantis Inc. December 14, 2015 Contents 1 User documentation 1 1.1 Overview................................................. 1 1.2 Release
More informationLearn to Code with C#
Learn to Code with C# Getting Started with Microsoft's Cross-Platform, Open Source Language Who am I? Jeff Ammons Microsoft MVP Pluralsight Author CEO/Chief Instructor at Code Career Academy 25 Years Professional
More informationMaking Sense of your Data
Making Sense of your Data Building A Custom DataSource for Grafana with Vert.x Gerald Mücke DevCon5 GmbH @gmuecke About me 3 IT Consultant & Java Specialist at DevCon5 (CH) Focal Areas Tool-assisted quality
More informationOverview. Rationale Division of labour between script and C++ Choice of language(s) Interfacing to C++ Performance, memory
SCRIPTING Overview Rationale Division of labour between script and C++ Choice of language(s) Interfacing to C++ Reflection Bindings Serialization Performance, memory Rationale C++ isn't the best choice
More informationSystem Wide Tracing User Need
System Wide Tracing User Need dominique toupin ericsson com April 2010 About me Developer Tool Manager at Ericsson, helping Ericsson sites to develop better software efficiently Background
More informationAccelerate at DevOps Speed With Openshift v3. Alessandro Vozza & Samuel Terburg Red Hat
Accelerate at DevOps Speed With Openshift v3 Alessandro Vozza & Samuel Terburg Red Hat IT (R)Evolution Red Hat Brings It All Together What is Kubernetes Open source container cluster manager Inspired by
More informationRun your own Open source. (MMS) to avoid vendor lock-in. David Murphy MongoDB Practice Manager, Percona
Run your own Open source Click alternative to edit to Master Ops-Manager title style (MMS) to avoid vendor lock-in David Murphy MongoDB Practice Manager, Percona Who is this Person and What Does He Know?
More informationQuick Start ArcGIS Enterprise with Automation. Shannon Kalisky Mark Carlson Nikhil Shampur Cherry Lin
Quick Start ArcGIS Enterprise with Automation Shannon Kalisky Mark Carlson Nikhil Shampur Cherry Lin Software installation is my favorite! I really love how complex and repetitive it can be especially
More informationMySQL Performance Optimization and Troubleshooting with PMM. Peter Zaitsev, CEO, Percona Percona Technical Webinars 9 May 2018
MySQL Performance Optimization and Troubleshooting with PMM Peter Zaitsev, CEO, Percona Percona Technical Webinars 9 May 2018 Few words about Percona Monitoring and Management (PMM) 100% Free, Open Source
More informationCIB Session 12th NoSQL Databases Structures
CIB Session 12th NoSQL Databases Structures By: Shahab Safaee & Morteza Zahedi Software Engineering PhD Email: safaee.shx@gmail.com, morteza.zahedi.a@gmail.com cibtrc.ir cibtrc cibtrc 2 Agenda What is
More informationFull Stack boot camp
Name Full Stack boot camp Duration (Hours) JavaScript Programming 56 Git 8 Front End Development Basics 24 Typescript 8 React Basics 40 E2E Testing 8 Build & Setup 8 Advanced JavaScript 48 NodeJS 24 Building
More informationArm Mbed Edge. Shiv Ramamurthi Arm. Arm Tech Symposia Arm Limited
Arm Mbed Edge Shiv Ramamurthi Arm Arm Tech Symposia 2017 IoT increasing efficiency, yield, and convenience Commercial buildings Better energy & space utilization Precision farming and connected sites Increased
More informationDevOps Tooling from AWS
DevOps Tooling from AWS What is DevOps? Improved Collaboration - the dropping of silos between teams allows greater collaboration and understanding of how the application is built and deployed. This allows
More informationIntroduction to Apache Beam
Introduction to Apache Beam Dan Halperin JB Onofré Google Beam podling PMC Talend Beam Champion & PMC Apache Member Apache Beam is a unified programming model designed to provide efficient and portable
More informationAWS IoT+ Lambda to power a blockchain project
AWS IoT+ Lambda to power a blockchain project June 2016 by Johann Romefort About Johann Tech Evangelist @Stylight 15+ years in tech In Germany for 2 years 7 years in San Francisco doing startups Organizer
More informationPutting A Spark in Web Apps
Putting A Spark in Web Apps Apache Big Data, Seville ES, 2016 David Fallside Intro Web app development has moved from Java etc to Node.js and JavaScript JS environment relatively simple and very rich,
More informationThe State Of Open Source Logging
The State Of Open Source Logging Rashid Khan (@rashidkpc) Shay Banon (@kimchy) Rashid Khan Developer @ elasticsearch Operations guy Logging Nerd Kibana project IRC/Twitter: rashidkpc Logs suck. 3am What
More informationUsing AWS to Build a Large Scale Dockerized Microservices Architecture. Dr. Oliver Wahlen moovel Group GmbH Frankfurt, 30.
Using AWS to Build a Large Scale Dockerized Microservices Architecture Dr. Oliver Wahlen moovel Group GmbH Frankfurt, 30. Juni 2016 The moovel Group GmbH Our vision is an ecosystem that simplifies mobility
More informationMeasuring HEC Performance For Fun and Profit
Measuring HEC Performance For Fun and Profit Itay Neeman Director, Engineering, Splunk Clif Gordon Principal Software Engineer, Splunk September 2017 Washington, DC Forward-Looking Statements During the
More informationFLORIDA DEPARTMENT OF TRANSPORTATION PRODUCTION BIG DATA PLATFORM
FLORIDA DEPARTMENT OF TRANSPORTATION PRODUCTION BIG DATA PLATFORM RECOMMENDATION AND JUSTIFACTION Executive Summary: VHB has been tasked by the Florida Department of Transportation District Five to design
More informationTangeloHub Documentation
TangeloHub Documentation Release None Kitware, Inc. September 21, 2015 Contents 1 User s Guide 3 1.1 Managing Data.............................................. 3 1.2 Running an Analysis...........................................
More informationMastering Near-Real-Time Telemetry and Big Data: Invaluable Superpowers for Ordinary SREs
Mastering Near-Real-Time Telemetry and Big Data: Invaluable Superpowers for Ordinary SREs Ivan Ivanov Sr. CDN Reliability Engineer Netflix Open Connect 137M subscribers (Q3 2018) 190 countries 1,000s of
More informationDevOps on AWS Deep Dive on Continuous Delivery and the AWS Developer Tools
DevOps on AWS Deep Dive on Continuous Delivery and the AWS Developer Tools Woody Borraccino, AWS Solutions Architect May 4, 2016, Stockholm 2016, Amazon Web Services, Inc. or its Affiliates. All rights
More informationApache Karaf in the enterprise. JB
Apache Karaf in the enterprise JB Onofré jbonofre@apache.org @jbonofre APACHECON North America Sept. 24-27, 2018 1 Who am I? Jean-Baptiste Onofré Software Architect/Fellow at Talend
More informationAWS Lambda: Event-driven Code in the Cloud
AWS Lambda: Event-driven Code in the Cloud Dean Bryen, Solutions Architect AWS Andrew Wheat, Senior Software Engineer - BBC April 15, 2015 London, UK 2015, Amazon Web Services, Inc. or its affiliates.
More informationQualys Cloud Platform
18 QUALYS SECURITY CONFERENCE 2018 Qualys Cloud Platform Looking Under the Hood: What Makes Our Cloud Platform so Scalable and Powerful Dilip Bachwani Vice President, Engineering, Qualys, Inc. Cloud Platform
More informationRuby in the Sky with Diamonds. August, 2014 Sao Paulo, Brazil
Ruby in the Sky with Diamonds August, 2014 Sao Paulo, Brazil JELASTIC PLATFORM AS INFRASTRUCTURE Jelastic provides enterprise cloud software that redefines the economics of cloud deployment and management.
More informationContinuous delivery of Java applications. Marek Kratky Principal Sales Consultant Oracle Cloud Platform. May, 2016
Continuous delivery of Java applications using Oracle Cloud Platform Services Marek Kratky Principal Sales Consultant Oracle Cloud Platform May, 2016 Safe Harbor Statement The following is intended to
More informationRed Hat Software Collections. Ryan Hennessy Sr. Solutions Architect
Red Hat Software Collections Ryan Hennessy Sr. Solutions Architect hennessy@redhat.com Hello Everybody... 2 Solutions Architect based out of the FAR west suburbs of Chicago (Iowa Adjacent) Husband, father
More informationCSCI-1680 RPC and Data Representation. Rodrigo Fonseca
CSCI-1680 RPC and Data Representation Rodrigo Fonseca Today Defining Protocols RPC IDL Problem Two programs want to communicate: must define the protocol We have seen many of these, across all layers E.g.,
More information