Ingest. David Pilato, Developer Evangelist Paris, 31 Janvier 2017
|
|
- Leo Logan
- 5 years ago
- Views:
Transcription
1 Ingest David Pilato, Developer Evangelist Paris, 31 Janvier 2017
2 Data Ingestion The process of collecting and importing data for immediate use in a datastore 2
3 ? Simple things should be simple. Shay Banon Elastic{ON} 17 3
4 Ingest Technologies Elasticsearch Beats Logstash ES-Hadoop APIs Ingest Node Lightweight Data Shippers Centralized Data Collection Engine Hadoop Ecosystem Connector 4
5 Elastic Ingestion Technologies Elasticsearch API ingest node Transform data node Store 5
6 Elastic Ingestion Technologies Elasticsearch ingest node Transform data node Store es-hadoop CUSTOM CONNECTORS 6
7 Elastic Ingestion Technologies DISTRIBUTED COLLECTION Elasticsearch Beats ingest node Transform Logs Metrics data node Store servers, containers 7
8 Elastic Ingestion Technologies DISTRIBUTED COLLECTION Elasticsearch Beats ingest node Transform servers, containers CENTRALIZED COLLECTION data node Store network devices DB data Flows JDBC Logstash 8
9 Ingestion Architecture Scalable and robust centralized ETL Java event rewrite Multiple pipelines 9
10 Ingestion Architecture Scalable and robust centralized ETL Persistent queues Dead letter queues 10
11 Cooperative Ingestion DISTRIBUTED COLLECTION Elasticsearch Beats ingest node Transform servers, containers data node Store 11
12 Elastic Ingestion Technologies DISTRIBUTED COLLECTION Elasticsearch Beats ingest node Transform servers, containers CENTRALIZED COLLECTION data node Store network devices Logstash 12
13 Elastic Ingestion Technologies DISTRIBUTED COLLECTION Elasticsearch Beats CENTRALIZED COLLECTION ingest node Transform servers, containers Logstash data node Store network devices 13
14 Easy migration between ingest technologies Ingest Node to Logstash conversion tool Elasticsearch ingest node Logstash 14
15 Use Cases & Data Sources
16 Use Cases & Data Sources Logging Metrics Security Common Log Formats System Web Servers Queues Turnkey Monitoring Infrastructure Containers Databases SecOps Dashboards Audit Firewalls, IDS/IPS SIEM Augmentation 16
17 Modules: Data sources made easy Collect specific type of data Parse and enrich it Default dashboards, alerts, ML jobs./filebeat -e -modules=system -setup 17
18 Metricbeat modules (introduced in 5.0) Aerospike Apache Ceph Couchbase Docker Dropwizard Elasticsearch Golang Graphite HAProxy HTTP Jolokia Kafka Kibana Kubernetes Memcached MongoDB MySQL Nginx PHP_FPM PostgreSQL Prometheus RabbitMQ Redis System vsphere Windows ZooKeeper 18
19 Filebeat modules (introduced in 5.3) Apache2 Auditd Icinga Kafka MySQL Nginx PostgreSQL Redis System 19
20 Logstash modules (introduced in 5.6) ArcSight Netflow 20
21 21 ArcSight Module (Introduced in 5.6)
22 22 DEMO
23 Logging Data Sources FILEBEAT WINLOGBEAT Infrastructure Applications System Linux / MacOS Windows Events Containers Docker (6.0) Kubernetes (6.0) Databases MySQL PostgreSQL (6.1) Queues Kafka (6.1) Redis (6.0) Web servers Apache Nginx Other HAProxy* Zookeeper* * Near-term roadmap 23
24 Metrics & Event Data METRICBEAT PACKETBEAT LOGSTASH Infrastructure System Linux MacOS Windows Perfmon (6.0) Containers Docker Kubernetes (6.0) Virtualization vsphere (6.0) Cloud AWS GCP Azure* DigitalOcean Network Netflow (5.6) Packets Storage Ceph WMI*. 24 * Near-term roadmap
25 Metrics & Event Data METRICBEAT HEARTBEAT LOGSTASH Applications Datastores Queues Uptime Web servers MySQL Kafka Heartbeat Apache PostgreSQL Redis Custom apps Nginx MongoDB RabbitMQ (6.0) JMX/Jolokia Other Couchbase Caches PHP-FPM HAProxy Aerospike (6.0) Memcached (6.0) Golang (6.0) Zookeeper Graphite (6.1) Dropwizard (6.0) Prometheus * Near-term roadmap 25
26 Security Data Sources FILEBEAT METRICBEAT PACKETBEAT LOGSTASH Security SIEM Augmentation ArcSight (5.6) more* Audit Auditd Auditbeat (6.0) Systems Access SSH Applications Connections Users Activity Network IPs / GeoIP DNS Packets Netflow (5.6) Firewalls* IDS/IPS* * Near-term roadmap 26
27 Business Analytics LOGSTASH Structured Databases JDBC input JDBC filter SaaS services Salesforce Heroku Github Azure* Activity Social media Twitter * Near-term roadmap 27
28 Administration
29 Monitoring & Management Logstash Centralized monitoring (5.3) Centralized management (6.0) * Near-term roadmap 29
30 30 Logstash Monitoring
31 Monitoring & Management Logstash Centralized monitoring (5.3) Centralized management (6.0) * Near-term roadmap 31
32 Monitoring & Management Logstash Centralized monitoring (5.3) Centralized management (6.0) Beats (Roadmap) Centralized monitoring Centralized management 32
33 Next steps Familiarize yourself with latest integrations (including in X-Pack) Watch UI roadmap for additional add-data workflows Come talk to us at the AMA booth 33
34 Thank You Find me at AMA booth or
Ingest. Aaron Mildenstein, Consulting Architect Tokyo Dec 14, 2017
Ingest Aaron Mildenstein, Consulting Architect Tokyo Dec 14, 2017 Data Ingestion The process of collecting and importing data for immediate use 2 ? Simple things should be simple. Shay Banon Elastic{ON}
More informationApplication monitoring with BELK. Nishant Sahay, Sr. Architect Bhavani Ananth, Architect
Application monitoring with BELK Nishant Sahay, Sr. Architect Bhavani Ananth, Architect Why logs Business PoV Input Data Analytics User Interactions /Behavior End user Experience/ Improvements 2017 Wipro
More informationMonitor your containers with the Elastic Stack. Monica Sarbu
Monitor your containers with the Elastic Stack Monica Sarbu Monica Sarbu Team lead, Beats team monica@elastic.co 3 Monitor your containers with the Elastic Stack Elastic Stack 5 Beats are lightweight shippers
More informationInfrastructure at your Service. Elking your PostgreSQL Database Infrastructure
Infrastructure at your Service. About me Infrastructure at your Service. Arnaud Berbier Senior Consultant +41 79 128 91 45 arnaud.berbier@dbi-services.com Page 2 Agenda 1.Playground Infrastructure 2.Elastic
More informationMonitor your infrastructure with the Elastic Beats. Monica Sarbu
Monitor your infrastructure with the Elastic Beats Monica Sarbu Monica Sarbu Team lead, Beats team Email: monica@elastic.co Twitter: 2 Monitor your servers Apache logs 3 Monitor your servers Apache logs
More informationUnifying logs and metrics data with Elastic Beats. Monica Sarbu Team lead, Elastic Beats
Unifying logs and metrics data with Elastic Beats Monica Sarbu Team lead, Elastic Beats # Who am I Team lead at Elastic Beats Software engineer Joined Elastic 1 year ago @monicasarbu http://github.com/monicasarbu
More informationThe webinar will start soon... Elasticsearch Performance Optimisation
The webinar will start soon... Performance Optimisation 1 whoami Alan Hardy Sr. Solutions Architect NEMEA 2 Webinar Housekeeping & Logistics Slides and recording will be available following the webinar
More informationNinja Level Infrastructure Monitoring. Defensive Approach to Security Monitoring and Automation
Ninja Level Infrastructure Monitoring Defensive Approach to Security Monitoring and Automation 1 DEFCON 24 06 th August 2016, Saturday 10:00-14:00 Madhu Akula & Riyaz Walikar Appsecco.com 2 About Automation
More information利用 Mesos 打造高延展性 Container 環境. Frank, Microsoft MTC
利用 Mesos 打造高延展性 Container 環境 Frank, Microsoft MTC About Me Developer @ Yahoo! DevOps @ HTC Technical Architect @ MSFT Agenda About Docker Manage containers Apache Mesos Mesosphere DC/OS application = application
More informationSupporting Docker in Emulab-Based Network Testbeds. David Johnson, Elijah Grubb, Eric Eide University of Utah
Supporting Docker in Emulab-Based Network Testbeds David Johnson, Elijah Grubb, Eric Eide University of Utah 2 2 2 2 over the course of a study prototype on laptop network testbed commercial cloud need
More informationThe SMACK Stack: Spark*, Mesos*, Akka, Cassandra*, Kafka* Elizabeth K. Dublin Apache Kafka Meetup, 30 August 2017.
Dublin Apache Kafka Meetup, 30 August 2017 The SMACK Stack: Spark*, Mesos*, Akka, Cassandra*, Kafka* Elizabeth K. Joseph @pleia2 * ASF projects 1 Elizabeth K. Joseph, Developer Advocate Developer Advocate
More informationDesigning MQ deployments for the cloud generation
Designing MQ deployments for the cloud generation WebSphere User Group, London Arthur Barr, Senior Software Engineer, IBM MQ 30 th March 2017 Top business drivers for cloud 2 Source: OpenStack user survey,
More informationBUILDING HA ELK STACK FOR DRUPAL
BUILDING STACK FOR DRUPAL Marji Cermak DevOps track, Experience level: Intermediate Marji Cermak Systems Engineer at @cermakm Scope of this presentation technical talk targeting sysadmins and systems savvy
More informationE l a s t i c s e a r c h F e a t u r e s. Contents
Elasticsearch Features A n Overview Contents Introduction... 2 Location Based Search... 2 Search Social Media(Twitter) data from Elasticsearch... 4 Query Boosting in Elasticsearch... 4 Machine Learning
More informationRuby in the Sky with Diamonds. August, 2014 Sao Paulo, Brazil
Ruby in the Sky with Diamonds August, 2014 Sao Paulo, Brazil JELASTIC PLATFORM AS INFRASTRUCTURE Jelastic provides enterprise cloud software that redefines the economics of cloud deployment and management.
More informationFilebeat is able to do multiline while collecting logs from the container. you can use autodiscover to configure it in many ways
elasticguest8086 Since k8 by default is using the json log file driver which will not support call trace (multi-line log).. Any solution for it with ELK? like using logstash as a logging driver? Filebeat
More informationAmazon Elasticsearch Service
Amazon Elasticsearch Service Fully managed, reliable, and scalable Elasticsearch service. Have Your Frontend & Monitor It Too Scalable Log Analytics Inside a VPC Lab Instructions Contents Lab Overview...
More informationCloud providers, tools and best practices in running Magento on Kubernetes. Adrian Balcan MindMagnet Software
Cloud providers, tools and best practices in running Magento on Kubernetes Adrian Balcan DevOps @ MindMagnet Software About Me Companies Projects Adrian Balcan contact@adrianbalcan.com Agenda Magento on
More informationScaling Pinterest. Marty Weiner Level 83 Interwebz Geek
Scaling Pinterest Marty Weiner Level 83 Interwebz Geek Evolution Growth March 2010 Page views per day RackSpace 1 small Web Engine 1 small MySQL DB 1 Engineer + 2 Founders Mar 2010 Jan 2011 Jan 2012 May
More informationEnd-to-End Security Analytics with the Elastic Stack. Samir Bennacer
End-to-End Security Analytics with the Elastic Stack Samir Bennacer!1 !2 Attacks are inevitable Cybersecurity Maturity Curve Phase 1 Security Event Management Phase 2 Automation Phase 3 Proactive Analytics
More informationSTATE OF MODERN APPLICATIONS IN THE CLOUD
STATE OF MODERN APPLICATIONS IN THE CLOUD 2017 Introduction The Rise of Modern Applications What is the Modern Application? Today s leading enterprises are striving to deliver high performance, highly
More informationThere's More to Docker than the Container The Docker Platform
There's More to Docker than the Container The Docker Platform Kendrick Coleman {code} by Dell EMC @KendrickColeman github.com/kacole2 Fabio Chiodini dotnext Team Dell EMC @FabioChiodini github.com/fabiochiodini
More informationQualys Cloud Platform
18 QUALYS SECURITY CONFERENCE 2018 Qualys Cloud Platform Looking Under the Hood: What Makes Our Cloud Platform so Scalable and Powerful Dilip Bachwani Vice President, Engineering, Qualys, Inc. Cloud Platform
More informationContainer 2.0. Container: check! But what about persistent data, big data or fast data?!
@unterstein @joerg_schad @dcos @jaxdevops Container 2.0 Container: check! But what about persistent data, big data or fast data?! 1 Jörg Schad Distributed Systems Engineer @joerg_schad Johannes Unterstein
More informationNetwork Automation using modern tech. Egor Krivosheev 2degrees
Network Automation using modern tech Egor Krivosheev 2degrees Key parts of network automation today Streaming Telemetry APIs SNMP and screen scraping are still around NETCONF RFC6241 XML encoding Most
More informationTungsten Replicator for Kafka, Elasticsearch, Cassandra
Tungsten Replicator for Kafka, Elasticsearch, Cassandra Topics In todays session Replicator Basics Filtering and Glue Kafka and Options Elasticsearch and Options Cassandra Future Direction 2 Asynchronous
More informationAWS 101. Patrick Pierson, IonChannel
AWS 101 Patrick Pierson, IonChannel What is AWS? Amazon Web Services (AWS) is a secure cloud services platform, offering compute power, database storage, content delivery and other functionality to help
More informationTable 1 The Elastic Stack use cases Use case Industry or vertical market Operational log analytics: Gain real-time operational insight, reduce Mean Ti
Solution Overview Cisco UCS Integrated Infrastructure for Big Data with the Elastic Stack Cisco and Elastic deliver a powerful, scalable, and programmable IT operations and security analytics platform
More informationPost-Exploitation Hunting with ATT&CK & Elastic
Post-Exploitation Hunting with ATT&CK & Elastic John Hubbard @SecHubb SOC Lead at GlaxoSmithKline SANS Author & Instructor SEC455: SIEM Design & Implementation SEC511: Continuous Monitoring & Security
More informationThe Art of Container Monitoring. Derek Chen
The Art of Container Monitoring Derek Chen 2016.9.22 About me DevOps Engineer at Trend Micro Agile transformation Micro service and cloud service Docker integration Monitoring system development Automate
More informationRethinking monitoring with Prometheus
Rethinking monitoring with Prometheus Martín Ferrari Štefan Šafár http://tincho.org @som_zlo Who is Prometheus? A dude who stole fire from Mt. Olympus and gave it to humanity http://prometheus.io/ What
More informationBuilding a Scalable Recommender System with Apache Spark, Apache Kafka and Elasticsearch
Nick Pentreath Nov / 14 / 16 Building a Scalable Recommender System with Apache Spark, Apache Kafka and Elasticsearch About @MLnick Principal Engineer, IBM Apache Spark PMC Focused on machine learning
More informationFUJITSU Software ServerView Cloud Monitoring Manager V1.1. Release Notes
FUJITSU Software ServerView Cloud Monitoring Manager V1.1 Release Notes J2UL-2170-01ENZ0(00) July 2016 Contents Contents About this Manual... 4 1 What's New?...6 1.1 Performance Improvements... 6 1.2
More informationBig Data Technology Ecosystem. Mark Burnette Pentaho Director Sales Engineering, Hitachi Vantara
Big Data Technology Ecosystem Mark Burnette Pentaho Director Sales Engineering, Hitachi Vantara Agenda End-to-End Data Delivery Platform Ecosystem of Data Technologies Mapping an End-to-End Solution Case
More informationAll Events. One Platform.
All Events. One Platform. Industry s first IT ops platform that truly correlates the metric, flow and log events and turns them into actionable insights. Correlate Integrate Analyze www.motadata.com Motadata
More informationSecuring the Elastic Stack
Securing the Elastic Stack Jay Modi, Security Software Engineer Tim Vernum, Security Software Engineer Elastic March 1st, 2018 @jaymode2001 @TimVernum Authentication Who are you? 3 Built-in Users elastic
More informationThales PunchPlatform Agenda
Thales PunchPlatform Agenda What It Does Building Blocks PunchPlatform team Deployment & Operations Typical Setups Customers and Use Cases RoadMap 1 What It Does Compose Arbitrary Industrial Data Processing
More informationKafka Connect the Dots
Kafka Connect the Dots Building Oracle Change Data Capture Pipelines With Kafka Mike Donovan CTO Dbvisit Software Mike Donovan Chief Technology Officer, Dbvisit Software Multi-platform DBA, (Oracle, MSSQL..)
More informationLog Analysis When CLI get's complex. ITNOG3 Octavio Melendres Network admin - Fastnet Spa
Log Analysis When CLI get's complex ITNOG3 Octavio Melendres Network admin - Fastnet Spa Introduction Network engineer at Fastnet Spa from 2003 Fastnet Spa is an ISP from Marche Region located in Ancona
More informationJava Architectures A New Hope. Eberhard Wolff
Java Architectures A New Hope Eberhard Wolff http://ewolff.com What happens with a talk titled like this? Architecture of Enterprise Java Apps How can I implement a new feature??? ! ECommerce System
More informationIngesting Logs with style. What has been cooking lately in Logstash world.
Ingesting Logs with style What has been cooking lately in Logstash world. # $whoami Pere Urbon-Bayes (Software Engineer since ever) Have always worked with databases, data and analytics. GraphDevRoom@FOSDEM
More informationOpen-Falcon A Distributed and High-Performance Monitoring System. Yao-Wei Ou & Lai Wei 2017/05/22
Open-Falcon A Distributed and High-Performance Monitoring System Yao-Wei Ou & Lai Wei 2017/05/22 Let us begin with a little story Grafana PR#3787 [feature] Add Open-Falcon datasource I'm sorry but we will
More informationAPI Connect. Arnauld Desprets - Technical Sale
API Connect Arnauld Desprets - arnauld_desprets@fr.ibm.com Technical Sale 0 Agenda 1. API Understanding the space 2. API Connect 3. Sample implementations 4. Démonstration 1 sales introduction growth decline
More informationUnderstanding the latent value in all content
Understanding the latent value in all content John F. Kennedy (JFK) November 22, 1963 INGEST ENRICH EXPLORE Cognitive skills Data in any format, any Azure store Search Annotations Data Cloud Intelligence
More informationBeBanjo Infrastructure and Security Overview
BeBanjo Infrastructure and Security Overview Can you trust Software-as-a-Service (SaaS) to run your business? Is your data safe in the cloud? At BeBanjo, we firmly believe that SaaS delivers great benefits
More informationCloud platforms. T Mobile Systems Programming
Cloud platforms T-110.5130 Mobile Systems Programming Agenda 1. Motivation 2. Different types of cloud platforms 3. Popular cloud services 4. Open-source cloud 5. Cloud on this course 6. Mobile Edge Computing
More informationUse Case: Scalable applications
Use Case: Scalable applications 1. Introduction A lot of companies are running (web) applications on a single machine, self hosted, in a datacenter close by or on premise. The hardware is often bought
More informationFROM VSTS TO AZURE DEVOPS
#DOH18 FROM VSTS TO AZURE DEVOPS People. Process. Products. Gaetano Paternò @tanopaterno info@gaetanopaterno.it 2 VSTS #DOH18 3 Azure DevOps Azure Boards (ex Work) Deliver value to your users faster using
More informationMonitoring MySQL Performance with Percona Monitoring and Management
Monitoring MySQL Performance with Percona Monitoring and Management Santa Clara, California April 23th 25th, 2018 MIchael Coburn, Product Manager Your Presenter Product Manager for PMM (also Percona Toolkit
More informationAccenture Cloud Platform Serverless Journey
ARC202 Accenture Cloud Platform Serverless Journey Tom Myers, Sr. Cloud Architect, Accenture Cloud Platform Matt Lancaster, Lightweight Architectures Global Lead November 29, 2016 2016, Amazon Web Services,
More informationMQ Monitoring on Cloud
MQ Monitoring on Cloud Suganya Rane Digital Automation, Integration & Cloud Solutions Agenda Metrics & Monitoring Monitoring Options AWS ElasticSearch Kibana MQ CloudWatch on AWS Prometheus Grafana MQ
More informationGabriel Villa. Architecting an Analytics Solution on AWS
Gabriel Villa Architecting an Analytics Solution on AWS Cloud and Data Architect Skilled leader, solution architect, and technical expert focusing primarily on Microsoft technologies and AWS. Passionate
More informationAbout the Tutorial. Audience. Prerequisites. Copyright and Disclaimer. Logstash
About the Tutorial is an open-source, centralized, events and logging manager. It is a part of the ELK (ElasticSearch,, Kibana) stack. In this tutorial, we will understand the basics of, its features,
More informationSpread the Database Love with Heterogeneous Replication. MC Brown, VP, Products
Spread the Database Love with Heterogeneous Replication MC Brown, VP, Products Heterogeneous Replication is NOT Exporting and Importing Data One Time Exports Moving to a different database platform ETL
More informationAmazon Web Services (AWS) Solutions Architect Intermediate Level Course Content
Amazon Web Services (AWS) Solutions Architect Intermediate Level Course Content Introduction to Cloud Computing A Short history Client Server Computing Concepts Challenges with Distributed Computing Introduction
More informationIntroduction to data centers
Introduction to data centers Paolo Giaccone Notes for the class on Switching technologies for data centers Politecnico di Torino December 2017 Cloud computing Section 1 Cloud computing Giaccone (Politecnico
More informationRegaining Our Lost Visibility
18 QUALYS SECURITY CONFERENCE 2018 Regaining Our Lost Visibility Sumedh Thakar Chief Product Officer, Qualys, Inc. Agenda Why are we doing what we are doing? The State of IT Now Security Today The Future
More information@unterstein #bedcon. Operating microservices with Apache Mesos and DC/OS
@unterstein @dcos @bedcon #bedcon Operating microservices with Apache Mesos and DC/OS 1 Johannes Unterstein Software Engineer @Mesosphere @unterstein @unterstein.mesosphere 2017 Mesosphere, Inc. All Rights
More informationHow we built a highly scalable Machine Learning platform using Apache Mesos
How we built a highly scalable Machine Learning platform using Apache Mesos Daniel Sârbe Development Manager, BigData and Cloud Machine Translation @ SDL Co-founder of BigData/DataScience Meetup Cluj,
More informationBuild, Deploy & Operate Intelligent Chatbots with Amazon Lex
Build, Deploy & Operate Intelligent Chatbots with Amazon Lex Ian Massingham AWS Technical Evangelist @IanMmmm aws.amazon.com/lex 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
More informationRealtime visitor analysis with Couchbase and Elasticsearch
Realtime visitor analysis with Couchbase and Elasticsearch Jeroen Reijn @jreijn #nosql13 About me Jeroen Reijn Software engineer Hippo @jreijn http://blog.jeroenreijn.com About Hippo Visitor Analysis OneHippo
More informationDocker for Development: Getting Started
Docker for Development: Getting Started Lisa H. Ridley Savas Labs DrupalCamp Chattanooga November 5, 2016 Who am I? Lisa Ridley, Director of Client Success, Savas Labs Lead Developer and Project Manager
More informationCloud Technologies. for Enterprise
Cloud Technologies for Enterprise Is cloud computing the harbinger of the next Industrial Revolution? The time of large data centres holding hundreds of data servers is becoming a thing of the past. As
More informationGetting Started With Serverless: Key Use Cases & Design Patterns
Hybrid clouds that just work Getting Started With Serverless: Key Use Cases & Design Patterns Jennifer Gill Peter Fray Vamsi Chemitiganti Sept 20, 2018 Platform9 Systems 1 Agenda About Us Introduction
More informationAPI, DEVOPS & MICROSERVICES
API, DEVOPS & MICROSERVICES RAPID. OPEN. SECURE. INNOVATION TOUR 2018 April 26 Singapore 1 2018 Software AG. All rights reserved. For internal use only THE NEW ARCHITECTURAL PARADIGM Microservices Containers
More informationTowards a Real- time Processing Pipeline: Running Apache Flink on AWS
Towards a Real- time Processing Pipeline: Running Apache Flink on AWS Dr. Steffen Hausmann, Solutions Architect Michael Hanisch, Manager Solutions Architecture November 18 th, 2016 Stream Processing Challenges
More informationAzure DevOps. Randy Pagels Intelligent Cloud Technical Specialist Great Lakes Region
Azure DevOps Randy Pagels Intelligent Cloud Technical Specialist Great Lakes Region What is DevOps? People. Process. Products. Build & Test Deploy DevOps is the union of people, process, and products to
More informationUsing DC/OS for Continuous Delivery
Using DC/OS for Continuous Delivery DevPulseCon 2017 Elizabeth K. Joseph, @pleia2 Mesosphere 1 Elizabeth K. Joseph, Developer Advocate, Mesosphere 15+ years working in open source communities 10+ years
More information1
1 2 3 6 7 8 9 10 Storage & IO Benchmarking Primer Running sysbench and preparing data Use the prepare option to generate the data. Experiments Run sysbench with different storage systems and instance
More informationMonitoring MySQL with Prometheus & Grafana
Monitoring MySQL with Prometheus & Grafana Julien Pivotto (@roidelapluie) Percona University Belgium June 22nd, 2017 SELECT USER(); Julien "roidelapluie" Pivotto @roidelapluie Sysadmin at inuits Automation,
More informationAlexander Klein. #SQLSatDenmark. ETL meets Azure
Alexander Klein ETL meets Azure BIG Thanks to SQLSat Denmark sponsors Save the date for exiting upcoming events PASS Camp 2017 Main Camp 05.12. 07.12.2017 (04.12. Kick-Off abends) Lufthansa Training &
More informationIncrease Value from Big Data with Real-Time Data Integration and Streaming Analytics
Increase Value from Big Data with Real-Time Data Integration and Streaming Analytics Cy Erbay Senior Director Striim Executive Summary Striim is Uniquely Qualified to Solve the Challenges of Real-Time
More informationNVMe over Fabrics (NVMe-oF) For Containers
NVMe over Fabrics (NVMe-oF) For s Scaling Cloud-Native lications With Elastic And High-Performance Storage Sudhakar Mungamoori Director Storage Solutions, Toshiba Memory America Inc. Venkat Ramakrishnan
More informationData Ingestion at Scale. Jeffrey Sica
Data Ingestion at Scale Jeffrey Sica ARC-TS @jeefy Overview What is Data Ingestion? Concepts Use Cases GPS collection with mobile devices Collecting WiFi data from WAPs Sensor data from manufacturing machines
More informationPowerful Insights with Every Click. FixStream. Agentless Infrastructure Auto-Discovery for Modern IT Operations
Powerful Insights with Every Click FixStream Agentless Infrastructure Auto-Discovery for Modern IT Operations The Challenge AIOps is a big shift from traditional ITOA platforms. ITOA was focused on data
More informationPlatform as a Service (PaaS)
Basics of Cloud Computing Lecture 6 Platform as a Service (PaaS) Satish Narayana Srirama Several slides are taken from Pelle Jakovits Outline Introduction to PaaS Google Cloud Google App Engine Other PaaS
More informationAMP Capabilities List
AMP Capabilities List Contents Entities Web Application Servers Load Balancing and Networking Databases (RDBMS) Data Stores (NoSQL) and Analytics Messaging Specialized Applications Platforms Policies Ecosystem
More informationWestern Michigan University
CS-6030 Cloud compu;ng Google App engine Sepideh Mohammadi Summer II 2017 Western Michigan University content Categories of cloud compu;ng Google cloud plaborm Google App Engine Storage technologies Datastore
More informationDevOps Course Content
DevOps Course Content 1. Introduction: Understanding Development Development SDLC using WaterFall & Agile Understanding Operations DevOps to the rescue What is DevOps DevOps SDLC Continuous Delivery model
More informationMODERN APPLICATION ARCHITECTURE DEMO. Wanja Pernath EMEA Partner Enablement Manager, Middleware & OpenShift
MODERN APPLICATION ARCHITECTURE DEMO Wanja Pernath EMEA Partner Enablement Manager, Middleware & OpenShift COOLSTORE APPLICATION COOLSTORE APPLICATION Online shop for selling products Web-based polyglot
More informationEuropeana Core Service Platform
Europeana Core Service Platform DELIVERABLE D7.1: Strategic Development Plan, Architectural Planning Revision Final Date of submission 30 October 2015 Author(s) Marcin Werla, PSNC Pavel Kats, Europeana
More informationStorm Crawler. Low latency scalable web crawling on Apache Storm. Julien Nioche digitalpebble. Berlin Buzzwords 01/06/2015
Storm Crawler Low latency scalable web crawling on Apache Storm Julien Nioche julien@digitalpebble.com digitalpebble Berlin Buzzwords 01/06/2015 About myself DigitalPebble Ltd, Bristol (UK) Specialised
More informationGriddable.io architecture
Griddable.io architecture Executive summary This whitepaper presents the architecture of griddable.io s smart grids for synchronized data integration. Smart transaction grids are a novel concept aimed
More informationAre you visualizing your logfiles? Bastian Widmer
Are you visualizing your logfiles? Bastian Widmer / @dasrecht Visualizing Logfiles with ELK Stack Bastian Widmer / @dasrecht Hola Com estàs? Bastian Widmer @dasrecht / bastianwidmer.ch DrupalCI: Modernizing
More informationMigrating massive monitoring to Bigtable without downtime. Martin Parm, Infrastructure Engineer for Monitoring
Migrating massive monitoring to Bigtable without downtime Martin Parm, Infrastructure Engineer for Monitoring This is a big deal. -- Nicholas Harteau/VP, Engineering & Infrastructure https://news.spotify.com/dk/2016/02/23/announcing-spotify-infrastructures-googley-future/
More informationNetFlow Optimizer. Overview. Version (Build ) May 2017
NetFlow Optimizer Overview Version 2.4.9 (Build 2.4.9.0.3) May 2017 Copyright 2013-2017 NetFlow Logic Corporation. All rights reserved. Patents both issued and pending. Contents About NetFlow Optimizer...
More informationDeploying Applications on DC/OS
Mesosphere Datacenter Operating System Deploying Applications on DC/OS Keith McClellan - Technical Lead, Federal Programs keith.mcclellan@mesosphere.com V6 THE FUTURE IS ALREADY HERE IT S JUST NOT EVENLY
More informationCisco Tetration Analytics
Cisco Tetration Analytics Enhanced security and operations with real time analytics John Joo Tetration Business Unit Cisco Systems Security Challenges in Modern Data Centers Securing applications has become
More informationLenses 2.1 Enterprise Features PRODUCT DATA SHEET
Lenses 2.1 Enterprise Features PRODUCT DATA SHEET 1 OVERVIEW DataOps is the art of progressing from data to value in seconds. For us, its all about making data operations as easy and fast as using the
More informationCreating a Recommender System. An Elasticsearch & Apache Spark approach
Creating a Recommender System An Elasticsearch & Apache Spark approach My Profile SKILLS Álvaro Santos Andrés Big Data & Analytics Solution Architect in Ericsson with more than 12 years of experience focused
More informationThe four forces of Cloud Native
1 Aplicaciones Nativas En La Nube The four forces of Cloud Native Iñaki Borrero- Advisory vspecialist MEDI, Dell EMC @DellEMCForum 2 Containers Devops Confluence of 4 forces Agile 3 3 Microservices 4 4
More informationBig Data Applications with Spring XD
Big Data Applications with Spring XD Thomas Darimont, Software Engineer, Pivotal Inc. @thomasdarimont Unless otherwise indicated, these slides are 2013-2015 Pivotal Software, Inc. and licensed under a
More informationZERO TRUSTED NETWORKS
SEARCH GUARD ZERO TRUSTED NETWORKS OR: WHY PERIMETER SECURITY IS DEAD 01. ABOUT ME Jochen Kressin, Co-Founder & CTO of floragunn GmbH Makers of Search Guard Enterprise Security Suite for Elasticsearch
More informationDavid Pilato Developer Advanced search for your legacy application
David Pilato Developer Evangelist @dadoonet Advanced search for your legacy application # 2 our legacy platform WEB APP DATABASE SQL JDBC HTTP / REST 3 4 our legacy domain / database demo time our legacy
More informationCHALLENGES IN A MICROSERVICES AGE: MONITORING, LOGGING AND TRACING ON OPENSHIFT. Martin Etmajer Technology May 4, 2017
CHALLENGES IN A MICROSERVICES AGE: MONITORING, LOGGING AND TRACING ON OPENSHIFT Martin Etmajer Technology Lead @Dynatrace May 4, 2017 WHY A CHALLENGE? Microservice A Microservice B Microservice C Microservice
More informationCloud & container monitoring , Lars Michelsen Check_MK Conference #4
Cloud & container monitoring 04.05.2018, Lars Michelsen Some cloud definitions Applications Data Runtime Middleware O/S Virtualization Servers Storage Networking Software-as-a-Service (SaaS) Applications
More informationStreamSets Control Hub Installation Guide
StreamSets Control Hub Installation Guide Version 3.2.1 2018, StreamSets, Inc. All rights reserved. Table of Contents 2 Table of Contents Chapter 1: What's New...1 What's New in 3.2.1... 2 What's New in
More informationVMware Cloud on AWS Technical Deck VMware, Inc.
VMware Cloud on AWS Technical Deck # 2 Enterprise Adoption Driving Strong Growth of Public Cloud Infrastructure as a Service, According to IDC. Press release. IDC. July 14, 2016 3 Cloud Building Challenges
More informationA U.S. based so,ware development and technical consul9ng company. Technical Capabilities Overview
A U.S. based so,ware development and technical consul9ng company Technical Capabilities Overview Overview Team Software Engineers, supported by full QA team authoring automated tests All located in single
More informationHarvesting Logs and Events Using MetaCentrum Virtualization Services. Radoslav Bodó, Daniel Kouřil CESNET
Harvesting Logs and Events Using MetaCentrum Virtualization Services Radoslav Bodó, Daniel Kouřil CESNET Campus network monitoring and security workshop Prague 2014 Agenda Introduction Collecting logs
More information