IntegraBng Splunk Data and FuncBonality Using the Splunk SDK for Java

Transcription

1 Copyright 2013 Splunk Inc. IntegraBng Splunk Data and FuncBonality Using the Splunk SDK for Java Damien Dallimore Developer Splunk #splunkconf

2 Legal NoBces During the course of this presentabon, we may make forward- looking statements regarding future events or the expected performance of the company. We caubon you that such statements reflect our current expectabons and esbmates based on factors currently known to us and that actual events or results could differ materially. For important factors that may cause actual results to differ from those contained in our forward- looking statements, please review our filings with the SEC. The forward- looking statements made in this presentabon are being made as of the Bme and date of its live presentabon. If reviewed ater its live presentabon, this presentabon may not contain current or accurate informabon. We do not assume any obligabon to update any forward- looking statements we may make. In addibon, any informabon about our roadmap outlines our general product direcbon and is subject to change at any Bme without nobce. It is for informabonal purposes only and shall not, be incorporated into any contract or other commitment. Splunk undertakes no obligabon either to develop the features or funcbonality described or to include any such feature or funcbonality in a future release. Splunk, Splunk>, Splunk Storm, Listen to Your Data, SPL and The Engine for Machine Data are trademarks and registered trademarks of Splunk Inc. in the United States and other countries. All other brand names, product names, or trademarks belong to their respeccve owners Splunk Inc. All rights reserved. 2

3 About Me

4 Developer Evangelist at Splunk Make Talk 4

5 Came from the Splunk Community 5

6 Coder 6

7 From Aotearoa (New Zealand) 7

8 Agenda

9 Agenda! Developer Pla`orm Overview! The Basics! Digging a bit deeper! IntegraBon Frameworks! Tools, Libraries and other use cases! QuesBons (if Bme allowing, else find me aterwards) 9

10 Developer Pla`orm Overview

11 Powerful Pla`orm for Enterprise Developers Build Splunk Apps Extend and Integrate Splunk Web Framework Simple XML JavaScript Django SDKs Java JavaScript Python Ruby C# PHP Data Models Search Extensibility Modular Inputs REST API 11

12 The Splunk REST API! Exposes an API method for every feature in the product Run searches Input data Manage Splunk configurabons! API is RESTful Endpoints are served by Splunkd Requests are GET, POST, and DELETE HTTP methods Responses are Atom XML Feeds or JSON Search results can be output in CSV/JSON/XML/Raw AuthenBcaBon is header token based 12

13 SDKs (SoTware Development Kits)! Our SDKs make it easier to use the REST API No need to wrangle with lower level HTTP REST semanbcs! Several different language offerings now available Javascript, Java, Python, PHP, C#, Ruby! Now includes support for more rapid development of Modular Inputs! Typical Use Cases Accelerate your Dev/Test cycles Integrate with exisbng solubons Build new big data applicabons 13

14 The Basics

15 Get the Splunk SDK for Java! Current release v1.2! Open sourced under the Apache v2.0 license! Clone from Github : git clone hnps://github.com/splunk/splunk- sdk- java.git! Project level support for Eclipse and Intellij IDE s, or use the development environment of your choice! Pre- requisites JRE 6+ Splunk installed Ant! Maven/Gradle/Ivy repository hnp://splunk.arbfactoryonline.com/splunk/ext- releases- local 15

16 SDK Class Design HTTPService Resource Args BaseService ResourceCollecBon EnBty EnBtyCollecBon Service JobCollecBon Job JobResultsArgs 16

17 Code & Demo! ConnecBng and authenbcabng! Hirng a simple REST endpoint! Simple searches Oneshot Blocking Search Simple Blocking Search! Indexing an event 17

18 Digging a Bit Deeper

19 Code & Demo! Searching (also demonstrates handling & displaying results ) Asynchronous with Job object RealBme Search ExporBng Paging through large result sets Saved searches and dynamic dispatch arguments! Indexing data TCP UDP Index oneshot upload! Managing Splunk (also demonstrates state management) create a Role enbty create a User enbty! Namespaces 19

20 IntegraBon Frameworks

21 Let s Make Life Even Easier! Splunk SDK for Java makes using the REST API easier! What can we do to make the SDK easier to use?! Integrate into standard enterprise Java sotware frameworks Spring IntegraBon (code & demo) Apache Camel (code & demo) Mule ESB 21

22 Tools, Libraries & Other Use Cases

23 Splunk Java Logging! A logging framework to allow developers to as seamlessly as possible integrate Splunk best pracbce logging semanbcs into their code! Transport log events to Splunk directly from your code! Custom handler/appender implementabons(rest and Raw TCP) for common Java logging frameworks LogBack Log4j java.ubl.logging! UBlity classes for formarng log events! Configurable in memory buffer to handle network outages 23

24 Eclipse Plugin! Adds extensions to the Eclipse sotware development pla`orm to simplify creabng projects using the Splunk SDK for Java! A new "Splunk SDK for Java" project type! A set of code templates for common tasks using the Splunk SDK for Java, plus opbonal data parsing and logging capabilibes! A launcher for Java applicabons that logs JVM acbvity to a Splunk instance JMX java.lang MBeans Byte Code InjecBon method level tracing 24

25 Other JVM Languages Scala Groovy Clojure Javascript(Rhino) JRuby PHP(Quercus) Ceylon Kotlin Jython We don t need SDK s for these languages, we can just use the Java SDK! 25

26 HUNK (Splunk AnalyBcs for Hadoop)! A new product offering from Splunk! Allows you to use the power and simplicity of Splunk to search over data locked away in HDFS! Sits on top of HDFS as if it was a nabve Splunk Index! Virtual Indexes! So you can use the Splunk SDK for Java to develop your Hadoop applicabons in exactly the same way that you currently use it. 26

27 Housekeeping

28 Where to Go for More Info Portal hnp://dev.splunk.com Github hnps://github.com/splunk Blog hnp://blogs.splunk.com/dev Demos hnp://demos.splunk.com 28

29 Links Github Gists for code examples in this presentabon : hnps://gist.github.com/damiendallimore SDK docs at dev.splunk.com : hnp://dev.splunk.com/view/sp- CAAAECN Splunk SDK for Java Github repository : hnps://github.com/splunk/splunk- sdk- java Splunk Spring IntegraBon repository on Github : hnps://github.com/springsource/spring- integrabon- extensions/tree/master/spring- integrabon- splunk Splunk Spring IntegraBon demo on Github : hnps://github.com/damiendallimore/spring- integrabon- splunk- webex- demo Splunk Apache Camel repository on Github : hnps://github.com/pax95/camel- splunk Splunk Apache Camel demo on Github : hnps://github.com/pax95/camel- splunk- example Splunk Eclipse plugin : hnp://dev.splunk.com/view/splunk- plugin- eclipse/sp- CAAAEQP Splunk Java Logging on Github : hnps://github.com/splunk/splunk- library- javalogging Splunk Java Agent on Github : hnps://github.com/damiendallimore/splunkjavaagent Splunk Android SDK on Github : hnps://github.com/damiendallimore/splunk- sdk- android Splunk REST API reference : hnp://docs.splunk.com/documentabon/splunk/latest/restapi/restcontents Free Splunk download : hnp:// Best pracbce logging overview : hnp://dev.splunk.com/view/logging- best- pracbces/sp- CAAADP6 Splunk SDK for Java videos : hnp://dev.splunk.com/view/get- started/sp- CAAAECH HUNK Beta video : hnp:// CAAAH2F Maven/Gradle/Ivy Repository : hnp://splunk.arbfactoryonline.com/splunk/ext- releases- local 29

30 Contact me ddallimore@splunk.com Twi6er Skype : damien.dallimore Github : damiendallimore Splunkbase : damiend Slideshare : hnp:// I will be around all week, feel free to grab me for a chat or a beer or both J 30

31 Thank you!