The TIBCO Insight Platform Actions with Analytics

Transcription

1 The TIBCO Insight Platform Actions with Analytics Michael O Connell Chief Analytics Lou Bajuk Sr. Director Product

2 Insight Platform - Actions with Analytics Value Grow Revenue Insight Platforms - Forrester The TIBCO Insight Platform Enabling Digital Business Insight to Action 1. Visual Analytics and Data Discovery 2. Numerical Algorithms Reduce Risk Increase Productivity ROI 3. Insight Execution Insight Platform Demonstration & Case Studies IIoT and Customer Analytics Wrap Up TIBCO Community & Exchange

3 Insight Driven Businesses are more successful An insights-driven business harnesses and applies data and analytics at every opportunity to differentiate its products and customer experiences. Harness digital insights to optimize product and service delivery Learn and adapt with lightning speed Source: Forrester Report, The Insights-Driven Business (July 2016) Create sustainable barriers to entry

4 Insight-Driven Businesses operate in a Closed-Loop Learning Process Source: Forrester Report, The Insights-Driven Business (July 2016)

5 TIBCO Insight Platform Forrester Insight Platform Wave 2016 TIBCO #1 Current Offering

6 People & Processes Visual Analytics APIs Predictive Analytics Data & Systems Streaming Analytics

7 AUGMENT INTELLIGENCE Visual Analytics Deliver recommendation driven insight to business and operations Predictive Analytics Model business and system behavior using data big and small Streaming Analytics Sense and take action in the right moment to improve business outcomes

8 AUGMENT INTELLIGENCE Visual Analytics ACCESS ANALYZE WRANGLE Predictive Analytics MODEL PREDICT Insight Action Streaming Analytics DECIDE ACT MONITOR

9 Learning Cycles Visual Analytics ACCESS ANALYZE WRANGLE ACCESS Predictive Analytics MODEL PREDICT WRANGLE Insight ANALYZE MODEL

10 Operational Cycles PREDICT Predictive Analytics MODEL PREDICT Action DECIDE Streaming Analytics DECIDE ACT MONITOR MONITOR ACT

11 TIBCO Insight Operational Platform Cycles Data Discovery ACCESS PREDICT Insight Deployment WRANGLE DECIDE ANALYZE Insight Action ACT MODEL MONITOR

12 TIBCO Insight Operational Platform Cycles TIBCO Spotfire ACCESS PREDICT TIBCO Streambase TIBCO Business Events WRANGLE DECIDE Insight Action ANALYZE ACT MODEL MONITOR

13 2-Speed Information Architecture Act & Monitor Store Events are analyzed and processed in real-time as they arrive Decisions are timely, contextual, and based on fresh data Decision latency is eliminated: Analyze ü Superior Customer Experience ü Operational Excellence ü Instant Awareness and Timely Decisions Copyright Copyright TIBCO Software Software Inc. Inc.

14 #1. Smart Visual Analytics INSIGHT Numerical Models Analytic Apps MODEL ACTION

15 #1. Smart Visual Analytics Recommendation driven insights Visual analytics is like a bicycle for your business mind.

16 Spotfire : Visual Analytics

17 Spotfire : Recommendations

18 Visual Analytics Spotfire Dashboards

19 Visual Analytics Spotfire Dashboards

20 Data Access & Data Wrangling In-Line, Immersive, Iterative

21 Visual Data Discovery on Big Data In-memory As fast as it gets, in RAM - no extracts to file, up to 1 Billion rows In-database live queries, no size limit, leverage investment and DB power On-demand smart load data only what s needed when needed Connectors are in-db apart from web connectors eg SFDC, Google analytics, odata - These are in-memory connectors; disabled keep data external option All connectors support on-demand (marking, doc properties driven) in-db and in-mem

22 Spotfire Data Connectors Goal, All: SQL92, FAST Native self service data connectors No DSN required Cloud Amazon Redshift Google Analytics (includes web authoring support in Business Author) Salesforce.com (includes web authoring support in Business Author) Enterprise Attivio Cisco ("Composite") Information Server HP Vertica IBM DB2 IBM Netezza Microsoft SQL Server Oracle Oracle MySQL Pivotal Greenplum PostgreSQL Teradata Teradata Aster Hadoop Apache Hive Apache Spark SQL Databricks Cloud Apache Hadoop Cloudera Hortonworks IBM BigInsights MapR Cloudera Hive Cloudera Impala Hortonworks Apache Hive IBM BigInsights Hive MapR Hive Pivotal HAWQ OLAP Microsoft SSAS Oracle Essbase SAP BW SAP SAP HANA SAP BW Web Services Odata TIBCO Spotfire Advanced Data Services Cisco Information Server Custom Java procedure Cloudera Cloudera Impala Data direct mainframe Files (cache, delimited, and XML) Greenplum Hbase Hadoop/Hive Hortonworks HDP HP Neoview HSQLDB IBM DB2 IBM DB2 z/os Informix LDAP Microsoft Access Microsoft Excel Microsoft SQL Server Mock-File-Delimited Oracle MySQL Netezza Oracle PostgreSQL SAP HANA Sybase ASE Sybase IQ Teradata WSDL HPE Vertica XML (flat files over HTTP) Sonic 7.5 TIBCO EMS OpenMQ Spotfire JDBC data sources Any JDBC source IBM DB2 Oracle MySQL IBM Netezza Oracle Spotfire ODBC data sources MongoDB File data sources ADO.NET Comma-Separated Values (.csv) ESRI Shape (.shp) Microsoft Access (.mdb,.mde) Microsoft Excel (.xls,.xlsx,.xlsm) ODBC SAS Data Files (.sas7bdat,.sd2) TIBCO Spotfire Attivio AIE JDBC CSV Excel Avro Parquet RSS Amazon Redshift SAS/SHARE Microsoft SQL Server SAP Sybase Teradata TIBCO Spotfire ADS Apache Cassandra Spotfire DecisionSite (.sfs) Spotfire Text (.stdf) Spotfire Binary (.sbdf) Text (.txt) TIBCO Formvine Universal Data Link (.udl) SPSS data files StatTran XML HTML Word PDF

23 Spotfire Big Data Connectors

24 StreamBase Adapters and Connectivity Financial Databases IoT: Integration OSI-PI Apps PeopleSoft, SAP, Siebel, Oracle E-Business WITSML MQTT SDFC, MSFT Sharepoint NetSuite, Marketo, MSFT CRM, Workday ServiceNow, JD Edwards,.. Big Data Social API s C++, Java,.NET, JavaScript, Python Messaging TIBCO RV, FTL & EMS, JMS, AMPQ, MQ Series, RMDS, Solace, Tervela, Wombat General Purpose Adapters FIX, STAMP, JDBC, ActiveSpaces, POP3, IRC, HTTP, SMTP, IM, XML, RSS

25 Spotfire Inline Data Wrangling Clean bad data Handle Missing Values Data Properties: Descriptive Stats Data Type Control Sort Order Control Missing Data Handling Quick Data Profiling

26 Spotfire Inline Data Wrangling Enrich Split, Create New Columns.. Group Clean and organize (MDM)

27 Spotfire Inline Data Wrangling Source View Auto Generated Data Lineage

28 2 Speed Architecture: Event Data Insight Action Messaging Normalization Filtering Batch Transform Deep ML Analytics Data Lake Index / Search Analytics / DW Reporting APIs Transformation Process Management Integration Adapters / Channels Enrichment Aggregation Real-Time RT Analytics Contextual Rules Windowing Patterns Applications & APIs Analytics (Real Time) Ingest Stream Processing Analytics Stream Outcomes Copyright Copyright TIBCO Software Software Inc. Inc.

29 #2. Numerical Models Analytic Apps

30 Σ Data Science Re-Imagined Mass Communicate the Power of Data Science Spotfire has an embedded R Engine Client and Server Spotfire makes it easy for Data Scientists to share their work Spotfire Data Functions support many Stats Engines Spotfire Library manages components for re-use & sharing TIBCO Community shares data science components

31 Σ TIBCO Enterprise Runtime for R (TERR) Enterprise-class statistics engine, rebuilt from the ground up by TIBCO Latest statistics scripting engine: S a S-PLUS a R a TERR X better performance and memory management than open source R Runs R code including CRAN packages Designed for commercial apps / embedding TIBCO licensed and supported product : NOT GPL NOT a repackaging of the open source R engine TERR extends the reach of R in the enterprise Develop code in open source R Deploy on a commercially-supported and robust platform Embed in Data Discovery, BI and real-time applications TERR is embedded in :- Spotfire Statistics Services TIBCO Grid Server TIBCO Cloud Compute Grid TIBCO Streambase TIBCO Business Events KNIME, Lavastorm, Hadoop, Spark Analytic Apps at Scale

32 Σ TERR and Spotfire What does TERR do in Spotfire? Adds stats on the Visual environment Can be used directly in Expressions (Data Wrangling) Runs TERR Data Functions in Spotfire analyses Powers the Predictive Modeling Tools Can extend Spotfire graphics palette

33 Σ Spotfire TERR Data Function Spotfire Map Spotfire TERR Data Function contourlines(x,y)

34 Σ Spotfire TERR GeoSpatial Data Functions GeoSpatial Data Functions Coordinate system transformation Contour analysis Kriging Hexbin analysis Points in Polygon analysis Polygon Area analysis Trade Area analysis Route optimization Route charts Drive distance, walk distance

35 Σ TERR Server-Side TERR on server : Spotfire Statistics Services Build models on big data directly in TERR on server and display results in Spotfire Run other stats engines from Spotfire Larger Data Results Modeling Data Source ODBC JDBC SDC File TERR TSSS Data Function Spotfire Spotfire and TERR can load data from any ODBC or JDBC compliant source or from Spotfire Data Connections (SDC) or Spotfire Information Links stored in the Spotfire library.

36 Σ Spotfire TERR Data Function Anomaly Detection Spotfire TERR Data Function h2o.deeplearning(x,..) h2o.deeplearning( )

37 Σ Spotfire TERR Machine Learning Data Functions Spotfire Modeling Data Functions Machine Learning Gradient Boosting Random Forests Deep Learning Anomaly Detection Segmentation Propensity Affinity Non-Linear Regression; Decline Curves Modeling & Simulation Genetic Algorithms Optimization

38 Σ Analytic Apps Deliver proactive customer service Smart cross-sell offers Predict impending equipment failure Real-Time inventory Management Optimize Pricing Prevent Fraud Optimize Routes Anticipate and handle disruptions

39 #3. Streaming Analytics Continuous algorithmic awareness & automation

40 Data Flow: Event Data Insight 1/ All Data Begin as Real-Time Events 2/ Analytics on Accumulated Data 3/ Insights are Perishable => Take Action!! Credit: Mike Gualtieri, Forrester

41 Data Flow Messaging APIs Integration Adapters / Channels Normalization Filtering Transformation Enrichment Aggregation Batch StreamBase BusinessEvents Real-Time Live Datamart & LiveView Transform Deep ML Analytics Data Lake RT Analytics Contextual Rules Windowing Patterns Index / Search Analytics / DW Reporting Process Management Applications & APIs Analytics (Real Time) Stream Ingest Stream Processing Stream Analytics Stream Outcomes Copyright Copyright TIBCO Software Software Inc. Inc.

42 Streaming Analytics : Streambase Spotfire Connection Business Strategy Continuous Visualization Analytics designed by data scientists Data Infrastructure Automated Action

43 Streaming Analytics : Streambase Analytics designed by data scientists

44 Anomaly Sensor Detection Analytics Leading Indicator Identification Location Change Variable moves up or down Slope Change Variable changes trend Variance Change Variable becomes more/less volatile Process Threshold Shewhart control chart Failure Model y (0/1) = f (X, b) + e; f = logistic regression, trees, svm, nnet,... Trend Analysis Combination of Rules CUSUM Analysis Statistical Analysis Statistical Process Control Machine Learning

45 Streaming Analytics : Insight Execution PFA PMML WITSML OSI PI TERR H2O

46 Streaming Analytics : LiveView + Spotfire Timestamp of latest refresh of data Existing LV Web App Data Refresh control and logging Sample Spotfire Visual Showing Latest Snapshot Data

47 Demonstrations

48 TIBCO Insight Platform Demonstration : IIoT Engineering Apps (Streambase) Predictive Maintenance, Production Surveillance,.. Data Science (Spotfire) Threshold ID, SPC, Models Analytics DevOps Notifications, RCA,.. Data in motion Sensor readings, monitoring and surveillance data OSI-PI (Realtime Data) Streambase (Analytics Engine) Surveillance System Output Cloud Service Mobile Alerts

49 TIBCO Insight Platform Demonstration : Simple Build Omni-channel Business Apps e.g. Web store, fulfilment, mobile app, call center, POS, CRM Data Science Analytics DevOps Cross-sell Make top offer Data in motion e.g. website traffic, mobile apps, store visits

50 Architecture Community

51 Insight Platform w Spark + Spotfire, Streambase, TERR Spotfire Live Datamart Operational Analytics Real-Time KPIs Model Performance Discover Data Relationships Train Models Validate Models Package Models into Campaigns Analytics Dashboards Events StreamBase Spark/Big Data Cluster Responses Capture streaming data Normalize Persist Load/Unload Trained Models Featurize Score Models Load model SQL

52 Insight Discovery to Execution Insight Discovery TIBCO Spotfire R, TERR, Python H2O, Skymind Matlab, SAS KNIME Insight Execution PFA, PMML POJO Proprietary formats (SAS, TIBCO,...) Insight Execution Services Microservice with containers ODG FastScore Devops / Data Science handshake

53 community.tibco.com

54 Spotfire Wiki

55

56 Contact Info Thank you! Michael O Connell, PhD Chief Analytics Officer TIBCO Lou Bajuk-Yorgan Sr. Director, Product Management Streaming and Advanced Analytics TIBCO

57