Db2 Web Query Demonstration

Transcription

1 Cognitive Systems Db2 Web Query Demonstration Doug Mack Cognitive Systems Lab Services

2 Analytics Experiences Insurance Industry: Why are our gross profit on policies sold in South America not as profitable as in North America? Manufacturing Industry: What is the amount of money our company spends on suppliers that are owned by a minority? Retailer: How can I ensure I have the right product mix inventory at our store locations based on how weather impacts purchasing decisions? Security Compliance Officer: I just want to have my cup of coffee in the morning and see that we are in compliance across different security attributes.

3 The Data Challenges Not all data is in the same place (or even in the same database) Multiple databases, Db2, SQLServer, Excel Much of the data is not understandable and may need to be re-structured, cleansed, or un-tangled. Some data you want for analysis might not even exist on your system! How many galoshes did I sell on Mondays after a rainy weekend? Often processing large amounts of data and summarizing, then drilling deeper Analytics workloads are different than transaction processing workloads where the database I/O and CPU usage is very short and data is at detail level Databases supporting analytics workloads require query acceleration techniques Buzz Words: in memory, columnar, parallelism, scalability

4 IBM i, DB2 for i, and Db2 Web Query Database Monitors Db2 Web Query for i Metadata Show Statements Data Warehousng Visual Explain DataMigrator ETL Plan Cache Data Discovery Connections to Watson/IBM Cloud Encoded Vector Indexing Symmetric Multi- Processing Maintained Temp Indexes Adapter Query Processing Aggregations in EVIs Materialized Query Tables Index Advice Result Set Caching EVI Index Only Access Star Schema Optimization (Lookahead Predicate Generation) BI/DW Tooling SQL Set at a Time SQL Aggregate Functions Grouping Sets, Rollup Rank, Dense Rank SQL OLAP Extensions SQL Stats Functions DBE Tooling Query Accelerators SQL Language Single Level Store Large Memory Model IBM i Architecture

5 Db2 Web Query for i Business Intelligence for IBM i Fast, easy access to business information assets for query, reporting and analysis Authoring Tool Intuitive Reports & Graphs Flexible delivery Dashboards Insightful OLAP Extensible Providing Analytics and Query/400 Modernization for the IBM i Client Low Cost Solution Offering Value Upgrade from Query/400 Leveraging Best Practice Meta Data Layer Approach Leveraging Db2 for i Advanced Query Optimization Technology 5

6 Db2 Web Query DataMigrator ETL Extension Extract, Transformation and Load Functions Automate consolidation, organization, untangling and optionally, the building of a data warehouse or data mart Consolidate data from many different data sources Build transforms through SQL, RPG, use of built in or Db2 functions, etc. Can create flat files, relational, incorporate lobs (e.g., XML, JSON) Run data flows off of IBM i job scheduler Integrated with IBM i and Db2 for i All components run in IBM i CL Commands, PTF Management, Security, Licensing is all IBM i INTEGRATED with Db2 Web Query Business Intelligence Can leverage meta data created with Db2 Web Query or vice versa Shared services and administration 6

7 Prototype Example: Augmenting Operational Data with Weather Data Augment Data with Weather info Visualize/deploy insights with Db2 Web Query IBM Bluemix Db2 Web Query for i DataMigrator Db2 for i Datamart Db2 for i Order, Product, Inventory and measurements (revenue, COGS) Information Power Systems(IBM i)

8 Db2 Web Query Installation and Setup (in 15 minutes) With the NEW EZ-Install Package

9 What is the EZ-Install Package A single downloadable image that you can request that includes: o o o o o o Db2 Web Query Version 2.2 at the LATEST PTF Group Level. Includes: An optional pre-req checker Express and Standard Edition Data Migrator and Developer Workbench Sample Century Electronics Database including MetaData over the database so you can run self guided tutorials out of the box» Library QWQCENT Sample IBM i System Administration Reports Db2 Web Query Auditing/Monitoring Reports Query/400 Discovery Tool All of the Tutorial Reports already completed (but this would be cheating if you didn t do the tutorials yourself) Request by sending to QU2@us.ibm.com Include: Name, Company Name, and Serial Number of system you plan to install on

10 Let s Take A Look And if you re interested in seeing more detail and how you build metadata, reports, and visualizations, attend the Workshop this afternoon!

11 To SQL or not to SQL Your HR department wants to ensure salaries are equitable across the company and across departments and there aren t outliers or other discrepancies What is the employee s salary compared to the average WITHIN their department? For each employee, compare their salary to the two closest behind this person s salary, and the two closest ahead of them in salary Check out blog post at db2webqueryi.blogspot.com

12 Db2 for i OLAP Specifications to the Rescue! With IBM i 7.3, Db2 for i supports the following additional OLAP specifications for summarizing and referencing rows within windows of result sets: Aggregates (SUM, COUNT, etc.) LAG and LEAD NTILE FIRST_VALUE, NTH_VALUE, and LAST_VALUE RATIO_TO REPORT CUME_DIST What is the value of this? You can address more complex analysis in a much simpler way (than the alternatives) BI tools like Db2 Web Query can push the work to Db2 for better performance

13 The Process Create a SQL Views (or script) using new 7.3 SQL Extensions View for Salary compared to AVERAGE View for 2 ahead, 2 behind

14 Examples

15 To Learn More Db2 Web Query for i Website (Product Info) Ibm.biz/db2webqueryi Db2 Web Query for i Wiki (Technical Info) Ibm.co/db2wqwiki Db2 Web Query Getting Started Enablement: Demonstrations: V2.2.1 Visualizations: End User Demos: EZ-Install Follow Db2 Web Query guy Doug Mack on twitter or check out his blog at for the latest info 15