Cool Things You Can Do with DB2 Web Query for i

Transcription

1 Cool Things You Can Do with DB2 Web Query for i Doug Mack DB2 for i Lab Services mackd@us.ibm.com QU2@us.ibm.com Agenda Quick Introduction A Query/400 Renaissance is underway Use DB2 Web Query for Systems Administration Reports Create a Dashboard with a Map Use DataMigrator to Build Operational DataStores or DataMarts to Optmize the Query Workloads

2 DB2 Web Query for i Intuitive, Insightful, Extensible Fast, easy access to business information assets for query, reporting and analysis Authoring Tool Intuitive Reports & Graphs Flexible delivery Dashboards Insightful OLAP Extensible Providing Analytics and Query/400 Modernization for the IBM i Client Low Cost Solution Offering Value Upgrade from Query/400 Leveraging Best Practice Meta Data Layer Approach Leveraging DB2 for i Advanced Query Optimization Technology 3 DB2 Web Query History DB2 Web Query was designed to: Modernize RPG and Query/400 Reporting and align with DB Modernization Strategies Leverage the IBM i and DB2 for i OS and DBMS Based on SQL Use of SQE Engine Provide a robust Business Intelligence Solution Limited use version at no charge Circa 2007 Import Query/400 GUI Authoring Tools Output to Excel, PDF, HTML, active reports Leverages SQE Meta Data Layer Developer Workbench for advanced dashboarding Run Time Licensing Automated job scheduling and distribution Excel Plug In SQLServer as data source Redbook SDK for application integration New GUI Authoring tool JDEdwards Adapter Query/400 conversion tools Improved Dasbhoarding Change Management Run Time Environments Version Simplified Packaging with Express and Standard Core based pricing Mobile Device Support New Security Center New BI Portal Interface Personal Dashboards DB2 Family as data sources Geographical Mapping Wizard Analytics DataMigrator ETL tool for building data warehouses Advanced HTML5 Charts/graphs DB2 Web Query Solution Edition Updated Redbook Updated Education (OD04 1 day class, OD05 3 day advanced workchop) How to get started videos Version 2.2 Auto Size Dashboards Enhanced DataSource Support for MySQL, Postgres or Generic JDBC Developer Workbench Usability Features Browser or mobile device specific development options

3 IBM DB2 Web Query for i User Interface The jumping off point for working with DB2 Web Query BI Portal the End User Standard Interface Run Reports Edit Reports Schedule Report Work with folders Work with Change Management Sync reports via Mobile Favorites Folder Set up Security Build a personal Dashboard InfoAssist Report Authoring Tool invoked with right-click and NEW at the folder level or with right-click EDIT at report level Build/Edit Reports and Dashboards with InfoAssist Web based Report Authoring component (built into Express or Standard) Invoked from BI Portal (web) or Developer Workbench (Windows) Intuitive office-like interface Tool bars (Ribbon) change based on selected tab WYSIWYG layout area Build reports, charts, graphs, maps, dashboards Output types Excel including pivot tables Active technologies (good for mobile devices) PDF, File, Print, Database Auto drill down (OLAP) report HTML, HTML5, Flash Powerpoint User can select at Run Time

4 A Query/400 Renaissance Renaissance: A cultural bridge between the middle ages and modern history Wikipedia: A Query/400 Renaissance: A methodology to move from the middle ages to modern Business Intelligence I made this up Query/400 to DB2 Web Query Imports your existing QRYDFN to DB2 Web Query browser reports Can import all per Library Can still run the green screen version (but why would you?) If the green screen version changes, you d need to re-import There ARE some limitations We ll get to those later

5 Step 1 is to Create a Synonym over the Query/400 definition(s) query Choose which queries to import A report is automatically built Hint: Give the synonym a prefix or suffix so you can later recognize it as a query/400 definition

6 Before and After (but we re not done) Enhance the Query/400 Definition Format the report Add a header, footer, stylesheet, traffic light Change the output Push the result set into a spreadsheet or build an active report Add a prompt for user controlled record selection Add the report to a dashboard Schedule the report to run automatically and send it out in an Copyright IBM Corporation 2014

7 No More Green Screen Changed the look of the report Added Report Header and Footer Sorted by Revenue Created new calculated field for %Gross Profit Added traffic lighting to that new field Can easily spot that bottom two products are high margin but low revenue why aren t we selling more? Changed the output to allow the end user to run this query on their own and put the results in a spreadsheet Made Product Type a parameter Moved Product Type column to the left of Product Category Now Let s Talk about those Limitations Chained Queries probably require some analysis and re-write because either you don t NEED to chain the queries because of more powerful function in DB2 Web Query or there is a better way Pre 7.2 it uses the older DB2 query engine, and likely even at 7.2 or 7.3 Poorer performance than a native SQL Query that DB2 Web Query generates Fields available to you to add to the report are limited to the original fields defined in the Query/400 definition And think about this if you have 1000 Query/400 definitions where there is a lot of redundancy or even ones that are obsolete this is your chance to clean this up and consolidate IBM has some tools to you help you too will cover in the next hour! But here s an example:

8 Build That Same Report from Scratch and make it Auto Drill Now the end user can iterate through the data with a single report

9 End Users Can (without needing another report): Drilll down on just Audio products Filter on United States and add REGION column to report End Users Can (without needing another report): Look for Trends by adding YEARS across the top (and clean up the report by removing a couple of columns): Use Pivot tool to make multiple changes at once:

10 End Users Can (without needing another report): When done iterating through the data, you can save to Excel, or an ACTIVE* Report for mobile devices, or just save to come back at a later time for more analysis without having to start the data iteration from the beginning With this ONE auto drill report, you just eliminated at least 20 Query/400 reports (probably more) Using InfoAssist to Build a Report Select Your Synonym (Meta data)

11 IBM DB2 Web Query for i InfoAssist IBM DB2 Web Query for i InfoAssist Format Tab

12 IBM DB2 Web Query for i InfoAssist Data Tab IBM DB2 Web Query for i InfoAssist Slicers, Layout and View Tabs

13 IBM DB2 Web Query for i InfoAssist Field Tab IBM DB2 Web Query for i InfoAssist Choosing Fields for Report

14 IBM DB2 Web Query for i InfoAssist 27 IBM DB2 Web Query for i InfoAssist Sort, Rank, Make it a top xx report Add headers, footers Add breakpoints, sub totals, grand totals Add column or row totals Change output types Change style sheet Add prompts/parameters Add traffic lights, Data Bars Change to one of the over 100 charts and graphs Add table of contents or pages on demand Add features like accordion collapse and expand sections Stack Measures Create link to a drill down report or URL 28

15 IBM DB2 Web Query for i InfoAssist 29 Dump the Data Into an Excel Pivot Table Sales Report defined with Excel Pivot Table Output

16 Create/Edit/Run Reports Directly from within Excel Using the Excel add-in Create ad-hoc form to simplify parameter selection for end users 31 Deploy to Mobile Device Build reports once, deploy to any device Dynamic detection of the device Converts to mobile Renders appropriate content for the device No charge android and apple apps Mobile Faves for managing reports and connections Synchronize reports w/ Mobile Faves folder in BI Portal Receive reports in and work offline Use the client s browser to connect to your system and access via the BI Portal See video at: ibm.biz/db2webqueryi Take DB2 Web Query End User Demos link

17 Place Your Report onto a Dashboard Build KPI (Key Performance Indicator) view of the business for executives Layout multiple KPIs onto single view Some, but often minimal interaction Example: allow end user to select geography of interest and all charts automatically reflect selection Multiple deployment models Active dashboards Can work with data offline Good fit for mobile device support Advanced dashboards with more sophisticated features Many additional controls such as a date picker Highly customizable Use Excel features for views, and DB2 Web Query add-in for pulling data from DB2 33 See video at: ibm.biz/db2webqueryi Take DB2 Web Query End User Demos link Meta Data: Providing the Foundation The difference between a GUI based query tool and Business Intelligences is a Meta Data Layer that allows you to: Document your database (which is probably not documented now) Standardize on the meaning of data in one place (single version of truth) Expand your community of report authors because they don t have to know the intricacies of the data or SQL Integrate DB2 functions, stored procedures, and view result sets into your reports (very powerful and flexible) Define relationships between tables/files, and between data elements to hide complexities of the database and provide advanced analytics like auto drill down capabilities (with no programming required) 34

18 With DB2 Web Query, Meta Data is Where You Start Standardize Field/Column Formats Ex, use commas, set currency symbol, suppress leading zeros Standardize/Decompose Date Fields Ex: Integer defined as MMDDYYYY Create Filters Ex: Define a set of countries as Europe Define JOINS and Dimensional Reporting Create Business Views Organize Columns/fields for easier report development Define Stored Procedures, Views, UDFs to Meta Data Layer for some REALLY COOL function. Examples: Text Search Leverage the web to bring in weather report, local news onto a dashboard Invoke existing RPG programs that return a result set The Power of Meta Data: Example We have a FIELD defined that has multiple sub-fields embedded Our report wants to show CREDIT RATING based on the value of that field, we want CREDIT RATING to be set to GOOD, BAD, or AVERAGE What we need to do is pull out the 10 th digit of that CUST_CODE field and apply a rule. BUT WE DON T WANT TO HAVE TO DO THIS FOR EVERY REPORT THAT INCLUDES CREDIT_RATING 10 character Cust_Code Credit Rating For credit rating >7 is Good, 4-6 is Average, <4 is Bad Customer Number Orders placed in last year

19 More Cool Stuff DB2 Web Query for i v2 Modernize Query/400 Reporting with Smarter Analytics for IBM i New Version 2 (Latest version is 2.2) New Product IDs (5733-WQe/WQs) New Core based pricing Only V2.2 available for 7.3, but also supports 7.1 and 7.2 Simpler Packaging Options Express Edition Entry level edition Report development Great for small, getting started environments Standard Edition Adds report distribution, integration APIs Adds Microsoft SQLServer Access Virtually unlimited runtime users support Optionally add JDEdwards Adapter Add User Licenses to either Edition

20 BI Portal Personal page: Dashboard with Drill downs and maps 39 The Easy Button: Wizard Analytics Included in Express or Standard Automates the building of meta data and xx number of standard reports xx will vary based on how many measurements and dimensions you have Two wizards Meta Data Wizard for DB2 tables/files Upload Wizard for importing Excel spreadsheets The wizards make assumptions about meta data based on looking at the data, but gives you a chance to alter that before creating Video demonstrations at ibm.co/db2wqwiki

21 Geographical Maps *Pre enabled territories are the only ones that are officially certified and QA d Choose Geographical Role of Location (ex: state)

22 Others Run Time Enablement Manage library lists dynamically at run time Migration Tools Simplified upgrades or moves from one system to another Enhanced scheduling functions Send with link to report placed in IFS Use DB2 table to source distribution list New Security Center GUI to manage users and their authorities Performance Many BI queries are summary in nature Show me revenue vs. forecast across these 3 product lines, these 2 regions, and the trend over the last 3 quarters. These kinds of queries against databases designed for transaction processing on systems tuned for transaction processing.can be problematic Data not in multidimensional formats Data in detail level, not summary Data transformation work is being done at report run time Data consolidation done at run time Data is point in time, not historical (usually) 44

23 DB2 Web Query DataMigrator New Product ID 5733-WQM Requires either DB2 Web Query Express or Standard Edition Standard Edition required for MS SQLServer as a data source DB2 Web Query Developer Workbench required to set up data and process flows ETL for IBM i Like DB2 Web Query, all server code and ETL objects are stored in IBM i Data sources support is based on DB2 Web Query adapters INTEGRATED with DB2 Web Query Use meta data created with DB2 Web Query or vice versa Same look and feel Shared services Why an ETL (Extraction, Transform, and Load) tool? Isolate Query workloads from Transaction workloads Different workloads require different tuning Leverage advanced DB2 for i query optimization and tuning techniques to boost performance without impacting transaction processing Consolidate data from multiple data sources 70% to 80% of a Business Intelligence (Analytics) project is in gathering data. This automates the gathering process from multiple data sources (including Excel spreadsheets) Prepare the data for analytics Transaction oriented databases are designed for short database operations (create, update, or delete a record). They are not designed for analytical queries and are less than optimal when used as the source for such queries. DataMigrator can create more optimal data models, such as star schemas Transform and cleanse the data to provide single version of the truth set of trusted, secured data

24 To Learn More DB2 Web Query for i Website Ibm.biz/db2webqueryi DB2 Web Query for i Wiki Ibm.co/db2wqwiki DB2 Web Query Getting Started Enablement: Demonstrations: Wizard Analytics: End User Demos: Getting Started Videos: Follow DB2 Web Query guy Doug Mack on twitter or check out his blog at for all the latest 47 COMING SOON: Two New Redbooks for Version 2.2 Current Version 2.1 Redbook contains over 14 chapters of Tutorials All will be updated New ones are being added New Nuts and Bolts Redbook Many more topics previously not covered or updated to cover new function

25 For Assistance: DB2 for i Lab Services Offerings DB2 Web Query Getting Started Service 3 Day skills transfer and workshops to build prototype Goes beyond tutorials with Best Practices and hand-holding Best way to ensure successful implementation Should include with EVERY DB2 Web Query proposal (proposal insert available) Query/400 Modernization Discovery, Analysis, and Conversion Addresses the question of how a customer can move from 100 s or 1000 s of Query/400 definitions to modernized environment that leverages DB2 query optimization! Out with the (very) OLD, in with the NEW improve performance, productivity, perception of IBM i, and move into analytics DB2 Web Query V1 to V2 Migration Service Remote assistance to help customers move to Version 2 While there exists migration tooling, migrations can become more complex depending on the customer s DB2 Web Query Environment - inexpensive service to hand hold the migration DB2 and SQL Performance Assessments Really critical assessment that should be conducted regularly by the customer But lack of DBAs in our i community means no one is paying attention to the database Assessment collects database (and system) performance data Recommendations made in report 49