BigInsights and Cognos Stefan Hubertus, Principal Solution Specialist Cognos Wilfried Hoge, IT Architect Big Data 2013 IBM Corporation
A Big Data architecture evolves from a traditional BI architecture Simplified architecture of a traditional BI environment Intelligence Analysis Ingestion and Integration Integrated Exploration Decision Management BI and Predictive Analytics Data at Rest ETL, Quality, MDM Warehouse / Marts Navigation and Discovery Information Governance, Security and Business Continuity
Data Warehouse Augmentation with BigInsights Hadoop as queryable DWH archive Hadoop as DHW Landing Zone / to store unstructured data Explorative analysis with Hadoop Intelligence Analysis Data in Motion Ingestion and Integration Integrated Exploration Decision Management Data at Rest ETL, Quality, MDM Landing, Analytics and Archive Warehouse / Marts BI and Predictive Analytics Navigation and Discovery Data in Many Forms Hadoop MapReduce Information Governance, Security and Business Continuity
IBM Big Data Platform: Hadoop Integration Hadoop DWH Reporting Information Governance, Security and Business Continuity Cost-effectively analyze Petabytes of unstructured and structured data InfoSphere BigInsights enterprise-grade Hadoop advanced text analytics data visualization Web Console Spreadsheet interface Dashboards. System for Hadoop
Leverage skills you have to access data on Hadoop: Big SQL Application SQL Language JDBC / ODBC Driver JDBC / ODBC Server BigSQL Engine Data Sources Hive Tables HBase Tables CSV Files SQL support opens the data to a much wider audience Familiar, widely known syntax Clear separation of defining the what (you want) vs. the how (to get it) Big SQL fully integrates with SQL applications and BI tooling with benefits including: Big SQL brings robust SQL support to the Hadoop ecosystem Comprehensive SQL '92+ support Standards compliant client drivers (JDBC & ODBC) Nested subquery support Windowed aggregates Standard join syntax, ansi join syntax, cross join and non-equijoin support Wide variety of data sources and file formats Applications do not have to compensate for constraints of Hive QL which may result in: more statements potentially moving more data over the network to the application BigInsights
Demo BigInsights 6
Establish the data source connection in IBM Cognos 10 Make the Big SQL client drivers available to the IBM Cognos BI server The required client drivers can be downloaded through a URL exposed on a BigInsights server The version of the client drivers have to be the same that is shipped with the server it will be connecting to 7
Establish the data source connection in IBM Cognos 10 Extract the big-sql-client-kit.zip file There is a JDBC and an ODBC client driver for Big SQL We use the JDBC driver (bigsql-jdbc-driver.jar) for IBM Cognos 10 8
Establish the data source connection in IBM Cognos 10 Copy the file bigsql-jdbc-driver.jar into the following locations of each IBM Cognos 10 install that will be connecting to the BigInsights server: <c10_location>\webapps\p2pd\web-inf\lib <c10_location>\v5dataserver\lib Stop and restart the IBM Cognos service 9
Define the data source connection in IBM Cognos 10 After making the Big SQL client driver available to the IBM Cognos 10 server, a new data source must be created in IBM Cognos Administration Select JDBC as connection Type IBM InfoSphere BigInsights (Big SQL) entry in the Type field must be selected 10
Define the data source connection in IBM Cognos 10 Enter the BigInsights Big SQL URI into the JDBC URL field in the format of jdbc:bigsql://<host>:<port>/<dbname> 11
Metadata modelling Standard guidelines documented in the IBM Cognos Framework Manager user guide are applicable for modeling the metadata from the BigInsights' Big SQL Catalog After data source query subjects are created following a metadata import of the Big SQL Catalog, relationships and determinants must be defined 12
Demo IBM Cognos 10 13
Thank You! 2013 IBM Corporation