Data Analysis and Integration

Transcription

1 MEIC 2015/2016 Data Analysis and Integration Lab 8: OLAP cubes and business analytics 1 st semester In this lab we will be using Pentaho Schema Workbench (PSW) to define an OLAP cube, and we will be using Saiku Community Edition to explore the data in that cube and to perform some OLAP operations. Downloading and starting Saiku 1. Download Saiku Community Edition from: 2. Unzip the downloaded file to a folder of your choice. (Suggestion: extract it to the same parent folder where you have placed PDI/data-integration.) 3. If you are running Windows, set the JAVA_HOME environment variable to point to the root folder of your JRE or JDK installation. IST/DEI Page 1 of 10

2 4. Open a Command Prompt (or Terminal) and navigate to the saiku-server folder. 5. In that folder, start Saiku with the appropriate command: On Windows, use start-saiku.bat On Mac OS X and Linux, use./start-saiku.sh 6. Open the Web browser (preferably Chrome) and navigate to: Note: Saiku runs in Apache Tomcat server. On the first run, it may take up to several minutes for Saiku to finish loading. 7. Proceed to the next steps while Saiku is loading Downloading and starting PSW 8. Download Pentaho Schema Workbench (PSW). At the time of this writing, the latest version is (released on ): The file to download is psw-ce zip. 9. Unzip the downloaded file to a folder of your choice. (Suggestion: extract it to the same parent folder where you have placed PDI/data-integration.) 10. We will be connecting PSW to the steelwheels database. For that purpose, we need the MySQL JDBC driver. Copy the MySQL.jar file from PDI (data-integration/lib/mysql-connector-java bin.jar) to PSW (schema-workbench/drivers). 11. If you are running Windows, edit the file schema-workbench/workbench.bat and replace -Xmx2048m by -Xmx1024m 12. Open a Command Prompt (or Terminal) and navigate to the schema-workbench folder. 13. In that folder, start PSW with the appropriate command: On Windows, use workbench.bat On Mac OS X and Linux, use./workbench.sh Configure the database connection in PSW 14. In PSW, go to the menu Options > Connection. The familiar Database Connection dialog will appear. IST/DEI Page 2 of 10

3 15. Configure the database connection as follows: Connection Name: steelwheels Connection Type: MySQL Access: Native (JDBC) Host Name: localhost Database Name: steelwheels User Name: steelwheels Password: steelwheels Press Test to test the connection. You should get the following message box: 16. Close the message box and the Database Connection dialog with OK. Exploring the database in PSW 17. Go to the menu option File > New > JDBC Explorer. 18. On the left pane, expand Default Schema. You will see the list of tables in the steelwheels database. 19. In this lab, we will be working mostly with the orderfact table. Expand this table to see its columns. 20. Take a moment to have a look at all the columns that orderfact contains. You should be able to guess what most of these columns contain. (Unfortunately, the functionality of JDBC Explorer is still very limited, so this this is all we can see right now.) 21. The orderfact table is at the center of a star schema that involves other tables, namely customers, products, and time. This is illustrated in the figure below, where: CUSTOMERNUMBER is a foreign key to customers PRODUCTCODE is a foreign key to products TIME_ID is a foreign key to time IST/DEI Page 3 of 10

4 22. Expand table customer in JDBC Explorer. You should remember this table from previous labs. 23. Expand table products in JDBC Explorer. Note that each product has a PRODUCTLINE and a PRODUCTVENDOR. Here is some sample data from that table (only 3 columns): PRODUCTNAME PRODUCTLINE PRODUCTVENDOR Harley Davidson Ultimate Chopper Motorcycles Min Lin Diecast 1952 Alpine Renault 1300 Classic Cars Classic Metal Creations 1996 Moto Guzzi 1100i Motorcycles Highway 66 Mini Classics 2003 Harley-Davidson Eagle Drag Bike Motorcycles Red Start Diecast 1972 Alfa Romeo GTA Classic Cars Motor City Art Classics 1962 LanciaA Delta 16V Classic Cars Second Gear Diecast 1968 Ford Mustang Classic Cars Autoart Studio Design 2001 Ferrari Enzo Classic Cars Second Gear Diecast 1958 Setra Bus Trucks and Buses Welly Diecast Productions 2002 Suzuki XREO Motorcycles Unimax Art Galleries 1969 Corvair Monza Classic Cars Welly Diecast Productions 1968 Dodge Charger Classic Cars Welly Diecast Productions 1969 Ford Falcon Classic Cars Second Gear Diecast 1970 Plymouth Hemi Cuda Classic Cars Studio M Art Models 1940 Ford Pickup Truck Trucks and Buses Studio M Art Models IST/DEI Page 4 of 10

5 24. Finally, expand table time in JDBC Explorer. Here is some sample data from that table: TIME_ID MONTH_ID QTR_ID YEAR_ID MONTH_NAME MONTH_DESC QTR_NAME QTR_DESC Jan January QTR1 Quarter Jan January QTR1 Quarter Jan January QTR1 Quarter Feb February QTR1 Quarter Feb February QTR1 Quarter Mar March QTR1 Quarter Mar March QTR1 Quarter Mar March QTR1 Quarter Mar March QTR1 Quarter Apr April QTR2 Quarter Apr April QTR2 Quarter Apr April QTR2 Quarter Apr April QTR2 Quarter Creating a new schema in PSW 25. In PSW, go to the menu option File > New > Schema. 26. You will be presented with the New Schema window. Before we proceed, remember these mechanics: On the left pane, we will be adding things by right-clicking with the mouse. On the right pane, we will be setting values by pressing Tab on the keyboard. IST/DEI Page 5 of 10

6 27. Click on the Schema node and set its name to steelwheels. Press Tab. 28. Right-click on Schema and select Add cube. Set name to Orders. Press Tab. 29. Right-click on Orders and select Add Table. In name select orderfact. (Always press Tab.) Creating the Customers dimension 30. Right-click on Orders and select Add Dimension. Set name to Customers In foreignkey select CUSTOMERNUMBER 31. Expand Customers to show New Hierarchy Right-click New Hierarchy 0 and select Add Table. In name select customers 33. Click on New Hierarchy 0 and set its attributes: Set name to Customer Hierarchy Set allmembername to All Customers In primarykey select CUSTOMERNUMBER 34. Right-click Customer Hierarchy and select Add Level. Set name to Country In column select COUNTRY In type select String Check uniquemembers In leveltype select Regular In hidememberif select Never 35. Right-click Customer Hierarchy and select Add Level. Set name to City In column select CITY In type select String Check uniquemembers In leveltype select Regular In hidememberif select Never 36. Right-click Customer Hierarchy and select Add Level. IST/DEI Page 6 of 10

7 Set name to Customer Name In column select CUSTOMERNAME In type select String Check uniquemembers In leveltype select Regular In hidememberif select Never Creating the Products dimension 37. Right-click on Orders and select Add Dimension. Set name to Products In foreignkey select PRODUCTCODE 38. Expand Products to show New Hierarchy Right-click New Hierarchy 0 and select Add Table. In name select products 40. Click on New Hierarchy 0 and set its attributes: Set name to Product Hierarchy Set allmembername to All Products In primarykey select PRODUCTCODE 41. Right-click Product Hierarchy and select Add Level. Set name to Product Line In column select PRODUCTLINE In type select String Check uniquemembers In leveltype select Regular In hidememberif select Never 42. Right-click Product Hierarchy and select Add Level. Set name to Product Vendor In column select PRODUCTVENDOR In type select String Check uniquemembers In leveltype select Regular In hidememberif select Never 43. Right-click Product Hierarchy and select Add Level. Set name to Product Name IST/DEI Page 7 of 10

8 In column select PRODUCTNAME In type select String Check uniquemembers In leveltype select Regular In hidememberif select Never Creating the Time dimension 44. Right-click on Orders and select Add Dimension. Set name to Time In foreignkey select TIME_ID In type select TimeDimension 45. Expand Time to show New Hierarchy Right-click New Hierarchy 0 and select Add Table. In name select time 47. Click on New Hierarchy 0 and set its attributes: Set name to Time Hierarchy Set allmembername to All Years In primarykey select TIME_ID 48. Right-click Time Hierarchy and select Add Level. Set name to Year In column select YEAR_ID In type select String Check uniquemembers In leveltype select TimeYears In hidememberif select Never 49. Right-click Time Hierarchy and select Add Level. Set name to Quarter In column select QTR_NAME In type select String Check uniquemembers In leveltype select TimeQuarters In hidememberif select Never 50. Right-click Time Hierarchy and select Add Level. Set name to Month IST/DEI Page 8 of 10

9 In column select MONTH_NAME In type select String Check uniquemembers In leveltype select TimeMonths In hidememberif select Never Creating the Sales and Quantity measures 51. Right-click on Orders and select Add Measure. Set name to Sales In aggregator select sum In column select TOTALPRICE Set formatstring to $#,###.00 In datatype select Numeric 52. Right-click on Orders and select Add Measure. Set name to Quantity In aggregator select sum In column select QUANTITYORDERED Set formatstring to #,### In datatype select Integer 53. Save your schema in a file called steelwheels.xml. Loading the schema into Saiku 54. Switch to the Web browser where you have Saiku open. You should see a login screen. Login with: Username: admin Password: admin 55. Click on the "A" button (Admin Console) at the top. 56. In the left pane, click on Add Schema. 57. Press on the Choose File button, and open your steelwheels.xml file. 58. In Schema Name write steelwheels and press the Upload button. You should see "Upload successful". 59. In the left pane, click on Add Data Source. IST/DEI Page 9 of 10

10 60. Configure the data source as follows: Name: steelwheels Connection Type: Mondrian URL: jdbc:mysql://localhost/steelwheels Schema: /datasources/steelwheels.xml Jdbc Driver: com.mysql.jdbc.driver Username: steelwheels Password: steelwheels 61. Press the Save button. Exploring the data in the cube 62. Click on the "+" button (New query) at the top. 63. Next to Cubes, click on the green button to Refresh Cubes (Clear Cache). 64. In Select a cube select the Orders cube from the steelwheels data source. 65. Expand the dimensions Customers, Products, and Time. 66. Drag the following elements from the left pane to the right pane: Drag Sales to Measures. Drag Country to Rows. You should see sales by country. 67. Drag Product Line to Columns. You should see sales by country and product line. 68. Drag City to Rows. You should see a drill-down of sales by country and city. 69. Drag Year to Columns. You should see sales city, product line, and year. 70. Drag Quantity to Measures. You should see both sales and quantity in each cell. IST/DEI Page 10 of 10