OnCommand Insight 6.3 Data Warehouse Custom Report Hands-on Lab Guide

OnCommand Insight 6.3 Data Warehouse Custom Report Hands-on Lab Guide How to easily create adhoc and multi-tenancy reports in OnCommand Insight DWH using Business Insight Advanced Dave Collins, Technical Marketing Engineer October 2012

Table of Contents Overview of this Lab... 3 Example 1: Raw Capacity by Data Center (table)... 4 Steps to create this report... 4 Example 2: Raw Capacity by Data Center (Chart)... 6 Steps to create this report... 6 Example 3: Raw Capacity Utilization by Data Center (table with conditional)... 8 Steps to create this report... 8 Example 4: Raw Capacity by Manufacturer (table drillable)... 15 Steps to create this report... 15 Example 5: Raw Capacity Trend (chart with history)... 17 Steps to create this report... 18 Example 6: Custom Chargeback or Showback Report by Business Entity and Application including variable cost of VM based on configuration, fixed Overhead and Storage usage... 20 Steps to create this report... 20 Adding variable costs per VM to your chargeback report.... 25 Adding Fixed Overhead costs to your chargeback report.... 29 Formatting and Grouping the report by Application and Tenant... 31 CLEANING up the report and running it.... 32 [Type text] Page 2

Overview of this Lab This Lab is designed to show you how to create chart, drilldown tables, trending and chargeback reports using OnCommand Insight Business Insight Advanced. The reports center on multi-tenancy and multi departmental business elements and applications. You will learn structure of the OnCommand Insight Data Warehouse which provides the basis of where to get your data for creating reports with the data elements you want. Using the Hands-on lab and videos, you ll experience how to easily create simple or complex custom reports that include tables, charts and other report elements by using simple drag and drop technology without knowing SQL. You will be able to create an array of reports from simple tables and charts, to complex trending reports and dashboards. Additionally, we have added a single report lab under example 6 that will enable you to see how easy it is to create a complex showback/chargeback report using actual usage and configuration variables from VM to Storage. Reports: 1. Example 1: Raw Capacity By Datacenter (table) 2. Example 2: Raw Capacity By Datacenter (add chart to first example) 3. Example 3: Raw Capacity Utilization by Datacenter 4. Example 4: Raw Capacity By Manufacturer (drillable) 5. Example 5: Raw Capacity Trend 6. Example 6: Multi-tenancy Showback and Chargeback report including cost of VM and Overhead [Type text] Page 3

Example 1: Raw Capacity by Data Center (table) This report is designed to show you how to create a basic table report using OnCommand Insight Business Insight Advanced. This report is created using the "Storage and Storage Pool Capacity" data model. This report shows the distribution of raw capacity by data center. Steps to create this report Watch a video on how to create this report Note: You may need a user name and password for this community. To obtain them, click the Become a Member link. 1. OnCommand Insight Reporting Portal is accessed through http://<reporting-server>:8080/reporting 2. Enter User name and Password credentials. (default is admin/admin123) 3. From the Welcome page, select My home. 4. From the Launch menu (at the top right corner of the OnCommand Insight Reporting portal), select Business Insight Advanced. 5. From the list of all packages that appears, click on the Capacity <version> folder and then click on Storage and Storage Pool Capacity <version>. 6. In the Business Insight Advanced landing page, click on Create new. 7. From the pre-defined report layouts New pop-up, choose List and click OK. 8. In the right pane, select the Source tab and expand Physical Capacity from the Storage and Storage Pool Capacity package. 9. Expand Data Center. Drag Data Center and drop it on the list. 10. Expand Capacity (TB). Drag Raw Capacity (TB) and place it on the report work area to the right of the Data Center column. [Type text] Page 4

11. Click Save and save the report in the Customer Reports folder. [Type text] Page 5

Example 2: Raw Capacity by Data Center (Chart) This report is created from the "Storage and Storage Pool Capacity data model. This report shows the distribution of raw capacity by data center. In this example, you will add a pie chart to the list report created in Example 1. Elements used: Data Center: The annotation associated with the storage device in the Insight Client. Raw Capacity: The sum of the disks physical capacities. Pie Chart shows the graphical representation of the list. Steps to create this report Watch a video on how to create this report Note: You need a user name and password for this community. To obtain them, click the Become a Member link. 1. Use the existing report from Example 1 or follow the steps from Example 1 on how to create the List report. 2. To create page layout to have both the List and Chart, select the Page Layout dropdown and choose the two column layout. You will see the page reformat into two columns. [Type text] Page 6

3. In the right pane, select the Toolbox tab. Select Chart and place it over the right column work area of the report. 4. From the Insert Chart dialog box, select Pie, Donut, (use the first pie chart selected by default) and click OK. 5. In the right pane, select the Source tab; expand Physical Capacity from the Storage and Storage Pool Capacity package. 6. From the Physical Capacity folder, expand Capacity (TB). Drag Raw Capacity (TB) and place it on the Default Measure section of the chart. 7. From the Physical Capacity folder, drag Data Center and place it on the Series (pie-slices) section of the chart. 8. Click Save and save the report in the Customer Reports folder. [Type text] Page 7

Example 3: Raw Capacity Utilization by Data Center (table with conditional) This report is created from the "Storage and Storage Pool Capacity data model. This report shows the utilization of raw capacity by data center. It highlights the exceptional data, so the utilization (%) with more than 50% is highlighted with red. Data Center: The annotation associated with the storage device in the Insight Client. Raw Capacity: The sum of the disks physical capacities. Used Raw Capacity: Raw capacity used by the storage. Unused Raw Capacity: Raw capacity spare or failed and that is not included in any volume or thin provisioned storage pool. Utilization: Total amount of Used Raw capacity by Raw Capacity. Steps to create this report Watch a video on how to create this report Note: You need a user name and password for this community. To obtain them, click the Become a Member link. 1. OnCommand Insight Reporting Portal is accessed through http://<reporting-server>:8080/reporting 2. Enter User name and Password credentials. 3. From the Welcome page, select My home. 4. From the Launch menu (at the top right corner of the OnCommand Insight Reporting portal), select Business Insight Advanced. 5. From the list of all packages that appears, click the Capacity <version> folder and then click on Storage and Storage Pool Capacity <version>. 6. Create a new report by selecting New from the dropdown in the upper left corner or Create New if you are on the Business Insight Advanced landing page. 7. From the pre-defined report layouts New pop-up, choose List and click OK. 8. In the right pane, select the Source tab; expand Physical Capacity from the Storage and Storage Pool Capacity package. 9. From the Physical Capacity folder, drag Data Center and place it on the work area of the report. [Type text] Page 8

10. Expand Capacity (TB). Drag Raw Capacity (TB) and place it on the report work area to the right of the Data Center column. 11. From Capacity (TB), drag Used Raw Capacity (TB) and place it on the report work area to the right of the Raw Capacity (TB) column. 12. From Capacity (TB), drag Unused Raw Capacity (TB) and place it on the report work area to the right of the Used Raw Capacity (TB) column. 13. To create the Data Item Utilization (%), do the following: a. In the right pane, select the Toolbox tab. Double-click on Query Calculation. [Type text] Page 9

b. From the Create calculation dialog, in the Name section, type Utilization (%). Then select Other Expression and click OK. c. From the left pane of the Data Item Expression window, select the Data Items tab. d. In the Data Items tab, from the Available components, drag into the Expression Definition pane first Used Raw Capacity (TB), then type "/" (i.e. divided by) and drag Raw Capacity (TB). Click OK e. Data Item Utilization (%) will be placed in the report work area to the right of the Unused Raw Capacity (TB) column. f. Right click on the column body Utilization (%), select Show Properties and set the following property. Data Format > Select Format Type: Percent. Click OK. 14. To highlight exceptional data in the report, do the following: a. Right click on Utilization (%) in the list report. From the Style menu, click on Conditional Styles. b. Click on the New Conditional Style icon, click on New Conditional Style. [Type text] Page 10

c. Data Item Utilization (%) will be selected automatically and the Type of conditional style as Numeric Range. Click OK. d. Click on New Value icon at the bottom left below Missing values. e. From the Threshold-Value dialog, enter the value 0 for lowest value. Click OK. [Type text] Page 11

f. Again click on New Value icon and in the Threshold-Value dialog enter the value 0.50 for highest value of Utilization (%). Click OK. g. In the Style section, click on the style icon on the right and associate red color. h. From the Style page to choose the color, click Background color, select the color Red and click OK. i. In the Name section of the Conditional Style - Numeric Range dialog, type Utilization Conditional Style. Click OK. [Type text] Page 12

16. Click Save and save the report in the Customer Reports folder. Now run the report using the Run Report HTML ICON at the top of the edit line so you can see the conditional column color as shown below. [Type text] Page 13

[Type text] Page 14

Example 4: Raw Capacity by Manufacturer (table drillable) This report is designed to show you how to create a report with drill down capabilities using OnCommand Insight Business Insight Advanced. This report is created from the "Storage and Storage Pool Capacity" data model. This report shows the distribution of raw capacity by manufacturer. Manufacturer: Manufacturer of the Storage Array. Raw Capacity: The sum of the disks physical capacities. Used Raw Capacity: Raw capacity used by the storage. Steps to create this report Watch a video on how to create this report Note: You need a user name and password for this community. To obtain them, click the Become a Member link. 1. OnCommand Insight Reporting Portal is accessed through http://<reporting-server>:8080/reporting 2. Enter User name and Password credentials. 3. From the Welcome page, select My home. 4. From the Launch menu (at the top right corner of the OnCommand Insight Reporting portal), select Business Insight Advanced. 5. From the list of all packages that appears, click on the Capacity <version> folder and then click on Storage and Storage Pool Capacity <version>. 6. Create a new report by selecting New from the dropdown in the upper left corner or Create New if you are on the Business Insight Advanced landing page. 7. From the pre-defined report layouts New pop-up, choose List and click OK. 8. In the right pane, select the Source tab and expand Physical Capacity from the Storage and Storage Pool Capacity package. 9. From the Physical Capacity folder, expand Storage and drag Manufacturer and place it on the report work area. [Type text] Page 15

10. From Capacity (TB), drag Raw Capacity (TB) and place it on the report work area to the right of the Manufacturer column. 11. From Capacity (TB), drag Used Raw Capacity (TB) and place it on the report work area to the right of the Raw Capacity (TB) column. 12. To enable drill behavior for the Manufacturer column, do the following: a. From the Data menu, click Drill Options. b. In the Drill Options dialog box, enable the Allow drill-up and drill-down check box. Click OK. 13. Drill-Up/ Drill-Down link will be enabled on the Manufacturer column in the reports. To validate perform the following: a. Click the Run Button in the center of the top menu to run the report b. Notice the links under the manufacture column c. Select the link to drill down d. Right click to drill up 14. Sequence of Drill-Down from the Manufacturer level is shown below by clicking on the links in that column: [Type text] Page 16

This will move the levels down in the Storage hierarchy. 15. At Storage Pool level, right click and click on Drill-Up. This will move the levels up in Storage hierarchy. 16. Click Save to save the report in the Customer Reports folder. Example 5: Raw Capacity Trend (chart with history) This report is created from the "Storage and Storage Pool Capacity data model. This report shows the raw capacity trend. Manufacturer: Manufacturer of the Storage Array. Raw Capacity: The sum of the disks physical capacities. Used Raw Capacity: Raw capacity used by the storage. [Type text] Page 17

Steps to create this report Watch a video on how to create this report Note: You need a user name and password for this community. To obtain them, click the Become a Member link. 1. OnCommand Insight Reporting Portal is accessed through http://<reporting-server>:8080/reporting 2. Enter User name and Password credentials. 3. From the Welcome page, select My home. 4. From the Launch menu (at the top right corner of the OnCommand Insight Reporting portal), select Business Insight Advanced. 5. From the list of all packages that appears, click on the Capacity <version> folder and then click Storage and Storage Pool Capacity <version> 6. Create a new report by selecting New from the dropdown in the upper left corner or Create New if you are on the Business Insight Advanced landing page. 7. From the pre-defined report layouts New pop-up, choose Chart. From the Insert Chart dialog box, select Line (use the first line chart selected by default) and click OK 8. To create page layout to have both the Chart and List, in the right pane, select the Toolbox tab, double click Table and set the Table size. Number of columns= 1, Number of rows= 2. Click OK. 9. Drag the Line Chart into the first row of the table cell. 10. In the right pane, select the Source tab and expand Physical Capacity from the Storage and Storage Pool Capacity package. 11. From Physical Capacity, expand Date and drag Quarter and place it on the Categories (x-axis) section of the chart. 12. From Capacity (TB), drag Raw Capacity (TB) and place it on the Series (primary-axis) section of the chart. 13. From Capacity (TB), drag Used Raw Capacity (TB) and place it on the Series (primary-axis) section of the chart to the right of the Raw Capacity (TB) column. [Type text] Page 18

14. In the right pane, select the Toolbox tab, select List and place it on the report work area in the second row of the table cell. 15. In the right pane, select the Source tab, from Physical Capacity, expand Date, drag Quarter and place it on the list. 16. From Physical Capacity, expand Storage, drag Manufacturer and place it on the report work area to the right of the Quarter column. 17. From Capacity (TB), drag Raw Capacity (TB) and place it on the report work area to the right of the Manufacturer column. 18. From Capacity (TB), drag Used Raw Capacity (TB) and place it on the report work area to the right of the Raw Capacity (TB) column. 19. Multi-select Quarter and Manufacturer columns from the list, from the Structure menu, click on Group/Ungroup. 20. Click Save to save the report in the Customer Reports folder. [Type text] Page 19

Example 6: Custom Chargeback or Showback Report by Business Entity and Application including variable cost of VM based on configuration, fixed Overhead and Storage usage Steps to create this report Watch a video on how to create this report Note: You need a user name and password for this community. To obtain them, click the Become a Member link. 1. OnCommand Insight Reporting Portal is accessed through http://<reporting-server>:8080/reporting 2. Enter User name and Password credentials. 3. From the Welcome page, select My home. 4. From the Launch menu (at the top right corner of the OnCommand Insight Reporting portal), select Business Insight Advanced. 5. From the list of all packages that appears, click on the Capacity <version> folder and then click on VM Capacity <version>. 6. Create a new report by selecting New from the dropdown in the upper left corner or Create New if you are on the Business Insight Advanced landing page. [Type text] Page 20

7. From the pre-defined report layouts New pop-up, choose List and click OK. 8. In the lower right pane, select the Source tab and expand Advanced Data Mart from the VM Capacity package. 9. From the Advanced Data Mart, expand Business Entity Hierarchy and Business Entity and drag Tenant and place it on the report work area. 10. Collapse Advanced Data Mart and expand Simple Data Mart 11. From Simple Data Mart, drag Application and place it on the report work area to the right of the Tenant column. (TIP. Make sure you place it on the blinking gray BAR on the right of the previous column or it will give you an error) Now we are going to drag multiple columns to the palate to save time building the report. 12. We will be reporting on the total # of processors (cores) and the memory that is configured for each VM. So, let s grab the following elements from the VM Dimension under the Advanced Data Mart: 13. From Advanced Data Mart, expand VM Dimension Select the next columns IN THE FOLLOWING ORDER. 14. From Advanced Data Mart>VM Dimension, hold the control key and select the following columns (in order): a. VM Name b. Processors c. Memory 15. Click and Drag VM Name and place it on the report work area to the right of the Application column. NOTE: All the columns should follow in the order you selected them similar to screenshot below. (your data will differ but columns will be the same) [Type text] Page 21

Now let s bring Capacity information onto the report. 16. From Simple Data Mart, hold the control key and select the following columns (in order): a. Tier b. Tier Cost c. Provisioned Capacity (GB) 17. Click and Drag Tier column and place it on the report work area to the right of the Application column. NOTE: All the columns should follow in the order you selected them similar to screenshot below. (your data will differ but columns will be the same) 18. To create a summary of cost per GB, hold the control key and select Tier Cost and Provisioned Capacity (GB) 19. Then Right Click the Provisioned Capacity Column and select Calculate and select the multiplication calculation. [Type text] Page 22

Business Insight Advanced has created a new column for you, completed the calculations and put it in the report. Next let s format and re-title the column name. 20. Right click on the new column head and select Show Properties 21. In the lower Right corner, scroll down to the bottom of the properties box and select the ellipsis on the Data item name box. Change the name to Storage Cost and click OK. 22. Note the column heading is now Storage Cost. 23. Now select one of the numeric values in that column and select Data Format ellipsis from the properties box in the lower right corner. [Type text] Page 23

24. From the Data Format dialog box select currency from the Format type dropdown. As you see from the Properties dialog box there are lots of options you can set to format the currency numbers in this column. The default is USD so let s just click OK to set the default. You will see the column reformat to USD. Here is our current report. Let s filter out storage that is NOT being charged. 25. Select any BLANK cell in the Tier Cost Column and click on the filter ICON in the top toolbar. 26. Select Exclude Null [Type text] Page 24

Here is our current report. Notice all the cells that had NO cost associated with those tiers are deleted leaving you with only the storage that has charges associated with it. (TIP: in another report, you can actually reverse the logic and show only storage that is NOT being charged as well ) You can also format the Tier Cost column with USD currency as well if you want. OK, that was easy, but not complete. Let s add other cost factors into your chargeback report for cost of VM Service Levels by configuration and fixed overhead costs used by each application. Adding variable costs per VM to your chargeback report. Let s say the customer wants to charge per VM based on the # of CPUs and Memory it s configured with. To do that, we need to first create a VM Service Level comprised of the # of CPUs and Memory configured for each VM. Then allocate cost per Service Level. To create a VM Service Level, we are going to drop in a small conditional expression to build the Service Levels per VM. This is an easy example of the flexibility of Business Insight Advanced in creating reports. (DON T panic, you can skip the conditional expression and just put a fixed cost on each VM if you want. See the Overhead example later on but humor me here in this lab.) 1. Select the Tier Column to place where we want to insert the new columns. 2. Select Toolbox tab at lower right corner and double click the Query Calculation ICON. 3. In the Create Calculation Dialog box name the column VM Service Level and select Other Expression and click OK [Type text] Page 25

4. In the Data Item Expression dialog box, copy and paste the following VM Service Level conditional expression into the Expression Definition box and select OK Note1: If you are remoted into the OnCommand Insight server, you may have to create a text document on the OnCommand Server desktop to cut and paste this into, prior to pasting it into the Expression box!) Note 2: If you cannot get the syntax correct with this cut and paste, then download the SQLExpressions.txt file from the community and cut and paste from it. (PDF sometimes messes with the characters.) Below is an example of the conditional expression that gives you the if-else condition for VM Service Level IF([Processors] = 2 AND [Memory] < 2049) THEN ('Bronze') ELSE (IF([Processors] = 2 AND [Memory] < 4097) THEN ('Bronze_Platinum') ELSE IF([Processors] = 4 AND [Memory] < 8193) THEN ('Silver') ELSE IF([Processors] = 4 AND [Memory] > 8193) THEN ('Silver_Platinum') ELSE IF([Processors] = 6 AND [Memory] > 8191) THEN ('Gold') ELSE IF([Processors] = 8 AND [Memory] > 16383) THEN ('Gold_Platinum') ELSE ('tbd')) [Type text] Page 26

5. Business Insight Advanced will validate the conditional expression (nice to know if you got it right) and create the column called VM Service Level and populate it based on the query. (If you get an error, your Conditional expression probably has a syntax or other error) 6. You will see a new column added called VM Service Level with the various Service Levels for each VM based on the # of CPU s and memory each has. (At this point there may be duplicates in the list but not to worry. We are not finished formatting or grouping the report). Next, let s add a column that calculates the cost per VM based on Service levels we just established. 7. Select Toolbox tab at lower right corner and double click the Query Calculation ICON. 8. In the Create Calculation Dialog box name the column Cost Per VM and select Other Expression and click OK In the Data Item Expression dialog box, cut and paste the conditional expression for Cost of VM (below) in the Expression Definition box and select OK Example of conditional expression for Cost per VM IF([VM Service Level] = 'Bronze') THEN (10) [Type text] Page 27

ELSE(IF([VM Service Level] = 'Bronze_Platinum') THEN (15) ELSE IF([VM Service Level] = 'Silver') THEN (20) ELSE IF([VM Service Level] = 'Silver_Platinum') THEN (25) ELSE IF([VM Service Level] = 'Gold') THEN (40) ELSE IF([VM Service Level] = 'Gold_Platinum') THEN (55) ELSE (30)) 9. You will see a new column added called Cost Per VM with variable costs for each VM based on the Service Level. 10. Next format the data in the Cost per VM column to USD currency as you did above. [Type text] Page 28

Adding Fixed Overhead costs to your chargeback report. Let s say the customer has determined that the total cost for Overhead (including items like heat/ac, Floor space, Power, Rent, Operations personnel, helpdesk, etc.) is $24. Per VM. Let s create a column called Cost of Overhead and apply this fixed cost. (note: you can do this for any fixed costs rather than use SQL as well..) 1. Select Toolbox tab at lower right corner and double click the Query Calculation ICON above. 2. In the Create Calculation Dialog box name the column Cost of Overhead and select Other Expression and click OK 3. In the Data Item Expression dialog box, enter a cost of 24 in the Expression Definition box and select OK 4. You will see a new column added called Cost of Overhead with 24 for each VM. (Note: at this point there may be duplicates in the list but not to worry. We are not finished formatting or grouping the report). 5. Next format the data in the Cost of Overhead column to USD currency as you did above. Then drag the column header and drop it to the right of the Storage Cost column as shown below. [Type text] Page 29

Subtotaling, naming and saving the report Now that we have a cost per VM, overhead and the cost per storage usage by Tenant, Application and VM, let s sum the total costs and finish formatting the report by Tenant and Application. 1. Hold the control key down and select a numeric cell in the Cost per VM, Storage Costs and Cost of Overhead columns. Right click one of the numeric cells and select Calculate and the add function for the three columns. This will create a new column called Cost per VM+ Storage Costs + Cost of Overhead and calculate each row. 2. Now format the column for USD currency, and retitle the column to Total Cost of Services 3. Name the report Total Storage, VM and Overhead Cost by Tenant and Application Chargeback (Showback) by double clicking the title area. [Type text] Page 30

4. Now save it to the Customer Report folder using the same name. Formatting and Grouping the report by Application and Tenant We are not done yet. Now we need to format the report by grouping, subtotaling and totaling by tenant and application. 5. Hold the control key down and select Cost per VM, Provisioned Capacity, Storage Costs, Cost of Overhead and Total Cost of Service columns 6. Select the Total ICON from the Summary dropdown ICON [Type text] Page 31

7. If you Page down to the bottom of the report you will see total columns. We ll clean up the summary Rows in a minute. Let s Group the report by Tenant and Application 8. Hold the control key down and select Tenant and Application columns 9. Select the Grouping ICON from the top toolbar. CLEANING up the report and running it. 10. To Clean up the report right click and delete the Summary ROWS. (not columns) [Type text] Page 32

11. Then Go to the bottom of the report, hold control key and select both Summary Rows and right click and delete them. (Leave the TOTAL rows) 12. Save the report. Now let s run the report to see how it looks: 13. Select the Run ICON from the toolbar and run the report as HTML. (note the formats you can run it in if you want ) The report will show like this in its final format. I ve paged down in the report below to show you subtotals and you can page to the bottom and see the totals by Company and Total of all resources charged. 14. These reports are extremely flexible to do what you need. Notice the drill down link in the Tenant column (pictured above in the red circle). If you click on the LINK you will drill down from Tenant to Line of Business then to Business Unit, etc. If you Right Click on the link you can drill up as well. You can now schedule this report to run and distribute in various formats like any other OnCommand Insight Data Warehouse report [Type text] Page 33

Remember, now that you have created this report, every time you run it will provide the latest in usability information. You can automate this report by scheduling it to run and email to recipients etc. Lots of flexibility CONGRATULATIONS!!! YOU COMPLETED THIS HANDS-ON-LAB. Feedback is welcome to davec@netapp.com [Type text] Page 34