Copyright 2013, Oracle and/or its affiliates. All rights reserved.

Transcription

1 1

2 CON9330 Oracle BI Publisher Best Practices: Be a Reporting Super Star Kevin McDermott Senior Principal Technical Support Engineer Nicholas Mann Senior Consultant, Peleton Group

3 THE FOLLOWING IS INTENDED TO OUTLINE OUR GENERAL PRODUCT DIRECTION. IT IS INTENDED FOR INFORMATION PURPOSES ONLY, AND MAY NOT BE INCORPORATED INTO ANY CONTRACT. IT IS NOT A COMMITMENT TO DELIVER ANY MATERIAL, CODE, OR FUNCTIONALITY, AND SHOULD NOT BE RELIED UPON IN MAKING PURCHASING DECISIONS. THE DEVELOPMENT, RELEASE, AND TIMING OF ANY FEATURES OR FUNCTIONALITY DESCRIBED FOR ORACLE'S PRODUCTS REMAINS AT THE SOLE DISCRETION OF ORACLE. 3

4 Program Agenda Oracle BI Publisher Enterprise Overview Deployment & System Requirements Report Design Best Practices Data Modeling & Template Design Guidelines BI Publisher & OBIEE Integration Best Practices Q & A 4

5 Oracle Business Intelligence Publisher Eliminates multiple-point solutions, Lowers TCO Invoices Checks One Environment Author Generate Deliver Benefits Eliminate complexity Simplify report development & maintenance Reduce costs Destinations Labels XML / EFT / EDI Reports 5

6 Oracle Business Intelligence Publisher Provides an end-to-end solution, from data to documents to delivery Interactive PDF HTML Layout Template Types Layout Editor MS Word MS Excel Adobe Flex XSL Layout Design Tools XSL Excel PPT Flash RTF CSV XML Printer Fax Repository OBI EE Semantic Layer EDI EFT e-commerce 6

7 Oracle Business Intelligence Publisher Enterprise class reporting application for all your document needs 7

8 Program Agenda Oracle BI Publisher Enterprise Overview Deployment & System Requirements Report Design Best Practices Data Modeling & Template Design Guidelines BI Publisher & OBIEE Integration Best Practices Q & A 8

9 Installation & System Requirements Installation requirements Oracle Fusion Middleware Installation Guide for Oracle Business Intelligence 11g Release 1 (11.1.1) JDK requirements Refer to the certification matrix for supported JDK versions for specific operating systems. There is one for and one for

10 Sizing Guidelines How Many servers? Concurrent Use Case Users viewing reports online Scheduled Jobs running at the same time Factors to consider Number of users viewing Small, Medium, Large, XLarge reports Number of CPUs /server Bursting Use Case Bursting reports Factors to consider Total Number of reports Time window % of Small, Medium, Large reports Number of CPUs/Server 10

11 Sizing Guidelines My Oracle Support Note

12 Enterprise Deployment Options Oracle BI Publisher Single Instance Architecture Oracle Fusion Middleware High Availability Guide 11g Release 1 (11.1.1) High Availability for Oracle Business Intelligence Publisher 12

13 Enterprise Deployment Options Oracle BI Publisher 11g High Availability Architecture Oracle Fusion Middleware High Availability Guide 11g Release 1 (11.1.1) High Availability for Oracle Business Intelligence Publisher Oracle BI Publisher supports an active-active high availability configuration. Each node acts as an independent server that shares a common repository and the scheduler database with the other Oracle BI Publisher nodes. 13

14 Enterprise Deployment Options Oracle BI 11g High Availability Architecture Oracle Fusion Middleware High Availability Guide 11g Release 1 (11.1.1) Configuring High Availability for Oracle Business Intelligence and EPM 14

15 Oracle BI Publisher 11g Scheduler Client Client Web server BI Publisher Web server BI Publisher Web server/jms Provider (Web Logic, Active MQ) Job Q Report Q FAX Q. Printer Q. Q. FTP Q. Fax Printer BIP System Topic WebDav Q. Repository JMS Resources File Q. File system BI Publisher Reports Repository Scheduler database 15

16 Program Agenda Oracle BI Publisher Enterprise Overview Deployment & System Requirements Report Design Best Practices Data Modeling & Template Design Guidelines BI Publisher & OBIEE Integration Best Practices Q & A 16

17 Oracle Business Intelligence Publisher Report Architecture Separate data logic, layout & translation benefits greater flexibility and reuse fewer reports and better report maintenance optimize data extraction and document generation process Data Logic Layout Translation BI Publisher Report output 17

18 Data Generation Data Sources Data Source Types File (XML) SQL Query MDX Query LDAP Query (11g only) Excel Spreadsheet (11g only) Endeca Query (11g only) CSV (11g only) View Object (11g only) HTTP (XML Feed) Web Service Oracle BI Analysis Oracle BI Discoverer (10g only) Data Template (10g only) 18

19 Data Generation Connection Types JDBC Vs JNDI (SQL Type) Both types of connection use the same JDBC driver With JNDI you can take advantage of connection pooling Better performance Connection already established to the source Best practice for reports with many parameters with SQL type LOVs attached to them Better RDBMS resource management BI Publisher 2 1 WebLogic Server 19

20 Data Generation Scalable Mode Enable for large reports Slower performance, but prevents out-of-memory errors Use with scheduled reports 20

21 Data Generation Enabling Scalable Mode for Data Engine (10g) Set scalable mode property to on in Data Template <properties> <property name="scalable_mode" value="on" /> </properties 21

22 Data Model Design Objectives Optimize data extraction Simplify layout design for report developers Reduce document generation time 22

23 Data Model Design Data Extraction Leverage back-end system resources (whenever possible) Join data Filter & group data Perform expensive calculations & data transformations Sort data Select t."office_dsc" as "Office" sum(f."revenue") as Sales Sum" From "BISAMPLE"."SAMP_REVENUE_F f "BISAMPLE"."SAMP_OFFICES_D t Where t."office_key"=f."office_key" group by t."office_dsc" 20 Vs 20,000 records 23

24 Data Model Design Data Extraction Parameters & LOVs Cache LOVS for better performance For large LOVs, pass NULL to the parameter when users select All & modify WHERE clause in Data Set query to use the NVL function. For example: Where order_id=nvl(:p_ordid, order_id) 24

25 Data Model Design Data Extraction Event triggers Before Data Triggers Generate dynamic SQL Populate TEMP tables Set user context After Data Triggers Insert rows to a target table Send notifications Clean or delete TEMP tables Select EMPLOYEE_ID, DEPARTMENT_ID, FIRST_NAME, LAST_NAME, , PHONE_NUMBER, HIRE_DATE, JOB_ID, SALARY from employees where &p_where_clause 25

26 Event Driven Jobs (11g Only) Enable users to set up flexible, conditional execution of scheduled jobs. Data Model Designer creates Data Model with schedule trigger Triggers can be created and shared from a single data model Users create scheduled jobs and determine window of time to check for condition Reports execute when condition is true or are skipped VALUE: Users can schedule reports to execute based on an event or condition over a window of time. 26

27 Data Model Design Best Practices for Faster Document Generation Structure data to match how data is displayed in the report Use short XML tag names they reduce the size of XML data file Use display names to simplify template design Create global & group-level aggregate functions for best performance, create them in data model instead of report layout Pre-sort data (preferably at the source) Note: Grouping data in data model automatically sorts data by the grouping element Bursting It also requires that data in the XML is sorted (or grouped) by the split-by key. 27

28 Template Design Guidelines Objectives Choose the right type of template Follow BI Publisher (XPT) template design best practices Do not overcomplicate RTF templates 28

29 Document Formatting and Layout What Template Type should I use? (1 of 2) BI Publisher Template 11g RTF Templates PDF Forms Web based Layout Editor no client installation required Best for Management Report WYSIWIG experience Support Interactive Output Wide range of output (PDF, HTML, Excel, PPT, RTF, MHTML) Easy to create w/ BI Publisher Template Builder Add-in to Word Greatest flexibility and functionality for highly formatted reports RTF marked up with XSL code or BI Publisher simplified XSL Wide range of output (PDF, HTML, Excel, PPT, RTF, MHTML) PDF forms with XML elements mapped to form fields. Great to use with government forms PDF output only Create in Acrobat Professional 29

30 Document Formatting and Layout What Template Type should I use? (2 of 2) Excel Templates e-text Templates Flash Templates XSL Style Sheets Excel Analyzer Templates Excel w/ data mapped to named cells & Excel and XSL formatting Great for formatted, true Excel output and burst over sheets Excel XLS output only Text output only for electronic communication Great for character delimited or fixed position docs (EFT & EDI) RTF with table of statements to place fields and separators SWF files with BI Publisher data for sophisticated interactivity Create in Adobe Flex Builder Allows for third party tools and legacy solutions Not recommended (deprecated) Excel output only. Can refresh data w/ parameters. 30

31 BI Publisher Template Best Practices Design Consideration Use Layout Grids to position components similar to tables in RTF Templates Layout Grids can be nested Layout Grid Cell can be joined The minimum height of rows can be fixed DO NOT put LARGE tables or pivot tables into Layout Grids (Performance!) 31

32 BI Publisher Template Best Practices Design Consideration The Interactive Viewer is one of BI Publisher s most promising new features Interactivity works best for flat tables or simple nested master-detail data sets Unrelated queries or groups can not interact Disable interactions for unrelated queries in the Configure Events Dialog BAD: Country on two branches Data G1 Country Revenue G2 Country Cost GOOD: Country in common parent Data G1 Country G2 Revenue G3 Cost 32

33 RTF Template Best Practices Use Word Tables Use tables to control precisely where field data will be placed in the report 33

34 RTF Template Best Practices Use Form Fields Keep the template clean Supported by the Template Builder Field Browser Can be colored or hidden to help understand the structure Caveat: Word header & footer don t allow form fields 34

35 RTF Template Best Practices Don t overcomplicate your template Keep it easy to understand, debug and maintain In general better to have different business documents in different templates Try to limit the logic in templates to simple if or loop statements Use sub templates to simplify documents if necessary Many calculations are better performed in the data model 35

36 RTF Template Best Practices Performance Considerations: XPATH Concepts BI Publisher uses XPATH to access data elements DEPARTMENT_NAME is inserted in the template as <?DEPARTMENT_NAME?> <?DEPARTMENT_NAME?> is translated to the XPATH.//DEPARTMENT_NAME.//DEPARTMENT_NAME searches for DEPARTMENT_NAME in the complete sub-tree starting from current context 36

37 RTF Template Best Practices Performance Considerations: XPATH Tuning Use the full relative path for large datasets Instead of <?for-each: DEPT?> use <?for-each:/dept_sals/dept?> Instead of <?DEPARTMENT_NAME?> use <?./DEPARTMENT_NAME?> For large documents that don t fit into memory the search requires disk access For small documents the search time is negligible 37

38 RTF Template Best Practices Performance Considerations: XPATH Tuning & Tables XPATH Tuning Start with the outer loops and outer most data access Reducing full tree searches will provide bigger improvements than optimizing access in a small subset of the data Fixing the XPATH in a single for-each loop may be all the performance tuning you need to do Tables LARGE tables that span hundreds of pages consume considerable server resources. If possible group the data and create a table inside each grouping. Do not nest LARGE tables into tables. 38

39 RTF Template Best Practices Performance Considerations: Grouping Better to Sort data in the data model Group By <?for-each-group?> will force the XSL engine to sort data Checking Data already sorted option in the Table Wizard will not re-sort data (good thing) 39

40 Template Best Practices Summary Don t overcomplicate your templates Use tables (layout grids) to place data fields precisely Use form fields and word styles for clarity Use sub templates for re-use and encapsulate complex code Optimize your data structure for interactivity if necessary Performance optimization Optimize the XPATH Focus optimization on outer loops Sort in the data base and use group-adjacent in the template 40

41 Program Agenda Oracle BI Publisher Enterprise Overview Deployment & System Requirements Report Design Best Practices Data Modeling & Template Design Guidelines BI Publisher & OBIEE Integration Best Practices Q & A 41

42 BI Publisher & OBI EE Integration Best Practices Nicho Mann p nmann@pelotongroup.com

43 Peloton Overview 43

44 Agenda BI Publisher and OBI EE Comparison BI Publisher and OBI EE Integration Best Practices Customer Success Story 44

45 BI Publisher and Oracle Business Intelligence Comparison BI Publisher (BIP) Pixel-Perfect Reporting Reporting Focused Layer of abstraction via the Data Model Sophisticated delivery capabilities User-friendly interface Oracle Business Intelligence (OBI) Interactive Dashboards and Analyses Analytics Focused Layer of abstraction via the Repository (RPD) Actionable Intelligence Ad-hoc capabilities 45

46 BI Publisher and Oracle Business Intelligence Comparison BI Publisher (BIP) Pixel-Perfect Reporting Reporting Focused Layer of abstraction via the Data Model Sophisticated delivery capabilities User-friendly interface Oracle Business Intelligence (OBI) Interactive Dashboards and Analyses Analytics Focused Layer of abstraction via the Repository (RPD) Actionable Intelligence Ad-hoc capabilities BI Publisher + OBIEE = Integrated, Scalable Reporting & Analytics Enterprise Application 46

47 BI Publisher Architecture Sources DW OLAP Cube BIP Data Model Flat File BI Publisher 47

48 Oracle Business Intelligence Architecture Sources DW OLAP Cube Flat File OBI RPD OBI EE Dashboards 48

49 BI Publisher & OBIEE Integration Architecture Sources DW BIP Data Model BI Publisher Reports OLAP Cube Flat File BI Server RPD OBI EE Dashboards 49

50 BI Publisher & OBI EE Integration Benefits Flexibility OBI RPD OBI Reports BIP Data Model BIP Reports Multiple Data Sources Create Calculations Apply Functions Change Column Names Use/Create Aggregates Custom Formulas Integration of BI Publisher & OBI EE allows for flexible solutions Solution is scalable as a result of flexibility in accepting multiple data sources 50

51 BI Publisher & OBI EE Integration Interactive Dashboards & Pixel-Perfect Reports OBI Dashboards Interactive Analyses Action Links & Guided Navigation Drillable Reports Extensive Visualizations BI Publisher Reports Pixel-Perfect Reports User-Friendly Interface Leverage Existing OBI Reports 51

52 Agenda BI Publisher and OBI EE Comparison BI Publisher and OBI EE Integration Best Practices Customer Success Story 52

53 BI Publisher & OBI EE Integration Keep It Simple Source Relational and OLAP data sources into OBI MDX and SQL will be dynamically generated by OBI Utilize a single OBI model instead of several data models 53

54 BI Publisher & OBI EE Integration Keep It Simple Push Logic As Far Back As Possible Data Source > RPD > Data Model > BIP Report Faster Calculations Less Maintenance Increased Query Performance Keep Datasets Under Control Be mindful of the amount of data being requested Use filters to limit data sets and increase performance 54

55 BI Publisher & OBI EE Integration Keep It Simple Using an existing OBI model means: Less coding Decrease turnaround time of requests Easier for developers to leverage Less training for end users Higher adoption by business users 55

56 BI Publisher & OBI EE Integration Maintain Consistency Utilize OBI Subject Areas when possible Cuts down on the number of data models Maintains logic in fewer locations Keep the number of BIP data models to a minimum Create data models that can be used across a range of reports 56

57 BI Publisher & OBI EE Integration Leverage Existing OBI EE Implementation Utilize Existing Applications Cut down costs Higher adoption Increased scalability Seamless Integration 57

58 Agenda BI Publisher and OBI EE Comparison BI Publisher and OBI EE Integration Best Practices Customer Success Story 58

59 BI Publisher Success Story Overview Infinity Pharmaceuticals In late stage trials beginning to prepare for the transition to commercial Purchased Oracle BI Foundation Suite to improve reporting and analytical capabilities Partnered with Peloton to implement a scalable, integrated solution to meet the needs of the growing organization 59

60 BI Publisher Success Story Challenges Difficult to access key information No consistent tool for financial reporting Limited transparency to Financial Investment Plans (FIPs) for department heads Challenging to quickly and easily access variance reports for functional heads 60

61 BI Publisher Success Story Solution - Overview Established New Data Warehouse Built Essbase Studio Cube Model Implemented Sophisticated Reporting Solution: OBI EE Hyperion Smart View BI Publisher 61

62 BI Publisher Success Story Solution BI Publisher Integrated BI Publisher with OBI EE Created POC leveraged existing OBI EE reports Developed BI Publisher Data Models using logical SQL Quickly generated pixel-perfect financial reports 62

63 BI Publisher Success Story Solution BI Publisher Leveraged OBI EE dashboards with BI Publisher reports Guided navigation and action links for sophisticated analysis BI Publisher reports for exporting purposes Cut down on development, system integration, & adoption time 63

64 Solution Options What if I only have Oracle Business Intelligence? Easily integrate BI Publisher Get more from your development dollars by leveraging your OBI EE implementation What if I only have BI Publisher? Consider the roadmap of your organization from an analytics perspective OBI EE offers much more structure for data sources and integrates well with BI Publisher What if I have neither? OBI EE is a great starting platform because of its flexibility Scalability is critical to any organization OBI EE is a highly scalable, enterprise application 64

65 A Charitable Donation to Support Children s Health 65

66 Q&A & 66

67 Stay Connected with BI Publisher 67

68 Graphic Section Divider 68

69 Appendix 69

70 Resources Certification matrix ( x) System Requirements and Supported Platforms for Oracle Business Intelligence Suite Enterprise Edition 11gR1 ( ) System Requirements and Supported Platforms for Oracle Business Intelligence Suite Enterprise Edition 11gR1 ( ) High availability white paper Sizing Spreadsheet for BI Publisher Enterprise 10g and 11g My Oracle Support Note Sub-templates white paper QUARTZ Scheduling - CPU Ratings

71 Install Requirements Oracle Business Intelligence 11g System Requirements Disk Space: 20GB or more Available Memory (RAM): 4GB or more Temp Space: 950MB or more Swap Space: 3GB or more CPU: dual-core Pentium, 1.5GHz or greater Database Requirements Oracle Fusion Middleware Installation Guide for Oracle Business Intelligence 11g Release 1 (11.1.1) Part Number E Disk space requirements for the database containing the Oracle Business Intelligence Scheduler database tables. 500MB on Oracle and Microsoft SQL Server databases for standalone and Business Intelligence applications and deployments. 500MB on IBM DB2 databases for standalone deployments. 71

72 Oracle Business Intelligence Publisher Recommended Configuration JVM settings & JDK version 64 bit JVM/JDK (on a 64 bit OS) JDK version 1.6 (update 2) or higher Memory (RAM for the JVM) 8 GB on 64 bit JVM is recommended for large, high volume use 2 GB on 32 bit OS suitable for small to mid volume deployments (2gb limitation for JDK on win OS) Storage Repository: Varies. 30 GB Hard disk space (must be shared for cluster) Temp Space: 20 GB (for document processing) not shared 72

73 Enterprise Deployment Options BI Publisher (10g) High availability Improve availability of the system Load balancing Increase throughput For more details on clustering BI Publisher standalone, please refer to our White Paper on High Availability. The link is available in the Appendix. 73

74 Enterprise Deployment Options BI Publisher Scheduler Configuration (v10g only) Enable clustering Client BIP servers cluster Scheduler database 74

75 Server Configuration Options Administration > Server Configuration Scalable threshold (in bytes) Cache expiration (in min) Cache size limit (# of datasets) Maximum cached reports Database Fetch Size Default values 75

76 Server Configuration Options Administration > Runtime Configuration > Properties Bursting (10g only) Enable multithreading Default: False* Thread count Default: 2* FO processing Use BI Publisher s XSLT processor Default: True Enable scalable feature of XSLT processor Default: False* Pages cached during processing Default: 50 Enable multithreading Default: False* FO Parsing Buffer Size Default: * Enable XSLT runtime optimization Default: True 76

77 Report-level Properties Edit Report > Properties > Formatting 77

78 Report-level Properties Viewing Reports Online Report Editor Report Viewer For long running reports Take advantage of scheduling and disable Run Report Online. 78

79 Report-level Properties Viewing Reports Online Report Editor Enable Data Caching Saves XML data for reuse up to the Cache Expiration threshold Improved performance with different template/output format Not recommended for real-time data Enable Document Caching Better performance Consumes more Temp storage space User Level (11g only) Disable for better performance if data can be shared across users Cache Duration (11g only) 79

80 Data Model Design Guidelines Element Naming Avoid re-using the same name for element names; it can cause confusion in template design. For example, CITY under SHIPPING_ADDRESS and BILLING_ADDRESS. But in many cases you are better off using different names e.g. S_CITY and B_CITY For reports that generate large data sets using 2 or 3 character names for elements can have a large impact on performance and size. Ex: a1, a2, 80

81 Data Model Design Guidelines NULL Elements & XML Attributes Avoid generating empty tags in the XML Aggregation over fields that contain empty tags will fail with a not a number exception Missing fields do not cause an issue with XSL for example a print statement will just return an empty string Avoid XML attributes They are supported in both RTF & Excel templates but they add an extra layer of complexity; they are not supported in the BI Publisher Layout Editor 81

82 Data Model Design Guidelines OBIEE Data Source If possible use SQL/JDBC against BI Server instead of using an Answers Request as a data source Tip: Copy the SQL in an Answers Request and paste into the Query Builder text area 82

83 Document Formatting and Layout Sub Templates: Introduction What is a sub template? A document that contains layout and or code that can be defined once and used multiple times Multiple functions (called templates in XSL) or text segments can be defined in a single sub template file Sub template types XSL sub templates for code re-use or separation RTF sub templates for layout re-use Caveat: Use of RTF sub templates makes it harder to understand the template structure 83

84 Document Formatting and Layout Sub Templates: Use Cases RTF sub templates Re-use common layouts such as terms and conditions Internationalized address block XSL sub templates Transformations for complex chart requirements Dynamically apply formatting to a portion of data (e.g. sub scripting / super scripting / chemical formula) Print formatted XHTML data convert to FO using sub template (as used in Oracle Contracts) ( supports HTML in data) Starting w/ we recommend using Style Templates for Header / Footer instead of RTF Sub Template 84

85 RTF Template Best Practices Use Word Styles Achieve consistency in the template and between templates In 11g use Style Templates to control the template styles 85

86 86

87 87