KNOWLEDGENT INSIGHTS volume 1 no. 5 October 7, 2011 Xcelerated Business Insights (xbi): Going beyond business intelligence to drive information value Today s growing commercial, operational and regulatory pressures underscore the importance of information management. Access to critical business information at the right time is essential to maintain competitive advantage. Despite industry progress, Enterprise Information Management (EIM) professionals continue to face implementation challenges due to the ever increasing and innovative ways information is used throughout the enterprise. Common practical challenges: Varying degree of information structure Dynamically locating, accessing and trusting the information Facilitating navigation, analysis and information visualization Key Features of xbi Core: Rapid Declarative Information Rule-based Solutions Integration of data across enterprise lines of business without physically integrating the data Inherent trust and traceability in every solution Flexible scalability With our EIM experience and deep cross-industry knowledge, Knowledgent believes these challenges are an opportunity to innovate. xbi is a platform that enables Knowledgent to deliver industry-centric solutions that are turn-key, configurable and/ or managed-services for their clients. These solutions address EIM challenges by: Declaratively creating solutions that quickly enable complex and flexible use of structured and unstructured information Collating data from multiple data sources into a single model making holistic processing across the typical enterprise information landscape possible Integrating deep traceability, from the data processing rules down to the data that enhances trust and visibility Scaling to data complexity and volumes of the largest enterprise
The xbi Difference xbi Technical Overview At a high level, xbi exploits the difference between programming and modeling. Programming/ procedural approaches require predetermining the order of steps necessary to solve a given problem. In contrast, declarative modeling systems specify rules independently from the problem to be solved. It s then up to the modeling system to analyze these rules to determine how to apply them in an order that satisfies all the conditions of the solution. A major challenge with this approach is providing a way to declare the rules that scales to enterprise solutions Although xbi has multiple add-on modules, the core is the integration of the data access, rule processing and presentation capabilities. As an illustration of the contrast between declarative and procedural approaches, compare a business spreadsheet environment with the stack of tools typically used to create an analytical solution (ETL, BI, Stored Procedures, programming language, etc.). A tool like Excel is a declarative modeling system in that the user wants a particular cell in a spreadsheet to represent a particular value. It s necessary only to specify the formula required to compute that value. More specifically, the user does not need to identify any other cells that must be computed before the desired value is computed. The ability to operate at a high-level (and not pre-specify computational order) is what gives spreadsheets much of their power and flexibility versus a procedural approach. xbi rules are declarative specifications used to solve information management problems. xbi is a modeling system for specifying the solution to the entire problem, from the lowest level data access thru the business processing and presentation, in ways that are faster to build and scale more effectively than other approaches. The integration of a federated data access, declarative modeling of the business and data logic and sliceand-dice style reporting, makes xbi dramatically more powerful. Through this integration the declarative approach is leveraged across all aspects of any solution. Federated Data Access: This enables solutions that span multiple data sources without physically moving or changing data. The tables, columns and joins needed by the rules are modeled and managed via the federation. This forms the foundation for a virtual data hypercube warehouse. Rules Engine: This dynamically combines data and generates insights. Every variable, dimension, fact, hierarchy, calculation, time period, data element and exception is modeled as a declarative rule. The rules and federation are linked via data map rules that point to values in the data source or multiple data sources based on rule conditions. Presentation: This is comparable to traditional standalone Business Intelligence (BI) products, such as a web-based interface enabling users to create and view dashboards, reports and runs ad-hoc and what if analysis. xbi s presentation layer is distinguished knowledgent insights volume 1 no. 5 2
by its ability to leverage not just data, but by presenting the output of arbitrary points in the layers of rules. Furthermore, xbi supports tracing through the rules all the way to the data level. This deep integration is a core xbi differentiator, exploiting the advantages of the declarative rule-based approach across the entire stack. Declarative Rules xbi s declarative rules engine works by providing an optimized way to describe and operate on the data in an online analytical processing (OLAP)-like cube. application of these rules is patented under US patent #5,918,232.) Meta Rules Principles The meta rules are inspired by two basic and intuitive principles. The first principle is that more specific business-rules have a higher priority. For example, a rebate calculation for trade executions of blocks greater than 10K shares is.01% * (price * volume). But there is a more specific calculation for trade volumes greater than 10K and a spread greater than 1/16 for a particular customer. That more specific rule will override less specific rules, and is a key enabler of xbi s enterprise-scale analytic solutions. At the base are the rules to obtain the data from the source and place it into the cube. From there rules are defined to realize all the additional data and behavior needed for the solution. The results of a rule can be based on data or the results of other rules. In standard warehouse terminology, the results of the rules form both facts and dimensions. Rules can be as simple as Profit = Revenue - Expense or they can perform complex calculation and data access logic. xbi is differentiated from similar sounding solutions through its use of Rule-Order Independence. This capability is enabled by powerful meta rules (rules for rules) that handle rule ordering, and provides scaling well beyond spreadsheet-class applications. (The The second principle is the priority of using data directly from a database in dimensions. For example, a hierarchy in the time dimension (e.g., day, month, quarter, year) where each point of aggregation in the hierarchy can be associated with a business-rule. The vast majority of the rules in a typical model actually come from the aggregations in these hierarchies. These rules have a lower priority than rules defined by the model builder, following the intuitive idea that the databasederived rules are the basic defaults. The model builder could test the effect of implementing a September fiscal year end by creating new rules to define the new year. Beyond this, if a user wants to change a value computed by the model, that what if value takes precedence over other rules of equivalent specificity, otherwise, the user s desire to test the effect of the changed value won t be properly honored. (Note: the ability to change values as needed to support what if or to write back to the source is another differentiator.) knowledgent insights volume 1 no. 5 3
The importance of rule ordering impacts accuracy of results and efficiency of result delivery. Lacking appropriate efficiency can often translate into no results if the computational effort required is too great. Real-Time Rules Management Although the xbi rules approach is intuitively powerful, the real power of xbi is in its ability to apply the rules in real-time. For example, the power of spreadsheets would be greatly diminished if making any change to cell computation required hours or even minutes to process before answers could be retrieved. Interactivity is the key benefit of an analytic model. xbi s patented active rules architecture optimizes rules ordering and models to provide dramatic performance gains. Model Auditing The xbi user interface further leverages the optimized rule organization to allow interactive exploration of a model s rules. This makes it possible to determine instantly and precisely not only how any value in the model was derived, but the ability to show the actual values or data sources used. Further, it s possible to see at a glance what downstream computations any value might be used in. Performance The rules optimization is accomplished by the rule set preparation process. xbi evaluates all the rules in combination, producing an internal, multidimensional representation of the model. This representation contains entries with a specification of a collection of cells in the cube and a rule which can be applied to compute the value of each of the cells. Once organized and a request for data is presented, the precise definition of the process for computing every single value from the entire business model can be optimally found and computed. It s critical that actual retrieval of data from source systems and computation of cell values from those data be as fast as possible. xbi incorporates a large number of optimizations in both database access and internal calculations to address the performance requirements. Computations, filtering and sorting operations are pushed into the underlying relational database where the hardware and software platform will generally be scaled to match the volume of data being analyzed. Only if the operation can t be performed by the database will it be performed by xbi. This occurs relatively infrequently, and the frequency can be reduced further by the ability for the business analyst to individualize specific SQL operations as part of the model s definition. Other optimizations are designed to increase performance by not having the database do some operations. For example, if most but not all rows need to be returned from a table, instead of giving the database a large and time-consuming filtering, xbi will drop the knowledgent insights volume 1 no. 5 4
database filter altogether, and discard the few unneeded rows itself. Finally, xbi fully supports caching of parts of a model and has a multi-threaded architecture optimized for use on symmetric multi-processor hardware platforms. Evolution Evolution of any solution must keep pace with the constant change of modern businesses. Every change implies changes to the business models used to guide the business. The combination of the xbi capabilities, most notably declarative rules rather than traditional fragile procedural approaches, enable solution evolution at the pace of business. stores them as structured data that can be merged into xbi rules-based models. This makes solutions like semantic enrichment of Master Data, discovery of customer affiliations, and visibility of trends within and outside of the enterprise attainable. Data Management Modules: These modules are comprised of discovery, metadata, lineage and governance components that provide a detailed picture of the data structures and underlying relationships of the data sources used in a solution. Federation Plug-in: This extends the available data universe to almost any source beyond the RDBMScentric approach immediately available via the xbi core. This aspect of the plug-and-play architecture of xbi is frequently used to integrate xbi in an enterprise that already has a data federation product in place. Plug-In Modules BI Tools Plug-in: This extends the output of xbi rule-based processing to feed existing traditional BI tool deployments. A powerful variation on this theme is integration BI tools that support the XMLA-MDX standards. xbi can deliver the results of rules to any XMLA-MDX compliant product making the output of xbi transparently available. Additional plug-in functionality augments xbi Semantic Enrichment Module: This module provides the capability to integrate structured and unstructured data. The module allows data from social media websites (e.g., Linked-In, Twitter, etc.), or internal text sources (e.g., call-center call notes), to be semantically analyzed. This analysis produces insights such as people, places, organizations, sentiment, etc., and knowledgent insights volume 1 no. 5 5
Knowledgent Insights offers business and strategic insights on the latest trends affecting information efficiency and management that drives strategic growth decisions. For more information on the subject matter covered in this issue, contact info@knowledgent.com About Knowledgent Knowledgent (www.knowledgent.com) is a leading industry consulting and information management firm. It combines deep industry expertise with advanced information management capabilities to maximize the value of information to empower clients to make informed strategic decisions. Knowledgent leverages large-scale analytics, unstructured data mining, semantic integration and master information management to help clients optimize business operations. Founded in 2009, Knowledgent has offices in Boston, Massachusetts, New York, New York and Warren, New Jersey. 2011 Knowledgent Group Inc. All rights reserved. knowledgent insights volume 1 no. 5 6