Introduction to K2View Fabric 1
Introduction to K2View Fabric Overview In every industry, the amount of data being created and consumed on a daily basis is growing exponentially. Enterprises are struggling to manage the velocity and variety of their data because it typically lives in disparate Big Data and legacy database technologies making it nearly impossible to quickly implement key initiatives or use it to deliver exceptional, real-time customer experiences. Typically, transforming existing enterprise technologies, applications and architectures to deal with complex data management challenges can be extremely costly, capital intensive and time consuming. What enterprises need is a fast and efficient way to quickly integrate their systems so they can access their data any time, regardless of where and how it is stored. They need a modern data management platform and process for managing data that works across all of their systems and technologies. And they need it now A different approach to organizing data K2View Fabric uses a proprietary data model to retrieve, manage and store data called the Logical Unit (LU).. The LU represents your business central business entity. It can be a customer, household, product, location, transaction whatever matters to your business. Most database management systems store data in rows and columns based on the type of data being stored (e.g. customer data, financial data, address data, device data). This model is very cumbersome because it requires complex joins every time users need to access data. And it s not optimal for operationalizing the data for other uses. K2View Fabric is a modern, distributed data management platform that rapidly integrates data from any source (RDBMS, Big Data, Cloud, IoT and more) and delivers it in real-time to any end user or application. K2View is a no-risk solution to today s toughest data management solutions. 2
At K2View, we store and manage data based on business need, not on a predefined technology or structure, hence the name Logical Unit. Our approach gives businesses a better way to organize their data and achieve unparalleled speed and agility. Each Logical Unit is associated with a data schema relevant to the business. The schema creation process can be initiated using K2View s Auto-Discovery module or performed manually using K2View s drag-and-drop graphical configuration dashboard, K2View Fabric Studio. The result is a business oriented data structure that contains all the tables and objects from as many systems as needed (e.g. 3 tables from the CRM system running on MySQL and 5 tables from the billing system residing on Oracle). The Logical Unit schema is used every time data is accessed in K2View Fabric using embedded, advanced data integration capabilities. Organizing and managing data as logical units that are compressed and encrypted in mini-databases enables incredible performance, enhanced security, high availability and customizable data synchronization. Regardless of whether your data resides on premise, in the cloud or in a hybrid environment, the Logical Unit approach to organizing data is the ideal solution to connect scattered, hard to maintain data and highly available, business-oriented data, then rapidly expose it everywhere you need it in just weeks. 3
Data without delay All the data you need. The way you need it. In weeks, not years. It leaves a lot of people asking: Exactly how is that possible? How do you do it? The key lies in our unique approach to organizing data and eliminating what keeps businesses from harnessing the power of their data as quickly as they need to. If you ve undertaken projects like these before, the process flow probably looked something like this -- loaded with layers of different solutions and complex, manual processes: K2View gets it. That s why we created Fabric to eliminate the headaches and deliver the data the way you need it in just weeks. K2View Fabric is an end-to-end solution that snuffs out the manual work and removes the need to cobble together multiple solutions to deliver the data you need more quickly without risk or impact to your legacy systems. Here s how: 4
K2View Fabric cuts out the headaches associated with multiple solutions and manual processes so that you can start solving problems, winning over customers, driving revenue and saving money with your data in just weeks! 5
Architecture CONFIGURATION: This layer contains the configuration of every Logical Unit. The layer is accessed through our user-friendly administration tools (K2 Admin Manager, K2View Fabric Studio and Web Admin interfaces). WEB/DATABASE SERVICES: This layer communicates with applications via direct queries (database services) or via web services. AUTHENTICATION ENGINE: This layer manages user access control and restrictions. MASKING LAYER: This layer allows real-time masking of sensitive data. PROCESSING ENGINE: This layer is where data computation is managed. It uses the principles of massive parallel processing and map-reduce to execute operations. SMART SYNC ENGINE: This layer drives the real-time synchronization of data with K2View Fabric. ETL LAYER: This layer is the embedded, advanced integration layer, allowing for automated ETL on retrieval. ENCRYPTION ENGINE: This layer manages the granular encryption of each data set. BUSINESS ENTITY STORAGE MANAGER: This layer compresses and sends data to the distributed database for storage. K2View Fabric is built on Cassandra, making it a flexible solution that can be adapted to any distributed database solution. 6
Features K2View Fabric is built to solve the challenges of enterprise data management. Key features and capabilities include: In-Memory distributed performance Linear scalability on commodity hardware Consistency, durability and high availability Full SQL support and industry connectors The following sections will provide an overview on how K2View Fabric provides these features.. PERFORMANCE K2View Fabric s principal performance feature is its inherent Logical Unit representation running every query on small amount of data: this feature makes K2View Fabric the fastest database on the market. On top of this inherent design, K2View Fabric ensures performance using the two following major principles: Every query is executed in-memory. For analytics queries running across several Logical Unit Instances, K2View Fabric implements a proprietary map-reduce algorithm that breaks down this analytic query in small jobs distributed against K2View Fabric s nodes. Every computation is driven by the K2View Fabric processing engine, which allows it to be executed and distributed across any node, which delivers Massive Parallel Processing (MPP). LINEAR SCALABILITY AND LOW TCO As opposed to many big data solutions that require high-end, in memory performance, K2View Fabric does not require storage of data in memory or expensive hardware. K2View Fabric offers a very low Total Cost of Ownership (TCO) and other important benefits. In-Memory performance using commodity hardware. Computations are done in memory, data is compressed and stored on disk. Complete linear scalability using a modern, distributed database. Risk-free Integration CONSISTENCY, DURABILITY AND AVAILABILITY K2View Fabric ensures full consistency, guaranteed durability and high availability of the data. Consistency is ensured by the Processing engine of K2View Fabric, using an internal and distributed transaction table to determine if a concurrent transaction is occurring and if the write 7
should be put on hold. Durability and high-availability are inherent features of the distributed database layer (Cassandra). FULL SQL AND STANDARD CONNECTORS The K2View Fabric Processing Engine uses two query methods depending on the type of data the query is executed: Query on a Logical Unit (around 95% of overall queries): simple ANSI SQL query. Query across Logical Units (analytics): Map-Reduce engine reproducing SQL protocol. Both methods support everything that is supported in ANSI SQL. The methods include a proprietary indexing functions that deliver faster performance and user access controls. Finally, K2View Fabric provides full JDBC support, and features connectors to all the most common databases on the market (e.g. Oracle, MySQL, PostgreSQL, Netezza, SQLServer, 8
Differentiators 2View Fabric offers the best features of big data architectures, while also providing unique functionality that differentiates it from other solutions on the market, including: Advanced ETL/Data Masking Embedded Web Services Flexible Synchronization Row-level security EMBEDDED ETL/DATA MASKING K2View s industry proven ETL capabilities are embedded into K2View Fabric. The principles of the ETL are based on the logical unit data representation: by simply defining its schema, K2View Fabric automatically creates a migration path from all sources into a logical unit. Any type of enrichment (adding field, masking fields, etc.) can be applied during this definition. The ETL layer is triggered automatically if needed by the smart data controller, alleviating any need for external ETL tools or costly migration projects. EMBEDDED WEB SERVICES K2View Fabric offers an out-of-the-box configuration graphical interface to define web services: any function (which can be as simple as a query) can be created and registered as web service. Once the function is defined, K2View Fabric automatically ensures user access, distribution, updates due to schema changes, etc. The gain in time and effort is tremendous compared to traditional database management systems that require developing, FLEXIBLE SYNCHRONIZATION K2View Fabric includes dynamic data synchronization features through the Smart Data Controller. Any time data is accessed in K2View Fabric, the Smart Data Controller compares the current data with the synchronization parameters and updates the data as needed. K2View Fabric offers flexible synchronization modes to ensure data is always fresh and accurate: ON-DEMAND SYNC This feature allows on-demand synchronization using web services, batch scripts or direct query using the administrative mode. EVENT-BASED SYNC Event-based synchronization can be triggered using the principles of Change Data Capture (CDC). Using this mode, K2View Fabric automatically captures changes in the source systems that are part of its schema. 9
ALWAYS SYNC K2View Always Sync offers an intelligent and flexible way to synchronize data. This mode allows complete granular control over data synchronization with source systems. Using Always Sync, you set the data refresh rules for each data element. The Always Sync timer then implements the synchronization rules (e.g. update customer usage information every 5 minutes, update customer address data 1x per week, etc.) to ensure data is always accurate and up-to-date. ROW-LEVEL SECURITY K2View Fabric uses a proprietary algorithm called Hierarchical Encryption-Key Schema (HEKS) that allows complete control over data encryption. The process relies on three set of keys to secure data: Master Key: Generated during the installation, this is the main key allowing access to every resource of K2View Fabric. Type Keys: These keys restrict access at the Logical Unit level and are a hash of the Master Key. Instance Keys: These keys restrict access at the Logical Unit Instance level and are a hash of their corresponding type key. In the figure above, you can see how HEKS is implemented for two LU types. Indeed, you can see the following keys: 1 Master Key with full access 2 Type Keys to control access to 2 different Logical Units 6 Instance Keys, 3 for each Logical Unit - to restrict access at the Logical Unit instance level Using this hierarchical encryption, K2View Fabric allows complete control over the stored data and significantly reduces the risk of data leaks. Even if one Instance Key were hacked, only the data of one instance would be leaked; all other instance data remains safely encrypted. Therefore, this design makes K2View Fabric the most secure database on the market, essentially rendering massive data breaches virtually impossible. 10
Frequently asked questions WHAT IS THE MAIN DIFFERENCE BETWEEN SECURITY IN K2VIEW FABRIC AND OTHER DATA MANAGEMENT SOLUTIONS? Other solutions do not offer multi-layer encryption. With K2View, data is secured at both the atomic and Logical Unit level which delivers unparalleled security and eliminates the chance of large scale data breaches. WITH SUCH RICH SYNCHRONIZATION FEATURES, HOW DO YOU ENSURE PERFORMANCE? K2View Fabric provides high-end performance by processing data at the Logical Unit level which improves data processing speed. Data processing is done in memory, and maintains data cache for frequent use. Additionally, K2View Fabric uses map-reduce to execute rapid queries. WHAT IS THE DIFFERENCE BETWEEN MIGRATING DATA USING K2VIEW FABRIC OR A TRADITIONAL RDBMS? Advanced data migration is a feature of K2View Fabric. Migration using traditional RDBMS requires extensive development, testing and deployment of migration tools. HOW MANY PROCESSING/SYNC/DATA STORAGE LAYERS ARE THERE IN K2VIEW FABRIC? K2View Fabric is built on Cassandra so there can be as many layers as there are nodes in your deployment. This allows for full parallel execution between nodes. 11
To learn more Visit our website www.k2view.com - and watch these short videos: Intro to K2view K2View Fabric for Customer 360 K2View Technical Overview Let us blow your mind Sound too good to be true? It s true anyway. Let us show you> Give us a couple hours of your time, and if you qualify, we ll invest 2 weeks to show you something you ve never been able to do before. Contact us to request a demo: Web: www.k2view.com Phone: 1(855)4K2VIEW Email: info@k2view.com 12