Shadowbase Data Replication and Data Integration Solutions GTUG

Size: px

Start display at page:

Download "Shadowbase Data Replication and Data Integration Solutions GTUG"

Chrystal Hardy
5 years ago
Views:

1 Shadowbase Data Replication and Data Integration Solutions GTUG Paul J. Holenstein Executive Vice President Shadowbase Products Group 1

Integration Shadowbase Success Stories What s New for Shadowbase What s

2 Agenda Introduction to Gravic Shadowbase Product Overview o Business Continuity o Data Integration & Synchronization o Application Integration Shadowbase Success Stories What s New for Shadowbase What s Next for Shadowbase Questions? Please ask as we go along 2

3 Introduction to Gravic A History of Excellence: 35+ Years and Going Strong! 1979 Founded, Development Organization & Service Bureau 1984 Introduced NonStop Replication Product TMF Auditor 1995 Shadowbase for HP NonStop Released 1996 Shadowbase Heterogeneous Platform Support Released 1997 Shadowbase for Oracle, SQL Server, and Sybase Released 1998 Gravic Labs Formed 2000 Patented & Released Shadowbase NonStop Bi-Dir Support 2002 Released Bi-Dir Heterogeneous Platform Support 2005 Surpassed 500 Licensed Shadowbase Systems 2008/9 Released SQL/MX, ACI BASE24, GE Centricity Enterprise Support 2011 Gravic Won Two Industry Awards from HP & Intel for Technical Excellence 2012/13 New Synchronous Replication Features Delivered/Beta; Gravic won STEVIE Award 2014 Gravic working with HP NED on a HP Reseller Deal for Shadowbase Products Total Replication Solutions Leverage product, services, and partners to offer complete business problem solution Industries include financial services, trading systems, banks, telecommunications, and healthcare 3

4 Selected Shadowbase Customers Banking & Financial Services: Telecommunications: U.S. Cellular Other:

5 Shadowbase Product Suite Overview Business Continuity & Application Availability Environments Active/Passive Disaster Recovery Sizzling-Hot-Takeover Active/Active Continuous Availability Eliminate Planned Downtime for Migrations & Upgrades (ZDM) Data Integration & Data Synchronization Homogenous & Heterogeneous Environments Data Transformation, Scrubbing, Filtering & Cleansing Extend Replication Capabilities with Embedded Application Logic Application Integration Build Event-driven Architectures o No more polling for needed data Build Real-Time Architectures o Process events as the occur; no more working with stale data Integrate Disparate Applications with no Application Code Changes o Integrate at data-layer, avoiding costly adapters & middleware Shadowbase Suite: Enabling, Extensible Technology! 5

Shadowbase Product Suite Overview Homogeneous & Heterogeneous

SQL/MX Enscribe HP NonStop SQL/MP SQL/MX Sybase Oracle MySQL DB2

Server DB2 Linux, Unix, Windows AS400 VMS Windows Any ODBC Target

, Teradata) Enscribe HP NonStop SQL/MP SQL/MX Enscribe HP NonStop

6 Shadowbase Product Suite Overview Homogeneous & Heterogeneous Uni/Bi-Directional Data Replication Enscribe HP NonStop SQL/MP SQL/MX Enscribe HP NonStop SQL/MP SQL/MX Sybase Oracle MySQL DB2 Unix/Linux Oracle SQL Server Sybase DB2 Oracle Sybase Oracle SQL Server DB2 Linux, Unix, Windows AS400 VMS Windows Any ODBC Target Platform/Database (e.g., Teradata) Enscribe HP NonStop SQL/MP SQL/MX Enscribe HP NonStop SQL/MP SQL/MX Oracle SQL Server Sybase Oracle SQL Server Sybase Linux, Unix, Windows Linux, Unix, Windows 6

7 Shadowbase Product Suite Overview Shadowbase Product Extensions/Example Uses Audit Compliance Reporting & Analysis Validate Target Matches Source Load/Refresh Data Warehouses & Data Marts Using ETL Build Real-Time Business Intelligence & Active Data Warehouse Systems Integrate Operational Processing with Ancillary Systems Eliminate Planned Application Downtime (ZDM) Restore Corrupted Databases On-line Eliminating Application Outages Chases Non-audited Log Files to Inject Events into Replication 7

Shadowbase Product Suite Overview Shadowbase Product Extensions/Example Uses Performs Optional

Initial & Refresh Loading of Target from Source Modernize an Application By Allowing Both Legacy

Workstation Test Database Creation, QA Database Refresh, Data Obfuscation No-Obligation Trial,

8 Shadowbase Product Suite Overview Shadowbase Product Extensions/Example Uses Performs Optional Disk-Based Source or Target-Side Queuing of Data Online Loading Facility Performs High-Volume Initial & Refresh Loading of Target from Source Modernize an Application By Allowing Both Legacy & New Versions to Coexist with No Application Downtime Manage, Command & Control GUI from Your Workstation Test Database Creation, QA Database Refresh, Data Obfuscation No-Obligation Trial, Test, Train, Tune We ll Build Your Environment in Our Lab or On-site & Demo 8

9 Business Continuity Overview Recovery Point and Recovery Time Objectives Recovery Point Objective (RPO) and Recovery Time Objective (RTO) are two commonly used terms to describe business continuity requirements. They are business decisions based on your applications needs RPO - describes the point in time to which the data must be recovered RTO - describes the time from when a failure occurs until the business process must become available/active again. Last Saved Data Point Potential for Data Loss RPO/RTO Relationship Failure Point Time to Recover Recovery Complete System Processing Time RPO Primarily Influenced by Technology (Async vs Sync) RTO Primarily Influenced by Architecture (Active/Passive to Active/Active) 9 9

10 Business Continuity Overview Recovery Point and Recovery Time Objectives Recovery Point Objective (RPO) and Recovery Time Objective (RTO) are two commonly used terms to describe business continuity requirements. They are business decisions based on your applications needs RPO - describes the point in time to which the data must be recovered RTO - describes the time from when a failure occurs until the business process must become available/active again. Last Saved Data Point Potential for Data Loss RPO/RTO Relationship Failure Point Time to Recover Recovery Complete RPO RTO

11 Shadowbase for Business Continuity (SYNC) Shadowbase Product Suite 1. Current-Shadowbase Disaster Recovery (Async, Active/Passive) 2. Current-Shadowbase Sizzling-Hot-Takeover (Async, Active/ Almost Active) 3. Current-Shadowbase Continuous Availability (Async, Active/Active) 4. Future-Shadowbase Disaster Recovery (Sync, Active/Passive) 5. Future-Shadowbase Sizzling-Hot-Takeover (Sync, Active/ Almost Active) 6. Future-Shadowbase Continuous Availability (Sync, Active/Active) Sync Disaster Recovery Sync Sizzling-Hot- Takeover Sync BC Sweet Active/ Spot Active No Data Loss, Fastest Recovery RPO (less, or no, data loss) Async Disaster Recovery Async Sizzling-Hot- Takeover Async Active/ Active Little Data Loss, Fastest Recovery RTO (faster recovery) 11

12 Shadowbase for Business Continuity Zero Downtime Upgrades and Migrations (ZDM) Minimize or eliminate planned application downtime Build & test new environments without impacting existing production users Avoid the risk of the outage window big-bang cut-over Avoiding failover faults o Cut-over to a known-working application/database environment o Very similar to the sizzling-hot-takeover benefits! Use for: o O/S or Platform Upgrades o Developing new application releases o Database upgrades or conversions o Moving other application or database environments onto NonStop 12

13 Shadowbase for Data Integration Shadowbase Manages Data Mapping for Source to Target Many datatypes mapped automatically o For example: CHAR, numerics, many dates/times, etc. Complex datatypes mapped via either Data Mapping scripts or the Shadowbase embedded User Exit capability Data Scrubbing and Cleansing Blank and null-fill processing, NULL mapping, date/time cleansing, etc. Data Filtering and/or Aggregation Remove events being replicated based on data content Consolidate multiple events into one Non-Relational to/from Relational Data Formats Data normalization support provided (e.g., for redefinition support, array fanout, etc.) For example NonStop Enscribe to Oracle 13

Shadowbase for Data Integration Large Scale SaaS

applications with online trading applications Windows

Shadowbase Internet 200+ Internet client Firewall

14 Shadowbase for Data Integration Large Scale SaaS Internet client Integrating HP NonStop trading applications with online trading applications Windows Linux Unix IBM NonStop Cluster Traditional Brokers Shadowbase Internet 200+ Internet client Firewall Oracle Sybase SQL Server DB2 MySQL Flat Files Firewall 14

15 Shadowbase for Data Integration Bi-Directional Active/Active NonStop with Oracle/RAC ACI BASE24 AJB Combined Stores Brand 1 Stores Brand 2 Stores Store POS terminals Store POS terminals AJB FIPay interchanges Brand 1's NonStop BASE24 Brand 2's NonStop BASE24 interchanges Linux servers RAC cluster interchanges SQL/MP Enscribe sales refunds exchanges sales refunds exchanges SQL/MP Enscribe Oracle sales refunds exchanges AJB RTS Integrated Refunds and Exchanges 15

16 Shadowbase for Application Integration Shadowbase Enables Event-Driven Architectures Shadowbase monitors the TMF transaction log and can trigger on all DML or DDL database activity (e.g., inserts, updates, or deletes) Shadowbase Provides Real-Time Data Delivery As soon as the event occurs in the database, Shadowbase processes it Shadowbase Integrates at the Data Layer No need to modify application code (assuming you *have* the code) Avoid inefficient polling of the database for changes Shadowbase acts as the hub, feeding pertinent database change events to all other system(s) Build efficient data-driven Publish/Subscribe event-notification architectures using replication as the middleware 16

17 Shadowbase for Application Integration Database Event Capture and Delivery Customer Application Customer Database Selected DB Activity Application IPC Feed OR OR Middleware Feed Function: Shadowbase sees all changes to the application s data and can act on them. Uses: Audit Trail Collector Business Logic Consumer Shadowbase acts as a capture process for change events from the database/audit trail and notifies or delivers them to downstream files, applications, or middleware. 17

Shadowbase for Application Integration Real-Time Fraud Detection ATM/POS Application NonStop-based ATM/POS application feeding transactions into RiskShield (a Unix-based real-time fraud

18 Shadowbase for Application Integration Real-Time Fraud Detection ATM/POS Application NonStop-based ATM/POS application feeding transactions into RiskShield (a Unix-based real-time fraud detection system) ATM/POS Database Business Logic Consumer Shadowbase Audit Trail Collector Fraud Detection Application Business Logic Consumer NonStop Shadowbase UNIX 18

$Shadowbase Shadowbase \NonStop \NonStop \NonStop \NonStop 3) Data Integration Active Data$

19 Shadowbase Multi-Use Case Study Implementations at First Data Corporation 1) Business Continuity Disaster Recovery 2) Business Continuity Active/Active Switch Clients ATMs Shadowbase Shadowbase \NonStop \NonStop \NonStop \NonStop 3) Data Integration Active Data Warehouse/Real-time Fraud Detection Client Services Shadowbase Oracle \NonStop 19

20 Shadowbase Success Stories Active/Passive: Uni-Directional Disaster Recovery Availability Modernization The Old Way BASE24 Regions 1,2,3,4,5 ACI BASE24 Key Issues: Paying for idled system capacity/licenses All users affected at failure More data loss at failure Worse recovery time application not running Non-Shadowbase Uni-Directional Replication Will target application come up??? Target DB read-only (inconsistent for reporting) 20

Shadowbase Success Stories Active/Active: Partitioned Application Users Availability Modernization The New Way BASE24 BASE24 Regions 1 & 2 Regions 3, 4, 5 ACI BASE24 Key Benefits: No idled system

21 Shadowbase Success Stories Active/Active: Partitioned Application Users Availability Modernization The New Way BASE24 BASE24 Regions 1 & 2 Regions 3, 4, 5 ACI BASE24 Key Benefits: No idled system capacity Fewer users affected at failure Less data loss at failure Partitioned Regions Shadowbase Bi-Directional Replication Faster recovery time - application already running Failover to known-working system Both DB s active/available for application work 21

22 What s Next for Shadowbase Sync Replication Shadowbase ZDL (Zero Data Loss) Shadowbase Synchronous Data Replication Engine with Guaranteed Data Delivery (Zero Data Loss at Failure) Incorporates HP TMF Synchronous Gateway API o Working with HP TMF Development on Various Enhancements Active/Passive, SZT, and Active/Active Architectures Supported o Data Collisions Possible File/Table and TX Level Granularity POC Completed, Beta Programs Underway Sync Replication Shadowbase ZDL Plus SR Leverages Shadowbase ZDL Architecture to Provide: o o Zero Data Loss if a Failure Collision Avoidance for Active/Active Architectures Beta Program to Follow Shadowbase ZDL Interested in Learning More? See Separate Presentation on Shadowbase Synchronous Replication NOTE: Shadowbase ZDL and Shadowbase ZDL Plus SR are future technologies and require HP s NonStop Synchronous Replication Gateway; specifications are subject to change without notice and delivery dates are not guaranteed 22

23 Why Choose Shadowbase? Proven Technology Shadowbase is deployed at hundreds of sites, including many of the most-demanding NonStop sites Flexible Solutions for Your Business Challenges Business Continuity, Data Integration & Synchronization, Data Warehouse Feeds, Application Integration, Real-time Business Intelligence Global 24x7 Support Organization Gravic s expert global 24x7 support organization partners with our local reseller support New Strategic Alliances with HP in Process Affordable, and Committed to the NonStop Platform Improves TCO via Overall Cost Advantage and Features o One Product, Many Solutions We are partnering and investing with HP in many innovative enhancements o Only on NonStop 23

For More Information Breaking the Availability Barrier Book

Volume 2 Achieving Century Uptimes with Active/Active Volume

for Case Studies, Executive Briefs, and White Papers:

24 For More Information Breaking the Availability Barrier Book Series Volume 1 Survivable Systems for Enterprise Computing Volume 2 Achieving Century Uptimes with Active/Active Volume 3 Active/Active Systems in Practice Also, Visit our Web Site for Case Studies, Executive Briefs, and White Papers:

com SBSales@gravic.com www.gravic.com Phone: +1.610.

25 Questions? Gravic, Inc. 17 General Warren Blvd. Malvern, PA USA Phone: Fax: Find us on 25

26 Supplemental Slides Follow 26

27 Disclaimer This presentation contains forward-looking statements and describes potential technologies that are under consideration, and either do not exist or are only starting to become available there is no guarantee that the technologies described in this presentation will become available on the HP NonStop platform. Specifications are subject to change without notice and delivery dates/timeframes are not guaranteed 27

business continuity architecture for your business needs The question is: When is it okay for your business to

28 Making Continuous Availability the Goal HP NonStop Technology makes localized faulttolerance a reality Shadowbase extends this technology to geographic fault-tolerance, while minimizing risk by selecting the right business continuity architecture for your business needs The question is: When is it okay for your business to be unavailable to your customers? Never? Then let s talk Source: HP Solution Brief # 4AA4-1791ENW 28

Shadowbase for Business Continuity GE Centricity Enterprise Async: Disaster Recovery Protection Classic DR: Active Passive Uni-Directional Disaster Recovery Application active on

capacity mostly unused All users affected at failover More data loss at failover Backup database may be inconsistent Primary Clients All Transactions Uni-Directional Replication

29 Shadowbase for Business Continuity GE Centricity Enterprise Async: Disaster Recovery Protection Classic DR: Active Passive Uni-Directional Disaster Recovery Application active on primary node only Passive node may be used for readonly OLQP Key Issues: Difficult to test backup and failover (requires outage) High testing costs Failover faults occur Backup capacity mostly unused All users affected at failover More data loss at failover Backup database may be inconsistent Primary Clients All Transactions Uni-Directional Replication Backup For these reasons of failover uncertainty, decision to execute failover requires senior management decision which takes more time, extending the outage. 29

Shadowbase for Business Continuity Async: Sizzling-Hot-Takeover (SZT) Step-up from Classic DR: Active Almost Active Backup application hot, database open R/W (improves RTO) Bi-Dir replication

30 Shadowbase for Business Continuity Async: Sizzling-Hot-Takeover (SZT) Step-up from Classic DR: Active Almost Active Backup application hot, database open R/W (improves RTO) Bi-Dir replication configured (facilitates recovery) All transactions routed to one node No data collisions Easy to validate backup - submit verification Tx Failovers easy to test (no outage) Excellent solution when application cannot run fully A/A Key Issues: All user affected at failover More data loss at failover Backup capacity mostly unused Bi-Directional Replication Billing/Customer Service 30

31 Shadowbase for Business Continuity Async: Active-Active No Collisions Active/Active Partitioned: Active Active Applications active on all nodes Bi-Dir replication Applications and/or data partitioned (tx s routed to specific node based on data content) Users load balanced across nodes (pre-assigned a primary node) Avoids data collisions Fewer users affected at failover Less data loss at failover Key Issues: Not all applications/data can be partitioned Imbalanced load distribution More complex to implement Customers A-M Bi-Directional Replication Customers N-Z 31

Shadowbase for Business Continuity Async: Active-Active Collisions can Occur Active/Active Route Anywhere: Active Active Applications active on all nodes Bi-Dir replication Tx s routed anywhere

32 Shadowbase for Business Continuity Async: Active-Active Collisions can Occur Active/Active Route Anywhere: Active Active Applications active on all nodes Bi-Dir replication Tx s routed anywhere Requests evenly load balanced across nodes Fewer users affected at failover Less data loss at failover ATM Switch Bi-Directional Replication Key Issues: Data collisions can occur which must be automatically identified and resolved via application logic embedded into replication engine. (E.g., most recent update wins) More complex to implement 32

33 Shadowbase Success Stories Multi-Shadowbase-Use Case Studies Application and Data Synchronization First Data Corporation Availability Modernization Royal Bank of Canada 33

HPE Shadowbase Key New Features to Solve Business Challenges. May 2018

HPE Shadowbase Key New Features to Solve Business Challenges May 2018 Disclaimer This presentation contains forward-looking statements regarding future operations, product development, product capabilities