Data Warehouse Testing Best practices to improve and sustain Data Quality Getting ready for Serious DevOps
|
|
- Douglas Daniels
- 5 years ago
- Views:
Transcription
1 Data Warehouse Testing Best practices to improve and sustain Data Quality Getting ready for Serious DevOps Ajay Nalabhatla, QA Lead Srihari Gopisetty, Technology Manager Wells Fargo India Solutions 1
2 Abstract In the age of Digital disruption, every organization wants to transform its technology arm in to advance practices - DevOps, to and fulfill the continuous demand from Business. However, all organizations are data driven and they need to realize that the success does not rely only on faster throughput and speed but also on the ability to access the diverse, large volume of complex data at real time to make strategic decisions. Important question is Does the organization have Quality Data? On average, U.S. organizations believe 32% of their data is inaccurate -Gartner Average organization loses $8.2 million annually due to poor Data Quality. -Experian Less than 0.5% of all data is every analyzed -Forrester Even as many organizations are establishing the Data Warehouse Testing as specialized service, recent surveys indicate that much more improvements needs to be done. It is a call to-action for organizations to address Data Quality gaps 2
3 Setting the context Data are of high quality "if they are fit for their intended uses in operations, decision making and planning. J.M.Juran (Source dqglossary.com) Data Quality Issue Drivers QA Key Causes Unavailability of Complete Data No Exhaustive Validation Consistency Accuracy ETL Transformation Missing Defined Test Strategies Validity Dimension Integrity Delayed Batch SLA Lack of Tools / Accelerators Incomplete DB Objects Validation Timeliness Completeness Batch Performance Missing End -to- End QA Framework Obsolete Jobs & Records Missing Standard Process REMEMBER : Poor Data Quality = Use of Less Information for Decision Making 3
4 Where, What, Why Heterogeneous Sources Staging/ODS Data Warehouse Applications BI DB OLTP OLAP Internal Sources Ascii Xml ETL Tables Other DB Objects Views ETL Views DB Objects Reports Ebcdic External Sources Extracts Downstream Apps Extracts Downstream Apps High Level Tests Static Testing ETL Transformatio n Testing Staging /ODS Validation Data Warehouse Validation Data Quality & Objects Validation Batch Performance BI Testing / Extracts High Medium Low 4
5 QA Framework For High Quality Exhaustive validation at every intermediate check point Runbook and scheduler/dependence validations Data Integrity Validation RI checks etc. Database Objects Validation Partitions, Synonyms, Flashback etc. Heterogeneous sources validation Xml/Ascii /Ebcdic Batch Performance Execution Database Privileges validation at Table/View/Report Level BI reports UI,Data & Performance validation 5
6 Specialized Testing Database Object Validation - Partition Users View DBA s View Test Strategy Database Table Regression Day Wise Partition Interval & Merge Purge >13M Test Flow Day2 Feb 17 Feb 17 Day3 Day 31 Jan 17 Feb 18 Dec 17 Feb 18 Source Inside DB Table 1 st time Load Daily Loads Monthly Purge >13 Months 6
7 Automation Possibility = Automation possibility Extracts Market Tools Parameter Home Grown Tools External Tools Static Testing Limited Limited Source File Metadata / Layout / Fields Order Yes Macro / UNIX Shell Yes Exhaustive Validation Diff Server DB s Yes Macro / UNIX Shell Yes for Both Batch Job execution in sequence Yes - UNIX No Heterogeneous File Load & Comparison (ASCII / XML / EBCEDIC) Yes ASCII / XML only Yes Regression Testing Tables /Extracts Yes Macro / UNIX Yes Data Quality checks Yes Macro / UNIX Yes Table Metadata validation Yes Macro / UNIX Yes BI Reports Validation (Data /Graphs) Yes Only Data Yes Batch Performance Testing Yes -UNIX Yes Yes Macro using ODBC / UNIX Yes Views Validation Partition /Index validation No No Test Cases Batch Execution yes Unix / Excel Yes Automate Test Execution Scheduler yes Unix Yes 7
8 Integrate the ETL testing In DevOps Usual Architecture for ETL Static Testing ETL/DW Testing Batch Performance Testing 8
9 Demo Overview CD CT CI Static Testing ETL/DW Testing Batch Performance Testing 9
10 Sources & ETL Jobs ETL Jobs SQL - Test cases Shell Script 10
11 Data Validation Test case.sql file.sql in Script MySQL Test 11
12 Jenkins Dashboard
13 Jenkins First job Creation
14 Adding Subsequent job(s)
15 ETL Test case Execution Job
16 Dependency Scheduling for Pipeline
17 GitHub Add WebHook with Jenkins
18 Jenkins GitHub for Automatic Triggering Jenkins Scheduling using Poll Feature
19 GitHub, Add files to GitHub
20 Pipeline For Sequence Execution Batch Execution Start Green =Success Batch Execution Finish
21 Console o/p for jobs
22 Final Pipeline O/p Test Results document on Jenkins Test Results on Linux
23 Build Execution History - Useful for Batch performance testing 23
24 DevOps Readiness Require thorough knowledge on Line of Business Data flow Runbook availability following predecessors & successors Identification of suitable Test approach based on project types Pre-Requisites Availability of Test data that represent all needs Alternative analysis to avoid table unusable state issues Ensure table Referential Integrity is addressed Availability of TDM team for table refresh to previous state in case of failures Batch performance SLA prediction Focus about - Cultural, Process and Tools 24
25 Benefits Improved Business confidence on Quality Blueprint That helps companies to gear up Possible Faster Iteration, Quick Feedback, Great Collaboration Low-priced Automation possibilities Insights on various Database Object Validations Early Defect Detection 25
26 26
27 Author Biography Ajay Nalabhatla Ajay Nalabhatla works as a Data Management QA Lead at WellsFargo for a Line of Business. He has around 11+ years of experience in Quality Assurance for ETL, DWT & BI Testing. Over a decade, he has involved in various DWT projects for different Banking & Securities Clients and delivered them successfully. He was also involved in conducting the Due Diligence for various DWT clients and also suggested them many improvements in both process and Technical competencies. Ajay s holds Bachelor of Engineering in Electronics & communication from Anna University Srihari Gopisetty Srihari Gopisetty is managing the Data Management and Digital Advisory Teams for a Line of Business at Wells Fargo India Solutions. He has more than 17 years of rich experience in leading teams for BFSI Domain and Microsoft Products. Prior to Wells Fargo, he has worked with Microsoft, First Advantage Srihari s educational background includes Bachelor of Engineering in Mechanical from Gulbarga University 27
28 References & Appendix
29 APPENDIX 29
30 Test Approach - Data Migration Pre - Migration Post -Migration Steady State Analyze Db and identify the objects Tables/Indexes/views Compare all DB objects Between Legacy & New Steady state Validations for Monthly loads Segregate wave wise plan - Forklift,Consolidation, static, Dynamic tables /views Validate data for all tables b/w legacy & new identified for migration Downstream App s support Validate New tables transformation rules are as per specs Take the snapshot for Post comparison Parallel load comparison for tables between legacy & new Validate Purging process is as expected for New system Prioritize / Create Batch & collect pre-run stats Execute Batch performance testing & compare stats with Legacy Performance Monitoring for Data Load 30
31 Infrastructure Upgrade Test Strategy - ETL tool /Scheduler tool upgrade Job Types Direct SQL processing Pre Migration Test Strategy Identify the various types of jobs Identify the Priority Jobs for phase wise execution Build run book for the phases with all dependencies Collect the batch statistics Take the snapshots of relevant table data ETL Jobs File watcher / Legacy jobs using c/c++ Store Procedure jobs Post Migration Steady State Execute the identified jobs on upgrade system Validate the batch / job performance with pre-stats Regression Testing for tables Parallel Load processing & data validation Validate Job dependencies and predecessors Batch performance monitoring. Analyse the failures to understand if they are upgrade related Steady state support for downstream applications 31
32 Thank You!!! 32
Test Automation Strategies in Continuous Delivery. Nandan Shinde Test Automation Architect (Tech CoE) Cognizant Technology Solutions
Test Automation Strategies in Continuous Delivery Nandan Shinde Test Automation Architect (Tech CoE) Cognizant Technology Solutions The world of application is going through a monumental shift.. Evolving
More informationJOB TITLE: Senior Database Administrator PRIMARY JOB DUTIES Application Database Development
JOB TITLE: Senior Database Administrator The Senior Database Administrator is responsible for managing multiple production and nonproduction Oracle, MSSQL, and PostgreSQL databases: 4 production Oracle
More informationData Virtualization Implementation Methodology and Best Practices
White Paper Data Virtualization Implementation Methodology and Best Practices INTRODUCTION Cisco s proven Data Virtualization Implementation Methodology and Best Practices is compiled from our successful
More informationFEATURES BENEFITS SUPPORTED PLATFORMS. Reduce costs associated with testing data projects. Expedite time to market
E TL VALIDATOR DATA SHEET FEATURES BENEFITS SUPPORTED PLATFORMS ETL Testing Automation Data Quality Testing Flat File Testing Big Data Testing Data Integration Testing Wizard Based Test Creation No Custom
More informationDATAWAREHOUSING AND ETL PROCESSES: An Explanatory Research
DATAWAREHOUSING AND ETL PROCESSES: An Explanatory Research Priyanshu Gupta ETL Software Developer United Health Group Abstract- In this paper, the author has focused on explaining Data Warehousing and
More informationWhat is database continuous integration?
What is database continuous integration? Database continuous integration (CI) is the rapid integration of database schema and logic changes into application development efforts and to provide immediate
More informationQuality Engineering in DevOps world a Strategic Enabler
www.cigniti.com Unsolicited Distribution is Restricted. Copyright 2015-16, Cigniti Technologies Quality Engineering in DevOps world a Strategic Enabler » Analyst Speak» DevOps in a nutshell» DevOps vs
More informationFIVE BEST PRACTICES FOR ENSURING A SUCCESSFUL SQL SERVER MIGRATION
FIVE BEST PRACTICES FOR ENSURING A SUCCESSFUL SQL SERVER MIGRATION The process of planning and executing SQL Server migrations can be complex and risk-prone. This is a case where the right approach and
More informationIBM s Integrated Data Management Solutions for the DBA
Information Management IBM s Integrated Data Management Solutions for the DBA Stop Stressing and Start Automating! Agenda Daily Woes: Trials and tribulations of the DBA Business Challenges: Beyond the
More informationPro Tech protechtraining.com
Course Summary Description This course provides students with the skills necessary to plan, design, build, and run the ETL processes which are needed to build and maintain a data warehouse. It is based
More informationWORK EXPERIENCE: Client: On Time BI, Dallas, TX Project: Sr. BODI Developer
Experience Summary: Well versed in Application Design, Data Extraction, Data Acquisition, Data Mining, Development, Implementations & Testing of Data warehousing & Database business systems. Data modeling
More informationHow Can Testing Teams Play a Key Role in DevOps Adoption?
June 3, 2016 How Can Testing Teams Play a Key Role in DevOps Adoption? Sujay Honnamane QA Director @sujayh Rameshkumar Bar Sr. Automation Architect @rameshbar 2016 Cognizant Session take away DevOps Overview
More informationAppScan Deployment APPLICATION SECURITY SERVICES. Colin Bell. Applications Security Senior Practice Manager
APPLICATION SECURITY SERVICES AppScan Deployment Colin Bell Applications Security Senior Practice Manager Copyright 2017 HCL Products & Platforms www.hcltech.com The Evolution of Devops 2001 - Continuous
More informationSAP HANA Inspirience Day
SAP HANA Inspirience Day Best practice ingredients for a successful SAP HANA project Maurice Sens SAP Lead Architect, T-Systems Nederland Today's issues with SAP Business Warehouse and SAP systems. Massive
More informationThis tutorial will help computer science graduates to understand the basic-to-advanced concepts related to data warehousing.
About the Tutorial A data warehouse is constructed by integrating data from multiple heterogeneous sources. It supports analytical reporting, structured and/or ad hoc queries and decision making. This
More informationStreaming analytics better than batch - when and why? _Adam Kawa - Dawid Wysakowicz_
Streaming analytics better than batch - when and why? _Adam Kawa - Dawid Wysakowicz_ About Us At GetInData, we build custom Big Data solutions Hadoop, Flink, Spark, Kafka and more Our team is today represented
More informationActifio Test Data Management
Actifio Test Data Management Oracle MS SQL Faster Time To Market Start Release Time To Market (TTM) Finish Faster App Releases Faster Application Releases Faster TTM Increases Revenue Market Share Competitive
More informationDATA MINING AND WAREHOUSING
DATA MINING AND WAREHOUSING Qno Question Answer 1 Define data warehouse? Data warehouse is a subject oriented, integrated, time-variant, and nonvolatile collection of data that supports management's decision-making
More informationEnterprise Data Architect
Enterprise Data Architect Position Summary Farmer Mac maintains a considerable repository of financial data that spans over two decades. Farmer Mac is looking for a hands-on technologist and data architect
More informationBuilding a Data Strategy for a Digital World
Building a Data Strategy for a Digital World Jason Hunter, CTO, APAC Data Challenge: Pushing the Limits of What's Possible The Art of the Possible Multiple Government Agencies Data Hub 100 s of Service
More informationDatacenter Management and The Private Cloud. Troy Sharpe Core Infrastructure Specialist Microsoft Corp, Education
Datacenter Management and The Private Cloud Troy Sharpe Core Infrastructure Specialist Microsoft Corp, Education System Center Helps Deliver IT as a Service Configure App Controller Orchestrator Deploy
More informationThinkPalm s BreakThrough DevOps Capabilities ThinkPalm
ThinkPalm s BreakThrough DevOps Capabilities ThinkPalm Dev Ops Business Planning Collaborative Development Customer Feedback & Optimization Testing Monitoring Release and Deployment STANDARDS OPERATE DEPLOY
More informationTHE STATE OF DATA QUALITY
THE STATE OF DATA QUALITY HOW TO START A DATA QUALITY PROGRAM Organizations claim to make decisions based on data, but are they really? Ask a few simple questions of the data they are using for those presumed
More informationTest Automation for data teams with Tosca BI
Data migration / DWH / BI testing Test Automation for data teams with Tosca BI By Daina Dirmaitė I Nov 13, 2018 Data Testing Challenges 1. Data models and data mapping documents in many ways represent
More informationOptimizing and Modeling SAP Business Analytics for SAP HANA. Iver van de Zand, Business Analytics
Optimizing and Modeling SAP Business Analytics for SAP HANA Iver van de Zand, Business Analytics Early data warehouse projects LIMITATIONS ISSUES RAISED Data driven by acquisition, not architecture Too
More informationOperating Systems: MS DOS, WINDOWS 3.1, 95, 98, WINDOWS 2000, WINDOWS NT & XP, UNIX various server platforms.
IBRAHIM ABE GARBA 5993 Brookmont Dr, Columbus, Ohio 43026 Web Site: www.abeitconsulting.com Cell: 614 562 8471 E Mail: iagarba@gmail.com EDUCATION Master of Science in Information Resource Management,
More informationAutomated Testing of Tableau Dashboards
Kinesis Technical Whitepapers April 2018 Kinesis CI Automated Testing of Tableau Dashboards Abstract Companies make business critical decisions every day, based on data from their business intelligence
More informationRDP203 - Enhanced Support for SAP NetWeaver BW Powered by SAP HANA and Mixed Scenarios. October 2013
RDP203 - Enhanced Support for SAP NetWeaver BW Powered by SAP HANA and Mixed Scenarios October 2013 Disclaimer This presentation outlines our general product direction and should not be relied on in making
More informationWHITE PAPER. Moving Fragmented Test Data Management Towards a Centralized Approach. Abstract
WHITE PAPER Moving Fragmented Test Data Management Towards a Centralized Approach Abstract Test Data Management (TDM) ensures managing test data requests in an automated way to ensure a high degree of
More informationAbstract. Duplicate record checks
Profile Koushik Kadimcherla is a Test Analyst with Infosys Limited. He has 4.4 years of experience in the IT industry. Koushik has been working on Data warehouse testing projects from the past 4 years.
More informationShift Left Testing: are you ready? Live Webinar, Sept 19
Shift Left Testing: are you ready? Live Webinar, Sept 19 Guy Arieli CTO, Experitest 01 What exactly is Shift Left? Agenda 02 03 How Shift Left affects application development & testing organizational structures
More informationC_HANAIMP142
C_HANAIMP142 Passing Score: 800 Time Limit: 4 min Exam A QUESTION 1 Where does SAP recommend you create calculated measures? A. In a column view B. In a business layer C. In an attribute view D. In an
More informationEvaluation Checklist Data Warehouse Automation
Evaluation Checklist Data Warehouse Automation October 2017 General Principles Requirement Question Ajilius Response Primary Deliverable Is the primary deliverable of the project a data warehouse, or is
More informationDesigning your BI Architecture
IBM Software Group Designing your BI Architecture Data Movement and Transformation David Cope EDW Architect Asia Pacific 2007 IBM Corporation DataStage and DWE SQW Complex Files SQL Scripts ERP ETL Engine
More informationPerform scalable data exchange using InfoSphere DataStage DB2 Connector
Perform scalable data exchange using InfoSphere DataStage Angelia Song (azsong@us.ibm.com) Technical Consultant IBM 13 August 2015 Brian Caufield (bcaufiel@us.ibm.com) Software Architect IBM Fan Ding (fding@us.ibm.com)
More informationWHITE PAPER. Leveraging Database Virtualization for Test Data Management. Abstract. Vikas Dewangan, Senior Technology Architect, Infosys
WHITE PAPER Leveraging ization for Test Data Management Vikas Dewangan, Senior Technology Architect, Infosys Abstract virtualization is an emerging trend in test data management (TDM) and is all set to
More informationArchitectural challenges for building a low latency, scalable multi-tenant data warehouse
Architectural challenges for building a low latency, scalable multi-tenant data warehouse Mataprasad Agrawal Solutions Architect, Services CTO 2017 Persistent Systems Ltd. All rights reserved. Our analytics
More informationMIGRATING SAP WORKLOADS TO AWS CLOUD
MIGRATING SAP WORKLOADS TO AWS CLOUD Cloud is an increasingly credible and powerful infrastructure alternative for critical business applications. It s a great way to avoid capital expenses and maintenance
More informationTop Trends in DBMS & DW
Oracle Top Trends in DBMS & DW Noel Yuhanna Principal Analyst Forrester Research Trend #1: Proliferation of data Data doubles every 18-24 months for critical Apps, for some its every 6 months Terabyte
More informationETL Best Practices and Techniques. Marc Beacom, Managing Partner, Datalere
ETL Best Practices and Techniques Marc Beacom, Managing Partner, Datalere Thank you Sponsors Experience 10 years DW/BI Consultant 20 Years overall experience Marc Beacom Managing Partner, Datalere Current
More informationData-Intensive Distributed Computing
Data-Intensive Distributed Computing CS 451/651 431/631 (Winter 2018) Part 5: Analyzing Relational Data (1/3) February 8, 2018 Jimmy Lin David R. Cheriton School of Computer Science University of Waterloo
More informationOracle GoldenGate and Oracle Streams: The Future of Oracle Replication and Data Integration
Oracle GoldenGate and Oracle Streams: The Future of Oracle Replication and Data Integration Sachin Chawla, Ali Kutay, Juan Loaiza, Hasan Rizvi Oracle Corporation The following is intended to outline our
More informationREGULATORY REPORTING FOR FINANCIAL SERVICES
REGULATORY REPORTING FOR FINANCIAL SERVICES Gordon Hughes, Global Sales Director, Intel Corporation Sinan Baskan, Solutions Director, Financial Services, MarkLogic Corporation Many regulators and regulations
More informationThe Data Organization
C V I T F E P A O TM The Data Organization 1251 Yosemite Way Hayward, CA 94545 (510) 303-8868 rschoenrank@computer.org Business Intelligence Process Architecture By Rainer Schoenrank Data Warehouse Consultant
More informationMicrosoft Azure Databricks for data engineering. Building production data pipelines with Apache Spark in the cloud
Microsoft Azure Databricks for data engineering Building production data pipelines with Apache Spark in the cloud Azure Databricks As companies continue to set their sights on making data-driven decisions
More informationCOGNOS DYNAMIC CUBES: SET TO RETIRE TRANSFORMER? Update: Pros & Cons
COGNOS DYNAMIC CUBES: SET TO RETIRE TRANSFORMER? 10.2.2 Update: Pros & Cons GoToWebinar Control Panel Submit questions here Click arrow to restore full control panel Copyright 2015 Senturus, Inc. All Rights
More informationWHITEPAPER. Database DevOps with the Redgate Deployment Suite for Oracle
WHITEPAPER Database DevOps with the Redgate Deployment Suite for Oracle 1 Abstract Building great software is never just about the code. It s also about managing multiple teams, timelines, and frequently
More information2018 Database DevOps Survey DBmaestro 1
2018 Database DevOps Survey 2017 DBmaestro 1 Table of Contents Executive Summary... 3 What Percentage of IT Projects in Your Company Use a DevOps Approach?... 4 Integration of DBAs with DevOps Teams...
More informationThe Future of Testing
The Future of Testing Wolfgang Platz, Founder & Chief Strategy Officer. awards Leader Gartner MQ founded 2008 Leader Forrester Wave locations Austria Germany Switzerland United Kingdom The Netherlands
More informationPagely.com implements log analytics with AWS Glue and Amazon Athena using Beyondsoft s ConvergDB
Pagely.com implements log analytics with AWS Glue and Amazon Athena using Beyondsoft s ConvergDB Pagely is the market leader in managed WordPress hosting, and an AWS Advanced Technology, SaaS, and Public
More informationAccelerated SQL Server 2012 Integration Services
1 Accelerated SQL Server 2012 Integration Services 4 Days (BI-ISACL12-301-EN) Description This 4-day instructor led training focuses on developing and managing SSIS 2012 in the enterprise. In this course,
More informationHoping my knowledge, skills and experience could be used by you and your company I appreciate in advance your time and consideration.
To Whom It May Concern: My name is Juan Jose Luna Castillo, born in Mexico City where I achieved a Bachelor s Degree in Electronics from the Universidad del Valle de Mexico. With over fourteen-year experience
More informationInstant Data Warehousing with SAP data
Instant Data Warehousing with SAP data» Extracting your SAP data to any destination environment» Fast, simple, user-friendly» 8 different SAP interface technologies» Graphical user interface no previous
More informationData Synchronization Data Replication Data Migration Data Distribution
Data Synchronization Data Replication Data Migration Data Distribution The right data in the right place at the right time. tcvision...is a cross-system solution for the timely, bidirectional data synchronization
More informationNext Generation Backup: Better ways to deal with rapid data growth and aging tape infrastructures
Next Generation Backup: Better ways to deal with rapid data growth and aging tape infrastructures Next 1 What we see happening today. The amount of data businesses must cope with on a daily basis is getting
More informationFrom the Source to the Dashboard: SAP Agile Data Warehousing for Self-Service BI
From the Source to the Dashboard: SAP Agile Data Warehousing for Self-Service BI Michael D Rutland, Sr SE, SAP / @TDWI, 9 October 2017, Savannah Disclaimer The information in this presentation is confidential
More informationCA Test Data Manager Key Scenarios
WHITE PAPER APRIL 2016 CA Test Data Manager Key Scenarios Generate and secure all the data needed for rigorous testing, and provision it to highly distributed teams on demand. Muhammad Arif Application
More informationHow to Keep UP Through Digital Transformation with Next-Generation App Development
How to Keep UP Through Digital Transformation with Next-Generation App Development Peter Sjoberg Jon Olby A Look Back, A Look Forward Dedicated, data structure dependent, inefficient, virtualized Infrastructure
More informationModule 1.Introduction to Business Objects. Vasundhara Sector 14-A, Plot No , Near Vaishali Metro Station,Ghaziabad
Module 1.Introduction to Business Objects New features in SAP BO BI 4.0. Data Warehousing Architecture. Business Objects Architecture. SAP BO Data Modelling SAP BO ER Modelling SAP BO Dimensional Modelling
More informationOracle Database and Application Solutions
Oracle Database and Application Solutions Overview The success of Oracle s products is based on three principles: Simplify Enterprises must increase the speed of information delivery with Integrated Systems,
More informationTest Automation: Agile Enablement for Business Intelligence Teams
Test Automation: Agile Enablement for Business Intelligence Teams Lynn Winterboer Agile Analytics Educator & Coach @AgileLynn www.winterboeragileanalytics.com Lynn Winterboer Colorado Native Guest Ranch
More informationData Science Services Dirk Engfer Page 1 of 5
Page 1 of 5 Services SAS programming Conform to CDISC SDTM and ADaM within clinical trials. Create textual outputs (tables, listings) and graphical output. Establish SAS macros for repetitive tasks and
More informationIBM Software IBM InfoSphere Information Server for Data Quality
IBM InfoSphere Information Server for Data Quality A component index Table of contents 3 6 9 9 InfoSphere QualityStage 10 InfoSphere Information Analyzer 12 InfoSphere Discovery 13 14 2 Do you have confidence
More informationMicrosoft Exam
Volume: 42 Questions Case Study: 1 Relecloud General Overview Relecloud is a social media company that processes hundreds of millions of social media posts per day and sells advertisements to several hundred
More informationHP APPs v.12 Solutions for Dev-Ops
HP APPs v.12 Solutions for Dev-Ops Kimberly Fort HP Software July 2014 Kimberly Fort Software Solutions Architect *5 Months with HP *17 Years experience using HP Tools & products *20 Years experience in
More information[3] Anon 2001, Microsoft SQL Server 2005, Microsoft Corporation, Washington, U.S.A.
References: [1] Accelerated Edge Incorporated 2012, How to Select Business Intelligence Query Tools, [Online], Available from: http://www.databi.com/downloads/bitools.pdf [Accessed 5 December 2012]. [2]
More information1 Dulcian, Inc., 2001 All rights reserved. Oracle9i Data Warehouse Review. Agenda
Agenda Oracle9i Warehouse Review Dulcian, Inc. Oracle9i Server OLAP Server Analytical SQL Mining ETL Infrastructure 9i Warehouse Builder Oracle 9i Server Overview E-Business Intelligence Platform 9i Server:
More informationAssuring Certainty through Effective Regression Testing. Vishvesh Arumugam
Assuring Certainty through Effective Regression Testing Vishvesh Arumugam Agenda Introduction The Problem Magnitude Management Regression Test Efficiency Solution and Approach Test Suite Maintenance Determining
More informationFour Steps to Unleashing The Full Potential of Your Database
Four Steps to Unleashing The Full Potential of Your Database This insightful technical guide offers recommendations on selecting a platform that helps unleash the performance of your database. What s the
More informationTop 20 Data Quality Solutions for Data Science
Top 20 Data Quality Solutions for Data Science Data Science & Business Analytics Meetup Boulder, CO 2014-12-03 Ken Farmer DQ Problems for Data Science Loom Large & Frequently 4000000 Strikingly visible
More informationThe Pathway to the Cloud Using Azure SQL Managed Instance
1 Sales Order Management Product Manuals 2 Agility Assurance (Security) Efficiency Experience (Apps) Business Growth 3 Catalog Existing application Define criteria for moving to or starting applications
More information70-532: Developing Microsoft Azure Solutions
70-532: Developing Microsoft Azure Solutions Exam Design Target Audience Candidates of this exam are experienced in designing, programming, implementing, automating, and monitoring Microsoft Azure solutions.
More informationThe Seven Steps to Implement DataOps
The Seven Steps to Implement Ops ABSTRACT analytics teams challenged by inflexibility and poor quality have found that Ops can address these and many other obstacles. Ops includes tools and process improvements
More informationWhitepaper: Back Up SAP HANA and SUSE Linux Enterprise Server with SEP sesam. Copyright 2014 SEP
Whitepaper: Back Up SAP HANA and SUSE Linux Enterprise Server with SEP sesam info@sepusa.com www.sepusa.com Table of Contents INTRODUCTION AND OVERVIEW... 3 SOLUTION COMPONENTS... 4-5 SAP HANA... 6 SEP
More informationCloudSwyft Learning-as-a-Service Course Catalog 2018 (Individual LaaS Course Catalog List)
CloudSwyft Learning-as-a-Service Course Catalog 2018 (Individual LaaS Course Catalog List) Microsoft Solution Latest Sl Area Refresh No. Course ID Run ID Course Name Mapping Date 1 AZURE202x 2 Microsoft
More informationAppliances and DW Architecture. John O Brien President and Executive Architect Zukeran Technologies 1
Appliances and DW Architecture John O Brien President and Executive Architect Zukeran Technologies 1 OBJECTIVES To define an appliance Understand critical components of a DW appliance Learn how DW appliances
More informationHorizontal Scaling Solution using Linux Environment
Systems Software for the Next Generation of Storage Horizontal Scaling Solution using Linux Environment December 14, 2001 Carter George Vice President, Corporate Development PolyServe, Inc. PolyServe Goal:
More informationDistributed CI: Scaling Jenkins on Mesos and Marathon. Roger Ignazio Puppet Labs, Inc. MesosCon 2015 Seattle, WA
Distributed CI: Scaling Jenkins on Mesos and Marathon Roger Ignazio Puppet Labs, Inc. MesosCon 2015 Seattle, WA About Me Roger Ignazio QE Automation Engineer Puppet Labs, Inc. @rogerignazio Mesos In Action
More informationSOFTWARE ARCHITECTURE & DESIGN INTRODUCTION
SOFTWARE ARCHITECTURE & DESIGN INTRODUCTION http://www.tutorialspoint.com/software_architecture_design/introduction.htm Copyright tutorialspoint.com The architecture of a system describes its major components,
More informationData Center Management and Automation Strategic Briefing
Data Center and Automation Strategic Briefing Contents Why is Data Center and Automation (DCMA) so important? 2 The Solution Pathway: Data Center and Automation 2 Identifying and Addressing the Challenges
More informationIBM InfoSphere Information Analyzer
IBM InfoSphere Information Analyzer Understand, analyze and monitor your data Highlights Develop a greater understanding of data source structure, content and quality Leverage data quality rules continuously
More informationUsing Layered Model-Based Requirements to achieve Continuous Testing
Using Layered Model-Based to achieve Continuous Testing Alex Martins CTO Continuous Testing CA Technologies October 2017 1 11 years ago In A Galaxy Not Far Away http://projectcartoon.com Gap in CD Pipeline
More informationAzure Data Factory VS. SSIS. Reza Rad, Consultant, RADACAD
Azure Data Factory VS. SSIS Reza Rad, Consultant, RADACAD 2 Please silence cell phones Explore Everything PASS Has to Offer FREE ONLINE WEBINAR EVENTS FREE 1-DAY LOCAL TRAINING EVENTS VOLUNTEERING OPPORTUNITIES
More informationSTATE OF MODERN APPLICATIONS IN THE CLOUD
STATE OF MODERN APPLICATIONS IN THE CLOUD 2017 Introduction The Rise of Modern Applications What is the Modern Application? Today s leading enterprises are striving to deliver high performance, highly
More informationBI ENVIRONMENT PLANNING GUIDE
BI ENVIRONMENT PLANNING GUIDE Business Intelligence can involve a number of technologies and foster many opportunities for improving your business. This document serves as a guideline for planning strategies
More informationDEPARTMENT OF THE AIR FORCE PRESENTATION TO THE SUBCOMMITTEE ON STRATEGIC FORCES U.S. HOUSE OF REPRESENTATIVES
NOT FOR PUBLICATION UNTIL RELEASED BY THE UNITED STATES HOUSE OF REPRESENTATIVES DEPARTMENT OF THE AIR FORCE PRESENTATION TO THE U.S. HOUSE OF REPRESENTATIVES SUBJECT: Assuring National Security Space:
More informationThe Future of Testing: Continuous Enterprise Testing
The Future of Testing: Continuous Enterprise Testing ANZTB Test Conference, Canberra, 1 June 2018 Thomas Hadorn. Dev Ops Years Months Months Weeks Delivery Cycle Time Weeks Days Perceived Disruption Software
More informationCHAPTER 3 Implementation of Data warehouse in Data Mining
CHAPTER 3 Implementation of Data warehouse in Data Mining 3.1 Introduction to Data Warehousing A data warehouse is storage of convenient, consistent, complete and consolidated data, which is collected
More informationGo USA! Get There Faster. 6/29/2010 Process World
Go USA! Get There Faster. 6/29/2010 Process World 2010 2 Go Germany! Get There Faster. BPM + BI = Process Intelligence Top 10 Business Priorities Rank Top 10 Technology Priorities Rank Business process
More informationContinuous Integration and Deployment (CI/CD)
WHITEPAPER OCT 2015 Table of contents Chapter 1. Introduction... 3 Chapter 2. Continuous Integration... 4 Chapter 3. Continuous Deployment... 6 2 Chapter 1: Introduction Apcera Support Team October 2015
More informationAccelerate your SAS analytics to take the gold
Accelerate your SAS analytics to take the gold A White Paper by Fuzzy Logix Whatever the nature of your business s analytics environment we are sure you are under increasing pressure to deliver more: more
More informationBig Data Technology Ecosystem. Mark Burnette Pentaho Director Sales Engineering, Hitachi Vantara
Big Data Technology Ecosystem Mark Burnette Pentaho Director Sales Engineering, Hitachi Vantara Agenda End-to-End Data Delivery Platform Ecosystem of Data Technologies Mapping an End-to-End Solution Case
More informationInfosys. Working on Application Slowness in Mainframe Infrastructure- Best Practices-Venkatesh Rajagopalan
Infosys Working on Application Slowness in Mainframe Infrastructure- Best Practices-Venkatesh Rajagopalan Summary Abstract An energy utility client was facing real-time infrastructure issues owing to the
More informationAzure Day Application Development. Randy Pagels Sr. Developer Technology Specialist US DX Developer Tools - Central Region
Azure Day Application Development Randy Pagels Sr. Developer Technology Specialist US DX Developer Tools - Central Region Azure App Service.NET, Java, Node.js, PHP, Python Auto patching Auto scale Integration
More informationSafe Harbor Statement
Safe Harbor Statement The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment
More informationTalend Big Data Sandbox. Big Data Insights Cookbook
Overview Pre-requisites Setup & Configuration Hadoop Distribution Download Demo (Scenario) Overview Pre-requisites Setup & Configuration Hadoop Distribution Demo (Scenario) About this cookbook What is
More informationDATA WAREHOUSE- MODEL QUESTIONS
DATA WAREHOUSE- MODEL QUESTIONS 1. The generic two-level data warehouse architecture includes which of the following? a. At least one data mart b. Data that can extracted from numerous internal and external
More informationA primer to SQL Server 2012
A primer to SQL Server 2012 Many industry insiders have declared SQL Server 2012 to be the strongest version Microsoft has released in a long time. The 2012 edition offers new features geared toward enterprises
More informationHybrid Backup & Disaster Recovery. Back Up SAP HANA and SUSE Linux Enterprise Server with SEP sesam
Hybrid Backup & Disaster Recovery Back Up SAP HANA and SUSE Linux Enterprise Server with SEP sesam 1 Table of Contents 1. Introduction and Overview... 3 2. Solution Components... 3 3. SAP HANA: Data Protection...
More informationDiscover the all-flash storage company for the on-demand world
Discover the all-flash storage company for the on-demand world STORAGE FOR WHAT S NEXT The applications we use in our personal lives have raised the level of expectations for the user experience in enterprise
More information