Hitachi Vantara Overview Pentaho 8.0 and 8.1 Roadmap. Pedro Alves

Transcription

1 Hitachi Vantara Overview Pentaho 8.0 and 8.1 Roadmap Pedro Alves

2 Safe Harbor Statement The forward-looking statements contained in this document represent an outline of our current intended product direction. It is provided for information purposes only and is not a commitment to deliver any new or enhanced product or functionality, or that we will pursue the product direction described. Facts and circumstances may occur which may impact current plans, resulting in changes to the information in this presentation. This information is current only as of the date it is made and should not be relied upon in making purchasing decisions. The development, release (if at all), and timing of any features or functionality described for the Pentaho products remains at the sole discretion of Pentaho.

3 Hitachi Vantara

4 Advanced Analytics Software X as a Service OT/IT Expertise Data Scientists Hitachi Data Systems Hitachi Vantara Pentaho Lumada Partner Ecosystem Infrastructure Vertical Expertise Solutions and Services Machine Learning

5 Hitachi Vantara: A New Company With 100+ Years of Heritage HITACHI VANTARA 10,000 customers 7,000 employees 2,000 partners 100 countries Trusted by 85% of FORTUNE Global 100 RECOGNIZED CULTURE I d posit that the reason these three values have lasted for more than 100 years at Hitachi and will likely last for 100 more is because of the emphasis they place on human relationships. Inc. Magazine HITACHI, LTD. Founded in 1910 US$81.8B FY subsidiaries 304,000 employees #1 worldwide for patent applications in big data analysis foundation technology #71 in the 2017 FORTUNE Global 500

6 Hitachi Vantara Is Trusted by 85% of the FORTUNE Global 100 and 10,000 Customers F I N A N C E I. T. S E R V I C E S H E A L T H C A R E R E T A I L First People s Hospital of Yibin M AN U FA C T U R I N G S E R V I C E S / O T H E R M E D I A T E L E C O M Xinhua News Agency

7 Hitachi Vantara Is Trusted by 85% of the FORTUNE Global 100 and 10,000+ Customers H I T A C H I A N A LY T I C S P O R T F O L I O / P E N T A H O C O R E I N F R A S T R U C T U R E H I T A C H I C O N T E N T P O R T F O L I O First People s Hospital of Yibin Xinhua News Agency Xinhua News Agency

8 Rely on Real, Ongoing Innovation 4,900 R&D employees, $2.8 billion annually committed to R&D 2,500+ patents awarded in technologies for big data analysis 119,000+ patents worldwide Over $5.4B revenue annually from IoT Computerworld: Hitachi Is #1 Most Powerful IoT Company Thomson Reuters: Top 100 Global Innovators

9 Hitachi s Unique Value CITY CLOUD INFRASTRUCTURE Only INDUSTRIAL Hitachi OT IoT Vantara IT combines ANALYTICS deep IT, OT and domain expertise BUSINESS 108 YEARS IS IN OUR DNA 59 YEARS APPLICATIONS CONSUMER BIG DATA

10 Every Company Must Now Be a Technology Company We all need to find the most value in our data. That means fundamental change to business and operations. That s with big data, but Many what have about a REALLY long way big to go: data? Only 40% of industries are truly There will be nearly 21 billion connected digitized (McKinsey) things by 2020 (Gartner)

11 Swimming in Data But Searching for Insight The full potential of data is elusive. A precious few companies have discovered how to find the full value of their data. Hitachi Vantara is a partner with data-driven solutions and services for people who see data as an opportunity.

12 We Help the Two Basic Business Directives: Make Money and Save Money Top-Line Benefit INFRASTRUCTURE MODERNIZATION Private, Public, Hybrid Flash Software-Defined DIGITAL WORKPLACE Enterprise Mobility Content Intelligence Object BUSINESS INSIGHT Data Orchestration Embedded Analytics Data Ingest and Blending INTERNET OF THINGS Asset Avatars Edge to Outcomes Co-Creation Bottom-Line Benefit

13 Our Core Beliefs Data is at the center of all you do and is the key to your transformation. We want you to own your data. Not us. Metadata is the new data. Your data will outlive the application that created it and the underlying infrastructure. We enable you to have your data and insight when, where and how you need it. Hitachi Vantara Corporation All Rights Reserved

14 Our Commitment: Deliver Outcomes That Matter for Business And Society

15 Pentaho 8

16 Future Vision: A Single Consistent Experience Data Engineering Data Prep Analytics Ingestion Processing Blending Data Delivery Data Discovery Analysis & Dashboards Administration Security Lifecycle Management Data Provenance Dynamic Data Pipeline Monitoring Automation

17 Pentaho 8.0 Challenge #1 Data volumes and velocity are growing exponentially Pentaho 8.0 Broadens connectivity to streaming data sources Connect to Kafka streams Stream processing with Spark Big data security with Knox Challenge #2 Processing and storage resources are constrained Pentaho 8.0 Optimizes processing resources Enhanced Adaptive Execution (AEL) Native Avro and Parquet handling Worker nodes for Scale-out Challenge #3 Shortage of Big Data talent and lack of productivity Pentaho 8.0 Boosts team productivity across the pipeline Data explorer filters Improved repository UX Extended operations mart

18 Platform and Scalability Worker Nodes New theme

19 Worker Nodes for Scaling Out Scale work items across multiple nodes (containers) Easily add and remove resources as required Distribute and Scale Worker Node (a) Worker Node (b) Worker Node (c ) Monitor and balance changing workloads Deploy on premise, cloud and hybrid NEW in Pentaho 8.0 Container framework Orchestration framework Node monitoring Enhanced HA implementation

20 Worker Nodes Architecture WORKER NODES Orchestration Framework Orchestration (Scheduler, monitoring, security, etc.) Powered by Pentaho Clients Master (Working) Master (Standby) Controller (HA) Master (Standby) Pentaho Server Container Framework Pentaho Repository WN 1 e.g. KJB WN 2 e.g. KTR WN n Executor

21 New Theme - Ruby

22 Data Integration Streaming support! Run configurations for Jobs Filters in Data Explorer New Open / Save experience

23 Streaming for Time Sensitive Insight Enable use cases that require realtime processing, monitoring and aggregation Real-time device monitoring Log-file aggregation Notifications And more NEW in Pentaho 8.0 Kafka Producer Step Kafka Consumer Step Get records from stream Step Spark streaming via AEL

24 Run configurations for Jobs Run Configuration Execute on server Leverage worker nodes

25 Pentaho 7.0 Data Explorer Access visualizations during data prep for inspection and prototyping

26 Data Explorer Filters Enhanced data inspection in PDI Identify data to be cleaned or removed Deliver data to the business more quickly New in Pentaho 8.0 Numeric filters String filters Include/Exclude data points

27 New PDI Repository Dialogs Enhanced user experience for content repository Consolidated open and save dialogs Enhanced search Recently used files option Sticky directories Business Benefits Increased productivity

28 Big Data Improvements on AEL Big Data File Formats - Avro and Parquet Big Data Security - Support for Knox VFS improvements for Hadoop Clusters

29 Pentaho 7.1 Adaptive Execution for Spark PDI No Coding Pentaho Kettle Build Once Execute on Any* Engine *Currently Available Engines

30 Enhanced Adaptive Execution Simplified setup HADOOP CLUSTER Eliminated Zookeeper component Reduced number of setup steps Hardened deployment PDI Client AEL-Spark Daemon on Edge Nodes Spark/Hadoop Processing Nodes Spark Executors Fail-over at the edge Kerberos impersonation for client More flexible AEL-Spark Engine (Spark Driver) HDFS Hadoop/Spark Compatible Storage Cluster Azure Storage Amazon S3 Etc Support multiple run configurations Customize cluster settings per job type

31 Native Avro and Parquet Handling Visual handling of data files with common big data file formats Reading and writing files with specific steps Natively executes in Spark via AEL NEW in Pentaho 8.0 Avro Input and Output Steps Parquet Input and Output Steps

32 Knox Gateway for More Secure Clusters Pentaho can interact with data services in Knox gateway protected Hadoop clusters* Benefits Highly secured Knox-protected Hadoop clusters can now be integrated in ETL pipeline *Knox is only available for Hortonworks HDP distro.

33 VFS improvements for Hadoop Clusters In order to simplify the overall lifecycle of jobs and transformations we made the hadoop clusters available through VFS, on the format hc://hadoop_cluster/.

34 Others Ops Mart for Oracle, MySQL, SQL Server Platform password security improvements PDI mavenization Documentation changes on help.pentaho.com Feature Removals: Analyzer on MongoDB Mobile Plug-in (Deprecated in 7.1)

35 Product Documentation Updates MindTouch Documentation Improvements (continued) Streamlining of site content pages: Simpler site structure and click paths to accelerate user content access Eliminates pages with little content value Fun fact: 7.1 contained pages; 8.0 contains 900+ pages with no elimination of valuable content Ongoing migration of big data steps from the wiki pages to the MindTouch Doc site Business Benefits Improved access to on-line documentation

36 Pentaho Detailed Data Integration Drag and drop numeric and non-numeric filters in Data Explorer Chart actions in Data Explorer to include or exclude data Cleaner and easier design/ux for PDI Repository dialogs Consolidated PDI Repository dialogs, replacing multiple pop-ups PDI Repository Dialogs remember last opened directory Jobs can leverage Run Configurations for seamless user experience Run Configuration option to run jobs on Pentaho Server Streaming Kafka Producer step for outputting streaming data Kafka Consumer step for streaming data input Get Records from Stream step for stream processing Ability to run AEL on Spark Streaming for transformations that use Kafka streaming ingest Enterprise Platform Worker Nodes Scale-Out solution to drive superior agility Ops Mart for Oracle, MySQL, SQL Server Ruby Theme new platform branding for browser and client tools Platform password security improvements PDI Mavenization for infra alignment Big Data Simplified Spark AEL setup Spark AEL fail-over and load balancing Support for Spark AEL on Hortonworks Enhanced security for Spark AEL including Kerberos impersonation and secure connectivity Customization of Spark AEL processing (i.e. memory and other settings) Parquet input and output steps Avro input and output steps Big Data Security with HDP Knox Gateway VFS Improvements for named Hadoop clusters Additional Items Big Data Sandbox VM updates Cumulative service pack framework Documentation improvements on help.pentaho.com

37 Pentaho 8.1

38 Pentaho 8.1 Investment themes Focus on Cloud Entry to Google Cloud Platform Make AWS Easy Validate WN for cloud, hybrid deploy Must-have response to market demand Harden Core Capabilities Continue establishing recent innovations Update overlooked platform areas 20% Continuous Improvement Targeted improvement for unfinished/neglected areas Begin the Next Phase All-in on Foundry Web-based design and data exploration Vantara solution integrations Get started now. Release vehicles TBD.

39 Q&A