IaaS/PaaS with Oracle Private Cloud Appliance in practice Konrad HÄFELI Senior Solution Manager Infrastructure Engineering @KonradHaefeli doag2017
Our company. Trivadis is a market leader in IT consulting, system integration, solution engineering and the provision of IT services focusing on and technologies in Switzerland, Germany, Austria and Denmark. We offer our services in the following strategic business fields: O P E R A T I O N Trivadis Services takes over the interacting operation of your IT systems. 2 21.11.2017
With over 600 specialists and IT experts in your region. COPENHAGEN HAMBURG 14 Trivadis branches and more than 600 employees 200 Service Level Agreements Over 4,000 training participants DÜSSELDORF Research and development budget: CHF 5.0 million FRANKFURT Financially self-supporting and sustainably profitable BASEL FREIBURG STUTTGART BRUGG ZURICH MUNICH VIENNA Experience from more than 1,900 projects per year at over 800 customers GENEVA BERN LAUSANNE 3 21.11.2017
Technology on its own won't help you. You need to know how to use it properly. 4 21.11.2017
Positioning of Oracle s Private Cloud Appliance 5 21.11.2017
Oracle Engineered Systems in a Hybrid Cloud World 6 21.11.2017
7 21.11.2017
Three Deployment Models for Cloud Ready Infrastructure 8 21.11.2017
Oracle Cloud-Ready Infrastructure 9 21.11.2017
Comparison PCA for DB and App for Databases: for Applications: 10 21.11.2017
Positioning in the market: Exa vs. PCA Exadata Database Machine Database platform Highest performance Most available Unmatched scalability Smart everything Software Storage avalability Licensing Private Cloud Appliance cost-effective solution for your mixed Oracle and non-oracle workloads components shipped fully preconfigured in a rack Embedded controller software automates installation and configuration Includes virtualization at no added cost 11 21.11.2017
Trusted Partitions for Oracle Engineered Systems Goal: flexible Sub-Capacity-Licensing based on Oracle VM Requirements: Enterprise Manager (see My Oracle Support Note 1471719.1) Connected Mode: Usage reported via My Oracle Support Disconnected Mode: quarterly Reports, locally stored for two years 12 21.11.2017
Business with PCA General purpose private cloud platform: We have a solution to optimize the Oracle SW Stack licensing The system is comparable good the Trusted Partition is the USP Give it a try, most customers have: different HW vendor anyway use different DB products run on different OSs Why not run also two Hypervisor? for the sake of license savings? 13 21.11.2017
Time to know, what the PCA based Platform is all about 14 21.11.2017
Building blocks of the architecture http://www.oracle.com/technetwork/server-storage/private-cloud-appliance/overview/index.html PCA: Privat Cloud Appliance ZS5: ZFS Storage Appliance Consolidated Workloads with secure Multi-Tenancy Simple setup & management Reliable Fast provisioning and elastic scaling Rapidly deploy Oracle Applications using Oracle VM Templates Optimal storage architecture for enterprise clouds and virtualization Dynamic caching among dynamic random access memory (DRAM), flash cache, and disk drives Including compression, cloning, encryption, and replication Integration with Oracle Database 15 21.11.2017
PCA costs savings potential Simple to setup & install Factory integrated Designed for reliability and ease of management 16 21.11.2017
Oracle Private Cloud Appliance Network Four 4x10GbE Storage 40Gb/s Server-to-Server Compute Nodes Fabric Interconnect Ethernet Switch InfiniBand Expansion InfiniBand Expansion Fabric Interconnect Compute Nodes Mgmt Nodes Management Storage Networking Management Oracle X6-2 Servers 2 to 25 nodes CPU: Up to 1100 cores Memory: Up to 19.2TB Supports any Linux, Solaris and Windows applications Network Infrastructure Oracle Fabric Interconnect F1-15, Oracle Switches High speed low latency networking between all components Fully configured fabric networking, no setup required Integrates with existing Ethernet and storage networks Oracle X5-2 Servers Oracle ZFS Z3-ES Storage Appliance Redundant controllers, high performance virtual storage 8 TB SAS disks 17 21.11.2017
Scale-out Computing with Expansion Rack Support Maximum of 2 expansion racks Interconnected via Infiniband Expansion racks contain compute nodes only No management nodes or storage required 85 total compute nodes 30 nodes per expansion rack 25 nodes base rack total of 3740 cores Customer must use tenant groups to use nodes in expansion racks 18 21.11.2017
Elastic Infrastructure for Multi-Tenancy Integrated Software Defined Networking Wire Once Infrastructure Connect any VM dynamically to any IO resource Prewired for simplicity, add compute nodes on demand Dynamically create up to 8 networks per Tenant-Group Increased Flexibility Deploy and grow applications as your needs change Create isolated groups for applications Improve app to app communication Software Defined Network Software Upgradable System Appliance features added as SW, no HW changes needed System managed as a single resource to patch and upgrade 19 21.11.2017
Private Cloud Appliance Orchestration Compute Nodes Compute Enterprise Manager Cloud management (self service, metering and chargeback, etc.) for one or multiple PCAs Hardware resource management Database, middleware, apps management Software management, configuration and compliance management Plugin with Oracle VM Manager for full stack management Fabric Interconnect Ethernet Switch Infiniband Expansion Infiniband Expansion Fabric Interconnect Networking Networking OVM Manager VM and hypervisor (Xen) resource management VM network / storage configuration Compute Nodes Management Nodes Management Storage Compute Management Dual, redundant PCA management nodes with automatic failover PCA Controller Orchestrated Hardware Bringup Inserts all servers in an Oracle VM Manager server pool Configures external networking (set IP address, etc.) Performs periodic back-up of Private Cloud Appliance 20 21.11.2017
Deploy IaaS: Private Cloud Appliance + Enterprise Manager Hardware, OS and Applications - Complete. Automated. Out-of-the-box. Monitoring Configuration and Change Management Disaster Recovery Provisioning Compliance Performance and availability monitoring Fault detection and management Incident Manager Centralized Inventory Tracking Search and compare configurations Drift analysis Apply updates and patches SiteGuard integration Multi-Site capability Highly customizable Storage Vendor Agnostic Gold image based provisioning Bare metal provisioning of VMs, hypervisor Standardize using YUM repository Out of box policies for regulatory compliance Comprehensive compliance reporting 21 21.11.2017
Shared Storage Compute Nodes Network VMs Full Tenant Isolation: Tenant Groups Tenant Group 1 Tenant Group 2 Tenant Group 3 VM VMVM VM VMVM VM VMVM Utilizes Oracle VM Server Pool technology Add/remove servers, networks, and VMs to tenant groups to isolate resources/users A tenant group can have a mix of hardware types (e.g. X4-2, X5-2, X6-2) VM live migration: forward compatible VM live migration: not backwards compatible Networks can be: PVI internal to the rack (node-to-node) Different 10GbE ports per tenant groups External VLAN enabled networks through 10GbE ports All networks built with HA 22 21.11.2017
Complete Disaster Recovery Architecture Full Maximum Availability Architecture support for Oracle Applications with Site Guard Oracle VM Disaster Recovery for Non-Oracle applications Extend to Oracle Public Cloud 23 21.11.2017
Oracle ZFS Storage Technical Innovations Record-Setting Storage Performance DRAM/flash architecture (Hybrid Storage Pool), SMP RTOS, most scalable file system Industry-Leading Storage Efficiency Real-time analytics, clone/snap, compression, deduplication, Hybrid Storage Pool, data services Optimal Storage Security Share/LUN encryption, two-tier key management, end-to-end integrity checks Oracle Database Coengineering OISP, HCC, ADO, OEM Provisioning, SMU, pluggable database analytics Oracle Cloud Coengineering Shadow Migration, a feature of Oracle ZFS Storage Appliance, and rolling upgrades, user-level analytics, workflows 24 21.11.2017
Read Flash Write Flash DDT Flash L2ARC Write Flash Read Flash ZS5 Hybrid Storage Architecture Hybrid Cloud Pools (HCP) Comprised of Oracle Cloud capacity Functions as a private system resource Compatible with all system data services Deduplication (DDT) Flash Comprised of Oracle Cloud capacity Functions as a private system resource Compatible with all system data services Hybrid Storage Pool Up to 9 PB of storage capacity Up to 450,000 IOPS at <1 ms 4 ms response Database data; primary, test/dev, backup 25 21.11.2017 Flash Storage Pools 8 TB to 3 PB of flash storage Consistent low latency Database indexes, redo logs, active partitions External Read Flash 2 TB to 300 TB of read flash storage Apply read flash to any pool Ideal for database warehousing and mining High-Performance Controllers 3 TB of DRAM, 144 processor cores Up to 24x10 GbE, 16x40 Gb IB, 16x16 Gb FC Full suite of enterprise software
Oracle Intelligent Storage Protocol Database and storage coengineering Oracle Database 12c I/O cues exchanged with Oracle ZFS Storage Appliance Oracle ZFS Storage Appliance dynamically tunes critical storage parameters Intelligence is in the code within both the database and storage Available only with Oracle Database 12c and Oracle ZFS Storage Appliance OS 8 and above Storage awareness of database workload Database sends cues about each I/O to the storage Over 70 database I/O types are recognized Cues grouped into five distinct categories by storage Information used by storage to adaptively and automatically adjust for optimal efficiency 26 21.11.2017
Oracle Intelligent Storage Protocol Technology: DB Coengineering OISP dnfs TCP IP Network IP TCP dnfs OISP Oracle Database with Oracle Intelligent Storage Protocol Extensions built on top of NFSv4 protocol Each I/O is tagged with data context I/O reason I/O priority File type (redo log, data file, control file, backup file) Database block size for file Database and/or pluggable database ID Cache hints Prefetch hints Dynamic Actions Dynamically record size, log bias (shipping) Pluggable database analytics (shipping) Oracle Enterprise Manager provisioning (Shipping) Analytics AWR feed I/O fair share scheduling and DB priority I/O caching/prefetch 27 21.11.2017
Oracle Intelligent Storage Protocol 2.0: Efficient Cache Management Simultaneous Oracle RMAN + OLTP workloads Before Extensions With Extensions RPC fair share scheduler with DB I/O prioritization Negative cache hints for lower priority like Oracle RMAN and archivelog I/O OLTP START Oracle RMAN START OLTP START Oracle RMAN START ARC Evictions 28 21.11.2017
Oracle Intelligent Storage Protocol 2.0: Optimized Database Storage With Extensions Before Extensions Bounded latency for higher priority DB I/O RPC fair share scheduler with DB I/O prioritization Separate thread pools for READs, WRITEs, and Oracle Intelligent Storage Protocol highpriority I/O 86% reduction in LGWR latency 33% faster datafile backup 29 21.11.2017
PCA Administration 30 21.11.2017
Software Components Oracle Private Cloud Appliance Dashboard Password Manager (Wallet) Oracle VM Manager Operating Systems (Admin) Databases (Berkeley DB, MySql) Oracle Private Cloud Appliance Management Software Oracle Private Cloud Appliance Diagnostics Tool (pca-diag) Dokumentation https://docs.oracle.com/cd/e83758_01/ 31 21.11.2017
Oracle Private Cloud Appliance Dashboard 32 21.11.2017
PCA Command Line Interface (CLI) # pca-admin Welcome to PCA! Release: 2.0.5 PCA> PCA> list management-node Management_Node IP_Address Node_State ILOM_MAC ILOM_State Master --------------- ---------- ---------- -------- ---------- ------ ovcamn06r1 192.168.4.4 RUNNING 00:10:e0:2e:7c:53 running ovcamn05r1 192.168.4.3 RUNNING 00:10:e0:31:93:6f running Yes ---------------- 2 rows displayed Status: Success PCA> exit # 33 21.11.2017
PCACLI PCA> help Documented commands (type help <topic>): ======================================== backup diagnose list rerun show stop delete help reprovision set start Undocumented commands: ====================== EOF exit q quit shell 34 21.11.2017
VM Manager 35 21.11.2017
Update Prozess Rebooting the Management Node Cluster pca-check-master pca-updater # pca-updater -m download -s -u http://url.example.com/pca-version-build.iso.zip # pca-updater -m update s Upgrading the Virtualization Platform (Oracle VM) Decoupled from the automatisation process Needs Rebooting nodes 36 21.11.2017
(O)VM Templates http://www.oracle.com/technetwork/server-storage/vm/database-templates-12c- 11gr2-1972804.html 37 21.11.2017
RAC VM Templates (White Paper) http://www.oracle.com/technetwork/server-storage/private-cloud-appliance/deploymentof-oracle-rac-on-pca-4013267.pdf http://edelivery.oracle.co m/oraclevm DeployCluster Tool fully supports Single Instance, Oracle Restart (SIHA) or RAC deployments 38 21.11.2017
VMware to Oracle VM Migration tool http://www.oracle.com/technetwork/server-storage/vm/downloads/ovm-tools-3604795.html 39 21.11.2017
Prices http://www.oracle.com/us/corporate/pricing/exadata-pricelist-070598.pdf Hardware Private Cloud Appliance Base Rack $117k Internal ZFS Storage $46k Compute node $17k minimal config < $ 200k ZS5-2 ~ $ 175k + HW Maintenance Software Licensing Metering and chargeback module incl. Site Guard Oracle Configuration Management Pack for Applications (no Oracle) Database Lifecycle Mgmt Pack and WLS Mgmt Pack $ 12k/proc Opt. Oracle Cloud Management Pack $ 7,5k/proc 40 21.11.2017
Conclusion 41 21.11.2017
Evaluation over TCO and value chain Requirements definition TCO Calculation Scenario comparison Make or buy decision As IT department As service provider Added values in the value chain Compare & Validate Decide 42 21.11.2017
Conclusion As an Oracle SW Stack Platform next to a general purpose Cloud Platform, it has its place Latest Compute Nodes X7-2 in Dec 2017 The license advantages can justify the costs Platform-Ready configuration and operation needs expertise Otherwise consider Oracle Cloud Machine (OCM) Automatization is key We believe in the market chance of PCA Platform and looking forward solving your infrastructure challenges with it 43 21.11.2017
Your Contact Konrad Häfeli Senior Solution Manager Partner Tel. +41 58 459 59 69 konrad.haefeli@trivadis.com 44 21.11.2017
Trivadis @ DOAG 2017 #opencompany Booth: 3rd Floor next to the escalator We share our Know how! Just come across, Live-Presentations and documents archive T-Shirts, Contest and much more We look forward to your visit 45 21.11.2017