Next Generation Database Clouds

Size: px

Start display at page:

Download "Next Generation Database Clouds"

Charles Craig
6 years ago
Views:

1 Sebastian Solbach Consulting Member of Technical Staff Bare Metal Cloud DBaaS Service Oracle Deutschland b.v. & C.o Next Generation Database Clouds Real Application Cluster in the Cloud Copyright 2017, Oracle and/or its affiliates. All rights reserved.

2 Challenges of High available Oracle Databases (in the Cloud) Placement Networking Storage Performance Where should my database be? Virtual IP Addresses (Floating IPs) / Subnet / Networking services Shared Storage Predictable network / storage / CPU performance

3 Defining Placement: Region / Domain Topology Regions serve different geographies, provide Disaster Recovery Domains provide a High foundation in a Region Region 1 Availbility Domain 1 Region 3 Domain 1 Domain 2 Domain 3 Region 2 Domain 2 Domain 3 Domain 1 Domain 2 Domain 3

4 Inside a Region High Building Blocks Multiple fault-decorrelated, completely independent datacenters Domains (ADs) Predictable low latency & high speed, encrypted interconnect between ADs < 500µs RTT latency, 1Tb/s bandwidth Enables zero-data-loss architectures (e.g. Oracle MAA) and high availability scale-out architectures (e.g. Sharding) Datacenters Region Domain 1 Domain 2 Domain 3

5 Inside an AD High Scale, High Performance Network Non-oversubscribed Clos network flat, fast, predictable Very high scale ~1 million network ports in an AD Predictable low latency & high speed interconnect between hosts in an AD < 100µs RTT latency, 10Gb/s bandwidth Physical Network Datacenters Region Domain 1 Domain 2 Domain 3

6 Comprehensive Virtual Network with Off-box Virtualization Highly configurable private overlay networks moves management and IO out of the hypervisor and enables lower overhead and bare metal instances Allows VIPs (Floating IPs) for RAC Virtual Network Physical Network Datacenters Region Domain 1 Domain 2 Domain 3

7 Managing the Traffic Flow on a SmartNIC Reduces the Processing Delay and Merges Multiple Workload Types onto a Single VCN Master Domain OS OS OS OS OS vswitch Hypervisor PCI NIC CPU SmartNIC Hardware Hardware

8 TB/Server, ~4 Million 4K Read IOPs Block Storage: 256GB-2TB, 1.

8 High IO Hardware Technology High Performance Compute Systems 36 Cores per Server Standard: Non-NVMe SSD, 256 GB RAM High I/O: 12.8 TB NVMe SSD, 512 GB RAM Dense I/O: 28.8 TB NVMe SSD, 512 GB RAM High Performance Storage Systems Local NVMe: up to 28.8 TB/Server, ~4 Million 4K Read IOPs Block Storage: 256GB-2TB, 1.5K-6K IOPs per Volume Object Storage High Throughput, Strong Consistency Fast Local Storage solves the I/O problem for High End Systems, whereas iscsi block storage solves it for generic systems

9 Putting it All Together Predictable, Flexible, Fast Compute & Storage Bare metal hosts Bare metal w/nvme VMs Engineered Systems? Any middlebox IDS/IPS, Virtual Network Physical Network Datacenters Region Domain 1 Domain 2 Domain 3

10 Oracle Database Cloud Service Offers Infrastructure Choice Virtual Machines Bare Metal Engineered Systems Test, Development, Departmental Applications Oracle AppsUnlimited, PaaS Compute Shapes by OCPU, Standard or High RAM Block Storage by the GB Up to 40TB database Intensive Test, Development, Departmental Applications Custom Applications Bare Metal Compute Shapes by core, HighIO or DenseIO Fixed NVMe Storage by Shape Up to 9TB database Mission Critical, Intensive OLTP and Decision Support Oracle and Custom Apps ¼, ½ and Full Rack Shapes Fixed Storage and Memory by Shape Up to 168TB database

11 Challenges of High available Oracle Databases (in the Cloud) Placement Networking Storage Performance Regions / Domains Flat non blocking Clos network with Overlay Local NVMe / iscsi Block Volumes No noisy neighbors

12 Database Cloud Service on OCI: IaaS Basics Predictable Performance Converged Network guarantees I/O (network and storage) performance within AD CPU are assigned exclusively to customer on BM or VM No Memory overprovisioning VCN and Private IP Support Each instance has a set of private IPs Access path within the cloud Public IP only necessary for external access and to connect to services on Public IP Instances on pure private IPs possible (not yet for DBaaS) VPN Out of the Box for all instances Detailed Egress/Ingress Rule settings Compartments 3 AD Concept

13 Database Cloud Service (Bare Metal) 3 Bare Metal Compute shapes DB.BM.HighIO TB NVMe DB.BM.DenseIO TB NVMe DB.BM.RACLocalStorage /64TB SSD VM Shapes (Exa Q/H/F) Full-featured 11gR2 or 12c database Database 12c (version / ) Database 11g (version ) Scale-up/down easily Start with 2 cores, and grow up to 36 cores Deploys into your Virtual Cloud Network Fully Portable from On-Premises to Cloud Full root access RMAN, Database CLI, Oracle EM support Integrated Patching Fully certified Oracle Backed by Oracle Support Simple licensing bundles and pricing SE, EE, EE-High Perf, and EE-Extreme Perf BYOL or License-included options Platform Native APIs and integrated console experience for deployment Complete customization and hybrid configurations or fully automated deployment

14 Storage Storage for BMC Systems Shape Raw Storage Usable Storage with Normal Redundancy (2-way Mirroring) Usable Storage with High Redundancy (3-way Mirroring) BM.HighIO TB NVMe DATA 3.5 TB RECO 740 GB DATA 2.3 TB RECO 440 GB BM.DenseIO TB NVMe DATA 9.4 TB RECO 1.7 TB DATA 5.4 TB RECO 1 TB BM.RACLocalStorage TB SSD DATA 22.1 TB RECO 5.5 TB DATA 14 TB RECO 3.5 TB

15 Exadata System Configuration System Details Resource Quarter Rack Half Rack Full Rack Number of Compute Nodes Total Minimum (Default) Number of Enabled CPU Cores Total Maximum Number of Enabled CPU Cores Total RAM Capacity 1440 GB 2880 GB 5760 GB Number of Exadata Storage Servers Total Raw Flash Storage Capacity 38.4 TB 76.8 TB TB Total Raw Disk Storage Capacity 288 TB 576 TB 1152 TB Total Usable Storage Capacity 84 TB 168 TB 336 TB

16 Deploying a Database/RAC Cluster 1.) Definition of the Virtuellen Cloud Netzwerks (VCN) Automatic Fixed CIDR block ( /16) Subent Internet Gateway Routing Rules Manual Define CIDR Block Hint: Use short names for VCN and subnet

17 Deploying a Database/RAC Cluster 2.) Launch DB System Name Domain Shape Edition (regard order) CPUs SSH Public Key ASM Redundancy (Normal/High) Deployment RAC: identical

18 Deploying a Database/RAC Cluster 2.) Launch DB System

19 Accessing the Database Within the Cloud Instanz (Public IP seen on DB System) Access with ssh as user oracle. Set environment (. oraenv) Access with SQL*Plus In the cloud in same VCN or VPN Internal IP Adress or Hostname ( X) Check firewall settings on hosts (1521) Services use DB_DOMAIN in default FromPublic Internet (without VPN) SQL*Net via. SSH Tunnel with Public IP Address SQL*Net with Public IP Adress (Regard Ingress Rule on Security List for VCN) SCAN/VIP are only accessible within VPN or Cloud (Alternative: Load Balancer Service)

20 Database on OCI Important Facts OCI always provided a full clusterstack (Grid Infrastructure) Provide important HA functionality like ONS for Data Guard Provides ASM (NVMe Mirroring + optimal Performance) Administration with dbcli and srvctl Deployment of a DB system takes longer (1 hour) than simple compute shapes Important: Create a service OCI BM shapes allow multiple DB per instance SE Edition can use up full instance Multiple instances via. Console or cli (dbcli) Environment is not set per default Caution: Oracle / Grid.bash_profile changes can impact console / dbcli functionality Solution: Create addiditonal user (in the DBA group)

21 Database on OCI Important Facts Databases are encryption on default Using Autologin Wallet On work with tablespaces set ORACLE_UNQNAME (DB_UNIQUE_NAME) Hint: DB_UNIQUE_NAME is DBNAME_<Region>#number NAME TYPE VALUE db_unique_name string ssashdb_iad36c Databases use DB_DOMAIN as default: NAME TYPE VALUE db_domain string ad1.ssopub.oraclevcn.com Impact on Service names (sspdb.ad1.ssopub.oraclevcn.com) Create of a new service

22 Database on OCI Important Facts Default CPU_COUNT on BM instances is 4 NAME TYPE VALUE cpu_count integer 4 Recommendation: Manually set CPU_COUNT following Partitioning : Overprovisioning : Block Checking SUM (CPU_COUNT) <= enabled DB_SYSTEMS CPU SUM (CPU_COUNT) <= 2x enabled DB_SYSTEMS CPU NAME TYPE VALUE db_block_checking string FULL db_block_checksum string FULL Comparing performance between Onpremise & Cloud (CPU & I/O)

DBaaS on OCI: Storage Local NVMe Storage for BM Shapes Local SSD Storage for BM RAC Shapes Shared fast Block SSD Storage for VM Shapes Predictable I/O

23 DBaaS on OCI: Storage Local NVMe Storage for BM Shapes Local SSD Storage for BM RAC Shapes Shared fast Block SSD Storage for VM Shapes Predictable I/O Performance Local Storage on BM Shared storage guaranteed I/O due to converged Network ASM and ACFS Support in all instance types Online Storage scaling for Block Storage

Generic DBaaS on OCI Characteristica Same administration tool for all DBaaS Shapes API first on thin scalable infrastructure API the same for all DBaaS shapes Same CLI

24 Generic DBaaS on OCI Characteristica Same administration tool for all DBaaS Shapes API first on thin scalable infrastructure API the same for all DBaaS shapes Same CLI across DBaaS shapes Easy and fast setup (Simplicity is key) Exact definable placement of DBaaS (alongside IaaS/SaaS instances) Grid Infrastructure Stack always available

Desaster Recovery Data Guard Can be setup any time Exact/known placement of Data Guard between ADs Data Guard within same AD allowed Network within Region allows for SYNC transport (not yet in API)

25 Desaster Recovery Data Guard Can be setup any time Exact/known placement of Data Guard between ADs Data Guard within same AD allowed Network within Region allows for SYNC transport (not yet in API) Console supported Switchover/Failover Oracle Notification Service (ONS) always available to reduce Application Brownout Definable Services for Application Continuity in all Shapes Oracle Managed RMAN Backup and Restore

26 Scaling BM Shapes allow online CPU Scaling CPU_COUNT of instances has to be manually adjusted online (because of mutiple DB support) Support for Multiple DBs, Multiple Homes on BM VM Shapes allow online scaling of Storage No need to increase any filesystem

27 Full RAC Support within an AD VCN and Subnets allow for separate Network for Interconnect and Public network Full VIP support Floating IP Support VIPs are on the same subnet and can failover Additional VIPs for Applications (e.g. HANFS, Goldengate) can be created SCAN Addresses on Public Full support for applications with FAN/FCF/AC with SCAN and VIP failover Specialities RAC BM: Dedicated shared SSD Storage for RAC BM Shapes Separate phyiscal Interconnet on Infiniband

28 Different Deployments for Database on Oracle Cloud IaaS vs. DBaaS Function IaaS DBaaS Console Support Patching Backup / Restore Data Guard Hybrid Columnar Compression InMemory Data Guard Shared Storage BYOL RAC Support Online CPU Scaling (N/A with VM yet) Online Storage Scaling (Only VM) ACFS Support for Databases

29 Different Deployments for Database on Oracle Cloud Bare Metal Deployment on OCI Model IaaS DBaaS Single Instance DBaaS RAC Shapes BM. Standard/HighIO/DenseIO HighIO/DenseIO RACLocalStorage CPUs Memory 256 / 512 / / 512 2x 512 Local Storage TB RAW * 0 / 12.8 / / Block Storage TB N/A at the moment N/A at the moment Shared Storage I/O (Network & Storage) 10 Gbps 10 Gbps 10 Gbps RAC No No Yes (IB Interconnect 40Gbps) Online Change CPUs DBaaS License included Only BYOL all 36 cores 2-36 cores / BYOL cores / BYOL 4-72 Multiple Homes/DB * Local Storage should be mirrored to protect from disk failure. Either with Normal or Triple Redundancy

Different Deployments for Database on Oracle Cloud VM Deployment on OCI Model IaaS.Standard Iaas.Dense DBaaS VM SI DBaaS VM RAC Shapes VM. Standard.1/2/4/8/16 Dense.

2/6.4/12.8 Block Storage TB 0-512 0.256-512 0.256-512 0.256-512 Shared Storage I/O (Network & Storage) 0.63 / 1.26 / 1.26 / 2.43 / 4.

30 Different Deployments for Database on Oracle Cloud VM Deployment on OCI Model IaaS.Standard Iaas.Dense DBaaS VM SI DBaaS VM RAC Shapes VM. Standard.1/2/4/8/16 Dense.4/8/16 Standard.1/2/4/8/16 Standard.1/2/4/8/16 CPUs 1/2/4/8/16 4/8/16 1/2/4/8/16 1/2/4/8/16 Memory 7/14/28/56/112 60/120/240 7/14/28/56/112 7/14/28/56/112 Local Storage TB RAW * 3.2/6.4/12.8 Block Storage TB Shared Storage I/O (Network & Storage) 0.63 / 1.26 / 1.26 / 2.43 / 4.78 Gbps (see next slide) RAC No No Yes Online Change CPUs DBaaS License included Only BYOL Yes and BYOL Yes and BYOL Multiple Homes/DB * Local Storage should be mirrored to protect from disk failure. Either with Normal or Triple Redundancy

31 Predictable Performance / No noisy neighbuours Detail for CPU & Network/Storage I/O Correlation for VM Shapes VM Cores Bandwidth (Gbps) Network / Storage and RAC Interconnect share the same 10Gbps physical network card.

32 Additional Virtual IP Addresses in OCI Additional VIPs are needed for HANFS, XAG, Goldengate OCI knows 2 types of IP Addresses Primary and Secondary (Floating IPs) Public (Internet) and Private (VCN) IP Addresses in OCI have 2 dependencies IP Adress in the Cluster itself (srvctl / appvipcfg) Metadata Information in OCI (and DNS Server in OCI) Confidential Oracle Internal/Restricted/Highly Restricted 33

33 Get VNIC Metadata Every OCI Instance has a Metadata Service curl -H "Content-Type: application/json" -X GET " [ { "vnicid" : "ocid1.vnic.oc1.eu-frankfurt-1.abtheljsxvhe6...", "privateip" : " ", "vlantag" : 0, "macaddr" : "90:e2:ba:d6:f1:84", "virtualrouterip" : " ", "subnetcidrblock" : " /24", "nicindex" : 0 } ] Confidential Oracle Internal/Restricted/Highly Restricted 34

34 VIP(s) on the VNIC Read VNIC Metadata: bmcs-curl $IAASHOST get "/ /privateIps?vnicId=$VNIC" { "availabilitydomain" : "XXIT:EU-FRANKFURT-1-AD-3", "compartmentid" : "ocid1.compartment.oc1..aaaaaaaaevtkt ", "displayname" : "ssfyoda1-vip", "hostnamelabel" : "ssfyoda1-vip0", "id" : "ocid1.privateip.oc1.eu-frankfurt-1.abtheljs6datuoscigj ", "ipaddress" : " ", "isprimary" : false, "subnetid" : "ocid1.subnet.oc1.eu-frankfurt-1.aaaaaaaa2tnk4nd ", "timecreated" : " T10:30:15.323Z", "vnicid" : "ocid1.vnic.oc1.eu-frankfurt-1.abtheljsxvhe6i3t2z6 " } Confidential Oracle Internal/Restricted/Highly Restricted 35

35 Create additional Metadata for the VIP bmcs-curl $IAASHOST post./createvip.json "/ /privateIps createvip.json: { "displayname": "'"${VIPHOST}"'", "hostnamelabel": "'"${VIPHOST}"'", "ipaddress": "'"${VIPADDR}"'", "vnicid": "'"${VNIC}"' } Oci-curl: 1.oraclecloud.com/Content/API/Concepts/signingrequests.htm?Highlight=curl#Bash Confidential Oracle Internal/Restricted/Highly Restricted 36

36 Challenges of High available Oracle Databases (in the Cloud) Placement Networking Storage Performance Regions / Domains Flat non blocking Clos network with Overlay Local NVMe / iscsi Block Volumes No noisy neighbors

Oracle IaaS, a modern felhő infrastruktúra

Sárecz Lajos Cloud Platform Sales Consultant Oracle IaaS, a modern felhő infrastruktúra Copyright 2017, Oracle and/or its affiliates. All rights reserved. Azure Window collapsed Oracle Infrastructure as