Run Oracle on Oracle

Transcription

1 Run Oracle on Oracle

2 Oracle 运行 Oracle 数据库的可选方式 Exadata ODA SuperCluster Oracle x86 Servers + Oracle Linux + Oracle Stoage Oracle x86 Servers + Oracle Solaris + Oracle Storage Oracle SPARC Servers + Oracle Solaris + Oracle Storage 2

3 工程一体机 3

4 Exadata 第五代 Oracle 数据库工程一体机 X4 Storage 2X Larger Physical Flash Memory 44 TB of Flash Memory Up to 4X Larger Logical Flash Memory 88 TB using Flash Cache Compression 77% More Flash IOs/sec on X M Reads, 1.96M Writes from SQL 33% Larger High Capacity Disks 672 TB using 4TB Disks 2X Larger High Performance Disks 200 TB using 1.2 TB Disks Per DB Machine Full Rack X4-2 Compute 50% More Database Cores 192 Cores using 12-Core Xeon CPUs 2X Larger DB Server Local Storage 2.4 TB per server using 600GB Disks 10% 2X to Faster 20% Lower InfiniBand Power InfiniBand PCI-3 Card. All Ports Active 4

5 特有的 Oracle 数据库软件优化技术 Query offload in storage Data intensive query operations offloaded to storage CPUs 100 GB/sec SQL data throughput Storage Index data skipping Database storage compression Hybrid Columnar for 10x DB size reduction and faster analytics Database optimized PCI Flash Smart caching of database data 2.66 Million Database IOs/sec Smart Flash log speeds transactions Database optimized QoS End-to-end prioritization from application to DB and storage Database optimized availability Fastest recovery of failed database, server, storage or switch Fastest backup. Incremental offload Exachk top-to-bottom validation of hardware, software, settings Database optimized messaging SQL optimized InfiniBand protocol for high throughput low latency SQL 5

6 Oracle Database Appliance 简单 可靠 平易近人的价格 More Processing Power 2 x 1RU x86 Servers. Each Server Contains: 2x 12-core Intel Xeon E v2 256 GB RAM (16 x 16 GB) 2 x 600 GB Boot Disks (mirrored) 1 x Internal & 2 x External SAS HBAs 4 x 1/10 GBase-T Ethernet Ports Redundant 10GBaste-T Interconnect 1 x 2RU Storage Shelf Direct-Attached 4 x GB SSDs for Redo 20 x GB HDDs for Data Optional storage expansion with additional storage shelf doubles storage capacity 6

7 内建的虚拟化可在单一系统内同时部署数据库与应用程序 DOM 0 VM Storage Repository Oracle Database Appliance Node 1 Domain U Domain U Domain U ODA Base Appliance Manager Grid Infrastructure Database DOM 0 VM Storage Repository Node 2 Domain U Domain U Domain U ODA Base Appliance Manager Grid Infrastructure Database Database runs in the ODA Base domain to provide native disk performance Domains provide application isolation Appliance Manager provides: VM Template and Domain management 7

8 Oracle x86 服务器被广泛用于 Oracle 工程一体机 Business Ready Systems (with x86 Building Blocks) Oracle Cloud (with x86 Building Blocks) Storage Systems (with x86 Building Blocks) Oracle x86 Systems (stand alone systems) - Oracle On Demand - On-Premise Cloud 2-Socket 1RU Rack 4-Socket Rack 8-Socket Rack Exadata Exalogic Oracle Virtual Cloud Appliance Big Data Appliance 2-Socket 2RU Rack ZFS Storage Appliances Oracle Exalytics in-memory Database Machine Oracle Database Appliance 2-Socket Blade 8

9 Oracle x86 专为性能优化 Oracle 软件在 Oracle x86 上运行更佳 Oracle software developed, integrated, and tested on Oracle x86 Oracle Linux features available only for Oracle x86 - Storage firmware enhancements - Deep bug fixes and hardening of firmware to improve performance of Oracle database and applications Oracle Solaris features available only for Oracle x86 - Advanced fault diagnosis - Better system management linkage impacting performance of IaaS Single system management tool for all Oracle products - Hardware, middleware, database, and applications - Improves system administration productivity, easier life cycle, more effective fault analysis 9

10 Oracle Linux 接近 11,000 个企业用户 ; 两位数的年增长率 Oracle Linux is one of the top 3 distributions, growing more than 80 percent year-over-year in 2012, which outpaced the overall Linux server operating system market growth (1). (1) Source: Gartner, Market Share, All Software Markets, Worldwide, 2012 March 29,

11 Oracle Linux 我们提供 Oracle Linux is binary compatible to Red Hat Enterprise Linux Provides two kernel options for customers to choose from: The Unbreakable Enterprise Kernel (default) Red Hat compatible Kernel provides a simple migration path for existing Red Hat customers Oracle Linux holds the record for TPC benchmarks on x86_64 systems. Oracle Linux leads in scalability and benchmarks with support for: Up to 4096 CPUs Up to 16TB Memory 11

12 Oracle 数据库在 Oracle Linux 上表现优异 联合开发带来超乎寻常的结果 Oracle Linux is the only Linux tested and certified with Oracle Database It is used in Oracle Engineered Systems Integrated features and joint develop optimize Oracle Linux for Oracle database. Database Smart Flash Cache Data Integrity Advanced Security Features Oracle Database Transparent Data Encryption and Redaction Oracle Audit Vault and Database Firewall Oracle pre-install and Oracle Validated solutions to simplify Database deployments 12

13 SuperCluster Oracle 速度最快 扩展性最强的工程一体机 COMPLETE Software Compute Storage Networking + + The best system for running databases and applications in memory Ideal for consolidation and cloud Best for IBM/HP and SPARC refreshes and new deployments 13

14 DIY 之服务器 14

15 国内传统用户典型的配置 服务器 + 存储 + 网络 集群配置, 无单点故障 DIY Oracle 组件 Oracle 优化解决方案 15

16 Oracle SPARC 服务器 更好的性能, 更好的性价比 T5 M6 M10 Up to 128 cores / 1024 threads Up to 4TB memory Up to 384 cores / 3072 threads Up to 32TB memory Up to 1024 cores / 2048 threads Up to 32TB memory Modular design, 4 sockets per BB 16

17 SPARC T5 最快的 OLTP 数据库服务器 TPC-C 公测指标对比 Processor Model (CPUs/Cores/Threads) SPARC T5-8 with Oracle 3.6 GHz SPARC T5 (8/128/1024) IBM Power 780 with DB GHz Power 7 (2/8/32) IBM Power node cluster with DB GHz Power 7 (24/192/768) IBM Power 595 with DB2 5.0 GHz Power 6 (32/64/128) IBM x3850 X5 with DB GHz Intel Xeon E (4/40/80) tpmc 8,552,523 1,200,011 10,366,254 6,085,166 3,014,684 Response Time (s) (New Order / 90th%) Price / tpmc $0.55 USD $1.38 USD $1.38 USD $2.81 USD $0.59 USD tpmc / CPU 1,069, , , , ,671 P7+ 机型始终拒不参测, 是否因为性能提升羞于见人? 参测 P780 最高可配置 16 个 CPU, 但实际却只用 2 个 CPU 测单机性能, 且通过 TurboCore 技术再关闭 16 核中的 8 核以提高主频, 并试图诱骗用户基于此来线性推算满配性能 参测 P780 最高可配置 128 核, 仅用 2 台就可以达到 256 核, 但实际却用 3 台半配来作集群, 是否意味着做集群的效果还要好过把 P780 配置得更高? IBM 测试所得的响应时间比 Oracle T5-8 差很远, 分别差出 69% 与 4.1 倍 17

18 SPARC T5 最快的中间件服务器 SPECjEnterprise2010 公测指标对比 Oracle Oracle Cisco IBM Java EE Server 1 x SPARC T5-8 with Oracle DB 5/8 SPARC T5-8 with Oracle DB 2 x Cisco UCS B440 M2 with Oracle DB 1 x IBM Power 780 with DB2 CPU Chip / Core / GHz (Total) 8 chips, 128 cores, 3.6 GHz SPARC T5 5 chips, 80 cores, 3.6 GHz SPARC T5 8 chips, 80 cores, 2.4 GHz Xeon E chips, 64 cores, 3.86 GHz POWER7 IBM 的最好成绩 Ejobs 57, , , , Ejobs / CPU SPARC T5-8 服务器比同为 8 CPU 的 IBM Power 780 要快 3.5 倍 即使采用 IBM 热衷使用的极不合理的线性推导,P780 满配置性能也仅为 T5-8 的 58% 不到 结论 :128 核的 Oracle T5-8 远远强于 128 核的 IBM P780 18

19 SPARC T5 最快的 OLAP 数据库服务器 TPC-H 公测指标对比 IBM 最害怕测 TPC-H IBM 测 TPC-H 用的数据库既不是 Oracle, 也不是 DB2, 居然是 Sybase System Performance (QphH) SPARC T5-4 Server 409,721 SPARC T4-4 Server 205,792 IBM Power 780 Model 9179-MHB 192,001 Database Oracle Database 11g R2 Enterprise Edition w/partitioning Oracle Database 11g R2 Enterprise Edition w/partitioning Sybase IQ Single Application Server Edition v.15.4 Operating System Oracle Solaris 11.1 Oracle Solaris 11 11/11 AIX Version 7.1 Type of CPU Oracle SPARC T5-3.6 GHz Oracle SPARC T4-3.0 GHz IBM POWER GHz TurboCore Total of cores (8 8coreCPU) 19

20 更好的性能来自优化的设计 为什么 T5 能够胜任各种数据库负载? 16 S3 cores per T5 CPU, Ghz Dynamically threaded with hardware-optimized resource sharing, one to eight strands per core Support for Critical Threads Logwriter, LMS for DB, up to 30% improvement in efficiency Compiler threads, GC and priority mapping support for JAVA, up to 2x improvement for app startup, Smooth GC 2 x8 Lane PCIe 8GT/s per T5 CPU 20

21 最高 128 核的 8 路直联系统第一个真正支持 8 路直联架构的 CPU Glueless 1-hop scaling to eight sockets Glueless means no hub required to connect all 8 CPUs A precise directory tracks all L3s in the system striped across all processors stored in on-chip SRAMs flexible for different socket counts Higher BW efficiency than snoop-based protocols enables better scaling 50% more effective bandwidth than comparable snoopy implementation T5 T5 T5 T - T5 T5 T5 128 Cores System T5 T5 21

22 P780 的 CPU 间连接方式 最高 128 核, 与 T5-8 完全一致 1 hop only happens in the same building block. Many 2 and 3 hops between building blocks. Serious performance impact to real world applications. The overall performance of a fully configured P780 can NOT be calculated by simple multiplication. Same to P770, P795 22

23 T4 +1x Throughput +5x Thread Strength Oracle SPARC Processor Roadmap Delivered M6 +2x Throughput M5 >1x Thread Strength +6x Throughput +1.5x Thread Strength T5 +2.5x Throughput +1.2x Thread Strength In Test M & T Series +2x Throughput +1.5x Thread Strength Software in Silicon Database Query Decompression Encryption Application Data Integrity Java Optimization Low Latency Clustering Planned Solaris 11 Solaris 11.1 Solaris 11.x Solaris 11.x Solaris 11.x Solaris 12 Next Gen Core M & T Series +1.3x Throughput +1.5x Thread Strength Oracle Numbers Optimization Solaris 12.x SPARC Core Enhancements Increased Cache Increased Bandwidth Software in Silicon Enhancements Database Query+ Java Optimization+ Encryption+ Low Latency Clustering+ Solaris 12.x 23

24 DIY 之操作系统 24

25 Oracle Solaris 当关键任务遇见了云 Highly Available, Secure Platform for Enterprise Apps Large-scale Cloud Management Predictive self healing ZFS data integrity Low overhead snapshots End to end encryption Application Clustering Compliance reporting DTrace observability Solaris 11 Zero overhead Server, Storage, Network virtualization Immutable zones Fast, fail safe life cycle management Comprehensive cloud management solution 25

26 Solaris 针对 Oracle RDBMS 的优化冰山一角 CPU Memory File System I/O Full MT-hot kernel, scales to 100s of cores and 10,000s of HW threads Support for Critical Threads features in T4 chip 5x performance improvement of high-resolution timer Multi-processing and multi-threading support for next gen database Large Page support Optimized Shared Memory (OSM) NUMA I/O Framework Fast DB Restart Latency-aware kernel memory allocator (x86, SPARC) Re-architecture of Virtual Memory sub-system Userland Fast-Memory Registration and Shared Protection Domain Userland file system for DB, Oracle File Server support udapl, RDSv1, RDSv3, SDP: Support for low-latency Infiniband protocols Direct I/O with concurrent writes Exclusive-IP zone support for RDSv3 to support DBaaS Dynamic reconfiguration for IB HCAs 26

27 Solaris 针对 Oracle RDBMS 的优化冰山一角 Observability Reliability and Availability Performance Multi-tenancy Security Enhanced observability for segmentation faults Read-out of libdtrace by next gen database Dynamic reconfiguration notifications for DB for resources rebalancing FMA callback for bad hardware Improved PGA performance Kernel lock acceleration for Oracle RAC Message Passing Co-processor Remote Memory Access (RMA) Zones: Secure isolation, lowest latency virtualization Transparent crypto off-load 27

28 Solaris for SPARC 路线图 Silicon Direction Security: Enhanced cryptography Oracle numbers Arithmetic Acceleration Hardware Decompression In Memory Columnar Database Acceleration Memory Versioning Low Latency Clustering Solaris Direction End-to-End Analytics Distributed Service Management Software Defined Networking Zero Downtime Patching Encryption Everywhere Hardware Scaling to 1000s TB Performance Reliability Security In-memory Database Big Data 28

29 DIY 之存储 29

30 Oracle 全线存储产品 30

31 Application Engineered Storage OISP ADO HCC Dynamic and automatic databasestorage tuning Advanced and dynamic database (data) optimization Superior database, data warehousing compression 31

32 Oracle 混合列压缩 Data is organized and compressed by column Dramatically better compression Not recommended for OLTP Speed-optimized Query Mode for data warehousing 10X compression typical Space-optimized Archival Mode for infrequently accessed data 15X to 50X compression typical Works great with partitioning, backup, etc. 32

33 混合列效果的蝴蝶效应 10x less storage 10x better disk bandwidth 10x more data in Flash Cache 10x more data in database memory 10x smaller test, development databases 10x smaller backup 33

34 Oracle DB: 运用 Hot Backup Mode High Level Sequence Oracle DB Instance FS DPM/3 Agent Requests Hot Backup Responds to Sync Point FS Copy Services Clones Volume Copies Logs, Tablespace, Clones etc. 1. DPM/3 agent puts DB in archivelog mode, then into Hot Backup mode. Scheduled or on-demand. 2. Transaction completes, buffers flushed 3. DB tells DPM/3 data is consistent. 4. DPM/3 agent tells FS to make a clone 5. On clone completion, DPM/3 agent returns DB to normal operation 34

35 DIY 之整合服务器 35

36 服务器整合的目标 15% Average Utilization 75% Average Utilization 36

37 整合并共享预留处理能力 One app per server leads to overload or extra headroom Consolidate many apps to share and reduce headroom Many Smaller Servers Overload 15% Overload Overload 40% 10% 5% 5% Overload Svr. A Svr. B 5% Distributed headroom 70% Single Larger Server Consolidated and shared headroom 37

38 LDOM 在一台 SPARC 服务器上整合多达 128 个虚拟机 Freely available on T and M series Can be setup like hardware domain Share least hardware resource Independent OS High efficiency Hard partition for licensing Flexible and secure live migration between hosts Fully dynamic resource management of CPU, memory, virtual I/O, and crypto accelerators on running virtual machines Automatic CPU dynamic resource management places resources where they are needed the most Redundant virtual networks and disks for higher availability 38

39 LDOM 灵活 LDOMs always have their dedicated CPU and memory LDOMs can have dedicated I/O or share I/O (Virtual I/O) Allocate CPU by core or thread, can do DR, can do policy governed automatic DR Allocate memory in 4MB granularity, can DR in a running domain on 256MB boundaries Can do DR on Virtual IO devices 39

40 LDOM 安全的在线迁移 消除应用停机窗口 Live Migration on the same or different generations of supported SPARC T-Series and M- Series systems SPARC M5, M6, T5, T4, SPARC T3, UltraSPARC T2 Plus, UltraSPARC T2 On-chip crypto accelerators deliver secure, wirespeed encryption for live migration No additional hardware required Eliminates requirement for dedicated network More secure, more flexible Shared Storage 40

41 Solaris Zone 随处可见 Global Zone and Zones Share OS running instance Same OS kernel Support legacy containers Brand Zone Solaris 10 in Solaris 11 Solaris 9/8 in Solaris 10 Migrate old software onto modern hardware Whole core Zone treated as Hard partition for licensing 41

42 Solaris Zone Is like a virtualized OS Environment Each Zone can be administered independently Provides a virtual console for each Zone Details of System Topology and allocation can be kept hidden from a Zone Full resource containment and control CPU, memory, IP, network data flow, file system, disk, etc. No performance overhead Up to 8192 Zones Great for Software fault isolation Great for Security isolation Processes in one Zone cannot see or affect processes in other Zones 42

43 Solaris Zone 方便 CPU 资源的隔离或共享 dedicated-cpu; capped-cpu; cpu-shares with FSS scheduler 43

44 Solaris Zone 可管理性 Zones are Easy to create / delete / backup / restore / Easily cloneable (ZFS integration) Mobile Start or Reboot in seconds Zones allow RAW disk I/O ZFS management delegation Observability with DTrace within a Zone too Boot environment management within a Zone 44

45 LDOMs 配合 Zones Oracle Works With Oracle 45

46 互为补充的技术 OVM for SPARC 1 thread granularity Hardware level Works with Hypervisor Every LDOM needs its own OS instance Different OS versions or kernels are allowed in different LDOMs Live migration Available on T series, M series FREE Zone 1 thread granularity or CPU share or share CPU OS Level Have resource control Share maintenance window Share OS kernel instances Hardware independent Available on Solaris 10/11 Native performance FREE LDOM and Zone can be used together 46

47 DIY 之整合存储 47

48 数据库数据的多样性不同的数据读写特征, 不同的响应时间需求 Data Type Storage Class LUN Performance Profile Priority Access Bias I/O Bias Control files SSD or FC High / Premium Mixed Mixed Database Index SSD High Mixed Mixed Database Tables SATA Medium Mixed Mixed Temporary files SATA Medium Mixed Mixed Online Redo Log Files FC High Sequential Write Archive Log Files SATA Low Sequential Write 仅控制数据存储介质就足够吗? 当多个不同业务并发作业时, 当大数据量同时迸发时 大部分 Cache 被谁使用?Cache 里的数据是否最应该在 Cache 里? 大部分磁阵控制器的 CPU 时间片被谁使用? 是否用在了最关键的数据上? 通道队列中最重要的数据是否得到了最及时的处理与响应? 48

49 如果不做应对 不同业务 不同应用 不同数据库可能无法共享同一存储 同一业务 应用 数据库中的某些重要性很低的操作可能对另外一些重要性高的操作造成明显的负面影响 因为 在多个不同业务并发作业 大数据量同时迸发时, 存储的处理资源有可能被优先级低的数据大量占据, 导致关键作业的响应时间得不到保证, 服务质量下降明显 49

50 QoS What Axiom 600 Has 50

51 Application Profiles Pre-tested optimal provisioning and QoS settings include QoS Level (I/O Priority) Access and IO Bias RAID level/thin Provisioning Caching behavior and read-ahead Most application types ship prebuilt with every FS Oracle Database / OLTP Archive / ILM Business Analytics / OLAP Microsoft Exchange Business Applications: CRM, ERP, HR Data Type Control Files Database Index Database Tables Oracle Database / OLTP Example Recommended Storage Class SSD/10K SSD SSD/10K/7.2K Priority Premium - High Premium - High Premium - Medium Access Bias Mixed Mixed Mixed I/O Bias Mixed Mixed Mixed Temp Files 7.2K Medium Mixed Mixed Online redo Log Files Archive Log Files 10K High Sequential Write 7.2K Low Sequential Write 51

52 Oracle Automatic Storage Management FS Application Profiles pre-built for ASM Integrated cluster file system and volume manager with Oracle DB Simplifies storage provisioning, array migration, and consolidation Distributes data evenly after storage configuration for max performance 52

53 Heat Map LUN Granularity to Sub-LUN Granularity LUN Fat Disk LUN SSD LUN Perf. Disk DREAM LUN Hot Frequent access Warm Semi-frequent access Cold Infrequent access REALITY 53

54 Market Leading QoS+ Adapts to Lowest Cost & Highest Performance by Business Priority QoS+: Oracle's patented Quality of Service for Storage, a policy-based virtualization management feature incorporating business priority and performance optimization, is now fused with sub-lun automatic tiering into one simple management framework. Domain n Performance and Capacity Flash Performance Disk Capacity Disk $/IOP T 0 Domain n T 1 T 2 Run Pin Learn & Hold Adjust Rate Throttle $/TB 54

55 The FS1 Solution: QoS+ Automate Sub-LUN Tiering across all tiers of storage and RAID levels with the most cost-effective granularity (640k blocks) Competitors do this, but some at < 1/1000th the granularity Offer controls to the user regarding data movement: Frequency, and Speed. FS is extremely flexible and has unique Fast Learn mode Preferentially move data by Business Value, and frequency of reference (QoS+) Nobody has this except Oracle. Optimize data layout based on user control and measured read/write ratio (bias) Oracle, and Compellent (DELL) have this Organize resource pools into storage domains Only Oracle, Hitachi have this. 55

56 DIY 之高可靠性 56

57 T5 System RAS RAS Design Everywhere S11 FMA Diagnosis engine on SP Auto reconfigure on failure Soft Error Rate Discrimination (SERD) Bad page retirement OS and SP watchdogs FMA Component hot-upgradeable T5 Processor L1$ Tag, Status & Data Parity protection Retry on error L2$/L3$ Data SEC/DED protection Cache-line Sparing L2$/L3$ Tags SEC/DED protection Inline Correction Cache-line Sparing L2$/L3$ Status & Directory SEC/DED protection Inline Correction Architectural RegistersL2 Cache SEC/DED protection Precise Trap and Hypervisor Correction and Retry Hypervisor Enables software partitioning (Ldoms) virtualization and failure containment Processor support for error clearing, correction and collection Solaris Hypervisor System Memory L3 Cache L2 Cache L1 Cache Core ** Post-RR System Diagnosis to the FRU level on first fault Power and Cooling Advanced Power Management Redundant hot-swap fans Redundant hot-swap AC/DC Dual grid power System I/O PCI-Express end-to-end CRC PCI Express link retry Hot-plug low profile PCI Express cards Redundant, hot-plug boot disks Alternate connections between M5 and IO Controllers Memory SDRAM Soft Errors ECC Protection and Correction Extended ECC Protection 4-bit Correction Pin Steering Channel Interconnect CRC protection/message Retry Lane Sparing 57

58 Oracle Solaris Cluster Mission-Critical Cloud Infrastructures If you need: Mission-critical service level No downtime for maintenance Business Continuity > > > Oracle Solaris Cluster delivers: Faster, automatic failover for key business applications Managed switchover of resources among servers or sites Safe, automated recovery from site failure Local data center cluster Multi-site stretched/ campus cluster Multi-site, multiple clusters 58

59 企业级高可靠性 Monitors health of the cluster components Servers, Storage, Network OS, Virtual Machines Applications Tolerates any failure Exploits HW redundancy Robust software algorithms Heartbeats, Membership Cluster Configuration Quorum Fencing Resource Group Manager Recovers cluster infrastructure and applications 59

60 LDOMs 与 Solaris Cluster 配合 Oracle Works With Oracle Setup cluster with 2 or more LDOMs Cluster software installed in LDOMs HA for DB or App running in LDOMs Setup cluster to take LDOMs as data services Cluster software installed in Primary Domain HA for Guest Domain Support domain migration 60

61 Solaris Zones 与 Solaris Cluster 配合 Oracle Works With Oracle Setup cluster in Global Zone HA for Zone / Flying Zone HA for Data Services in Zone Zone Cluster Delegate cluster administration tasks to DB/App administrator 61

62 企业级可靠性 2.5x Faster Failure Detection and Recovery 62

63 总结 63

64 Whole Red Stack Oracle 独有的 全红堆栈 多样选择, 满足不同的需求与预算 原厂设计 整合 测试 安装 维护 独有的功能与性能特点 每一环节都为 Oracle 数据库优化 每一层次都为相互配合优化 大量性能指标纪录 公测! 实测! 并非由低配线性推导得出 明确的产品路线图 Simplify IT 64

65 65

66 66