<Insert Picture Here> South Fla Oracle Users Group Oracle/Sun Exadata Database Machine June 3, 2010

Transcription

1 <Insert Picture Here> South Fla Oracle Users Group Oracle/Sun Exadata Database Machine June 3, 2010

2 Safe Harbor Statement The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions. The development, release, and timing of any features or functionality described for Oracle s products remain at the sole discretion of Oracle. 2

3 Agenda - Exadata Exadata Database Machine Overview Exadata Based Product Offerings Exadata Architecture and Features Best Data Warehousing Machine Best OLTP Machine Best Consolidation Machine 3

4 World's First DW and OLTP Database Machine with Sun FlashFire Technology New Now the Sun Oracle Database Machine is the best for OLTP, Data Warehouse, and Consolidated Database workloads 4

5 Drastically Simplified Deployments Database Machine eliminates the complexity of deploying database systems Months of configuration, troubleshooting, tuning Database Machine is ready on day one Pre-built, tested, standard, supportable configuration Runs existing applications unchanged Extreme performance out of the box Up to 10x faster that other hardware Months to Days 5

6 Fastest Time to Implement / Lowest Risk Build From Scratch with Components Reference Configurations Sun Oracle Database Machine Testing and Validation Installation and configuration Acquisition of components Pre-implementation System sizing Weeks to Months Time To ROI / Level of Risk Testing and Validation Installation and configuration Acquisition of components Weeks to Months Faster deployment Lower Risk Database pre-configured Take delivery of Sun Oracle Database Machine < 1 Week after Delivery 6

7 The Products Exadata Storage Server & Database Machine Exadata Storage Server Storage Product Optimized for Oracle Database Extreme I/O and SQL Processing performance Combination of hardware and software Exadata Storage Server Software Sun Oracle Database Machine Pre-Configured High Performance Balanced performance configuration Takes the guess work out of building an Oracle deployment Exadata Storage Server Software Oracle Database 11.2 on OEL 7

8 Exadata Database Machine Platform Description A fully fully optimized server & storage platform for for Oracle databases: Designed Designed to to address address traditional traditional I/O I/O limitations limitations of of multi-purpose multi-purpose servers servers Leverages Leverages commodity commodity components components to to deliver deliver a lower lower total total cost cost of of ownership ownership Pre-built Pre-built & configured configured for for extreme extreme out out of of the the box box performance performance Automated Automated management management of of storage storage and and operations operations to to deliver deliver consistently consistently superior superior performance performance with with low low operational operational costs costs Full RAC Database Server Grid 8 High-performance low-cost compute servers 2 Intel quad-core Xeons each Total 64 cores 72 GB Memory each Total 576 GB Memory Exadata Storage Server Grid 14 High-performance low-cost storage servers 100 TB raw SAS disk storage or 336 TB raw SATA disk storage InfiniBand Network 40 Gb/sec fault-tolerant unified server and storage network 5 TB flash storage! 2009 Oracle Corporation 8

9 Sun Oracle Database Machine Extreme Performance RAC Database Server Grid Millions of transactions per minute Tens of millions of queries per minute Billions of rows per minute Exadata Storage Server Grid 21 GB/sec disk bandwidth 50 GB/sec flash bandwidth 1 million I/Os per second InfiniBand Network 880 Gb/sec aggregate throughput 9

10 Sun Exadata Database Machine Hardware SunFire X4170 Server Sun Exadata Storage Server Hardware 2 Quad-Core Intel Xeon E GHz Processors 72 GB RAM Hardware by 4 X 146 GB SAS Drives Dual port InfiniBand Host Channel Adapter 4 X 1 GB/second Ethernet ports Software by Dual-redundant, hot swappable power supplies 10

11 Sun Exadata Storage Server Hardware Sun Exadata Storage Server Hardware Hardware by Software by Building block of massively parallel Exadata Storage Grid Up to 1.5 GB/sec raw data bandwidth per cell Up to 75,000 IOPS with Flash Sun Fire X4275 Server 2 Quad-Core Intel Xeon E5540 Processors 24 GB RAM Dual-port 4X QDR (40Gb/s) InfiniBand card Disk Options 12 x 600 GB SAS disks (7.2 TB total) 12 x 2 TB SATA disks (24 TB total) 4 x 96 GB Sun Flash PCIe Cards (384 GB total) Software pre-installed Oracle Exadata Storage Server Software Oracle Enterprise Linux Drivers, Utilities Single Point of Support from Oracle 11

12 Sun Exadata Storage Server Hardware Dual-redundant, hotswappable power supplies 24 GB DRAM ILOM Disk Controller HBA with 512M battery backed cache 12 x 3.5 Disk Drives 2 Quad-Core Intel Xeon Processors InfiniBand QDR (40Gb/s) dual port card 4 x 96GB Sun Flash PCIe Cards Pre-installed Software: Oracle Exadata Storage Server Software Oracle Enterprise Linux Drivers 12

13 Sun Flash Accelerator F20 PCIe Card Capacity and Connectivity 96GB Flash memory 256MB cache Low-profile PCIe HBA card Random I/O Performance 120k IOPS / 1GB/s read 32k IOPS / 600MB/s write Availability Persistent enterprise flash (SLC) Integrated super cap - power reserve SSD SSD DOM DOM Form Form Factor Factor SAS SAS HBA HBA SuperCap SuperCap Power Power Reserve Reserve Turbo-charge applications instantly and improve efficiency with FlashFire Technology 13

14 Infiniband Network Qty x 2 or 3 Sun Datacenter Infiniband Switch 36 A 1RU 36 port managed QDR InfiniBand Switch. All Database Servers and Sun Exadata Storage Servers Data Facing Servers Dual Port HCA QSFP connection from Server to two separate switches Provides Redundant single HCA Path for all servers All SQL Queries and Replies for all Servers utilize IB Network Embedded OpenSM for IB Fabric 14

15 Storage Bottlenecks Today, database performance is limited by storage Storage systems limit data bandwidth from storage to servers Storage Array internal bottlenecks SAN bottlenecks Random I/O bottlenecks due to physical disk speeds Data Bandwidth limits severely restrict performance for data warehousing Random I/O bottlenecks limit performance of OLTP applications 15

16 Exadata Smart Storage Breaks Data Bandwidth and Random I/O Bottleneck Oracle addresses data bandwidth bottleneck three ways Massively parallel storage grid of high performance Exadata storage servers (cells). Data bandwidth scales with data volume Data intensive processing runs in Exadata storage. Queries run in storage as data streams from disk, offloading database server CPUs Columnar compression reduces data volume up to 10x Exadata Hybrid Columnar Compression provides 10x lower cost, 10x higher performance Oracle solves random I/O bottlenecks using Exadata Smart Flash Cache Increase random I/Os by factor of 20X Exadata Storage Cells 16

17 Exadata Storage Software Features Exadata Smart Scans 10X or greater reduction in data sent to database servers Exadata Storage Indexes Eliminate unnecessary I/Os to disk Hybrid Columnar Compression (HCC) Efficient compression increases effective storage capacity and increases user data scan bandwidths by a factor of 10X Exadata Smart Flash Cache Breaks random I/O bottleneck by increasing IOPs by 20X Doubles user data scan bandwidths Inter-leaved Grid Disks Enables storage grid that allows multiple applications to place frequently accessed data on faster portions of the disk I/O Resource Manager (IORM) Enables storage grid by prioritizing I/Os to ensure predictable performance 17

18 Exadata Smart Scan Exadata cells implement scan offload to greatly reduce the data sent to database servers Row filtering based on where predicate Column filtering Join filtering Incremental backup filtering Scans on encrypted data Data Mining model scoring 10x data reduction is common Completely application transparent Even if cell or disk fails during a query 18

19 Traditional Scan Processing Smart Scan Example: Telco wants to identify SELECT customer_name FROM calls WHERE amount > 200; Table Extents Identified I/Os Issued Rows Returned DB Host reduces terabyte of data to 1000 customer names that are returned to client I/Os Executed: 1 terabyte of data returned to hosts customers that spend more than $200 on a single phone call The information about these premium customers occupies 2 MB in a 1 terabyte table With traditional storage, all database intelligence resides in the database hosts Very large percentage of data returned from storage is discarded by database servers Discarded data consumes valuable resources, and impacts the performance of other workloads 19

20 Exadata Smart Scan Processing SELECT customer_name FROM calls WHERE amount > 200; Smart Scan Constructed And Sent To Cells Smart Scan identifies rows and columns within terabyte table that match request Rows Returned Consolidated Result Set Built From All Cells 2 MB of data returned to server Only the relevant columns customer_name and required rows where amount>200 are are returned to hosts CPU consumed by predicate evaluation is offloaded to Exadata Moving scan processing off the database host frees host CPU cycles and eliminates massive amounts of unproductive messaging Returns the needle, not the entire hay stack 20

21 Smart Scan Transparency Smart scans are transparent to the application No application or SQL changes required Returned data is fully consistent and transactional If a cell dies during a smart scan, the uncompleted portions of the smart scan are transparently routed to other cells containing a replica of the data Smart Scans correctly handle complex cases including Uncommitted data and locked rows Chained rows Compressed tables National Language Processing Date arithmetic Regular expression searches Partitioned tables High Throughput, Reduced Overhead, No Complex Tuning 21

22 Exadata Storage Index Transparent I/O Elimination with No Overhead A Table B C D 1 Index Exadata Storage Indexes maintain summary information about table data in memory Store MIN and MAX values of columns Typically one index entry for every MB of disk 3 5 Min B = 1 Max B =5 Eliminates disk I/Os if MIN and MAX can never match where clause of a query Min B = 3 Max B =8 Completely automatic and transparent Select * from Table where B<2 - Only first set of rows can match 22

23 Data Growth Challenges IT must support exponentially growing amounts of data Without hurting performance Without growing cost Powerful and efficient compression is key 23

24 Exadata Hybrid Columnar Compression Data is stored by column and then compressed Query Mode for data warehousing Optimized for speed 10X compression ratio is typical Scans improve proportionally Archival Mode for infrequently accessed data Optimized to reduce space 15X compression is typical Up to 50X for some data Up To 50X 24

25 Exadata Hybrid Columnar Compression Compression Unit Column 1 Column 2 Reduces 4x Table to 50x Size Reduction 4x to 40x Column 3 Tables are organized into sets of a few thousand rows called Compression Units (CUs) Within Compression Unit, data is Organized by Column and then compressed Column organization brings similar values close together, enhancing compression Useful for data that is bulk loaded and queried Update activity is light 25

26 Exadata Hybrid Columnar Compression Warehousing and Archiving Warehouse Compression Optimized for Speed 10x average storage savings 10x Scan I/O reduction Archive Compression Optimized for Space 15x average storage savings Up to 50x on some data Some access overhead For cold or historical data Smaller Warehouse Faster Performance Reclaim 93% of Disks Keep Data Online Can mix compression types by partition for ILM 26

27 Real-World Compression Ratios Oracle Production E-Business Suite Tables Size Reduction Factor by Table OLTP Compression (avg=3.3) Query Compression (avg=14.6) Archive Compression (avg=22.6) Columnar compression ratios Query = 14.6X Archive = 22.6X Vary by application and table 27

28 Exadata Smart Flash Cache Breaks the Disk Random I/O Bottleneck 300 I/O per Sec Trade-off between traditional disks drives and Flash Disk drives are cheap, high capacity but low I/Os per second (300 IOPS per disk) Flash is expensive, lower capacity but can support tens of thousands of I/Os per second Tens of Thousands of I/O s per Second Ideal Solution - Exadata Smart Flash Cache Keep most data on disk for low cost Transparently move hot data to flash Use flash cards instead of flash disks to avoid disk controller limitations Flash cards in Exadata storage High bandwidth, low latency interconnect 4 x 96 GB PCI Express Flash Cards per Exadata Server 28

29 Exadata Logical Flash Disks Logical Flash Disks Configure a portion or all of the Flash memory to act as persistent Logical Flash Disks Treat them just like regular disks Create ASM diskgroups across these Flash disks like any other ASM diskgroup Data is automatically mirrored by ASM across these Flash disks with the mirrored copy on other Exadata Storage Servers High Performance for write-intensive workloads 29

30 Interleaved Grid Disks Grid disks are optionally split and interleaved to place frequently accessed data in all grid disks on higher performing outer tracks Grid Disk 1 Hot Data, Cold Data All applications benefit from higher performance outer tracks of disks Grid Disk 2 Hot Data, Cold Data 30

31 Exadata Configuration Single-Instance Database RAC Database InfiniBand Switch/Network Exadata Cell Exadata Cell Exadata Cell Each Exadata Cell is a self-contained server which houses disk storage and runs the Exadata software Oracle Databases are deployed across multiple Exadata Cells Oracle Database enhanced to work in cooperation with Exadata Storage Server No practical limit to number of Cells that can be in the grid 31

32 Exadata Storage Layout Example ASM Mirroring and Failure Groups ASM Failure Group Exadata Cell Exadata Cell ASM Failure Group Hot Hot Hot Cold Cold Cold Hot Hot Hot Cold Cold Cold Example shows cell disks divided into two grid disks ASM hot and cold Disk Group Two ASM disk groups created across the two sets of grid disks ASM striping evenly distributes I/O across the disk groups ASM mirroring is used to protect against disk failures ASM failure groups are used to protect against cell failures 32

33 Exadata I/O Resource Management Multi-Database Environment Ensure different databases are allocated the correct relative amount of I/O bandwidth Database A: 33% I/O resources Database B: 67% I/O resources Ensure different users and tasks within a database are allocated the correct relative amount of I/O bandwidth Database A: Reporting: 60% of I/O resources ETL: 40% of I/O resources Database B: Interactive: 30% of I/O resources Batch: 70% of I/O resources Database A Database B InfiniBand Switch/Network Exadata Cell Exadata Cell Exadata Cell 33

34 Exadata Storage Management & Administration Enterprise Manager Manage & administer Database and ASM Exadata Storage Plug-in Enterprise Manager Grid Control Plug-in to monitor & manage Exadata Storage Cells Comprehensive CLI Local Exadata Storage cell management Distributed shell utility to execute CLI across multiple cells Sun Embedded Integrated Lights Out Manager (ILOM) Remote management and administration of hardware 34

35 Exadata Storage Plug-in Enterprise Manager Grid Control Plug-in to monitor & manage Exadata Storage Cells Works with Enterprise Manager Grid Control and later versions 35

36 Data Protection Solutions All single points of failure eliminated by the Exadata Storage architecture Hardware Assisted Resilient Data (HARD) built in to Exadata Storage Prevent data corruption before it happens Data Guard provides disaster protection and data corruption protection Automatically maintains one or more copies of the database Flashback provides human error protection Snapshot-like capabilities to rewind database to before error Recovery Manager (RMAN) provides backup to disk Archiving and corruption protection Can be used with Oracle Secure Backup (OSB) or third party tape backup software These work just as they do for traditional non-exadata storage Users and database administrator use familiar tools 36

37 Start Small and Grow Quarter Rack Half Rack Full Rack 37

38 Sun Oracle Database Machine Quarter Rack Pre-Configured for Extreme Performance 2 Sun Fire X4170 Oracle Database servers 2 Intel quad-core Xeons, 72GB RAM each Total 16 cores Total 144 GB Memory 3 Exadata Storage Servers (All SAS or all SATA) 2 Sun Datacenter InfiniBand Switch port Managed QDR (40Gb/s) switch 1 Admin Cisco Ethernet switch Keyboard, Video, Mouse (KVM) hardware Redundant PDUs Single Point of Support from Oracle Can Upgrade to an Half Rack 38

39 Sun Oracle Database Machine Half Rack Pre-Configured for Extreme Performance 4 Sun Fire X4170 Oracle Database servers 2 Intel quad-core Xeons, 72GB RAM each Total 32 cores Total 288 GB Memory 7 Exadata Storage Servers (All SAS or all SATA) 2 Sun Datacenter InfiniBand Switch port Managed QDR (40Gb/s) switch 1 Admin Cisco Ethernet switch Keyboard, Video, Mouse (KVM) hardware Redundant PDUs Single Point of Support from Oracle Can Upgrade to a Full Rack 39

40 Sun Oracle Database Machine Full Rack Pre-Configured for Extreme Performance 8 Sun Fire X4170 Oracle Database servers 2 Intel quad-core Xeons, 72GB RAM each Total 64 cores Total 576 GB Memory 14 Exadata Storage Servers (All SAS or all SATA) 3 Sun Datacenter InfiniBand Switch port Managed QDR (40Gb/s) switch 1 Admin Cisco Ethernet switch Keyboard, Video, Mouse (KVM) hardware Redundant Power Distributions Units (PDUs) Single Point of Support from Oracle Add more racks for additional scalability 40

41 Scale Performance and Capacity Scalable Scales to 8 rack database machine by just adding wires More with external InfiniBand switches Scales to hundreds of storage servers Multi-petabyte databases Redundant and Fault Tolerant Failure of any component is tolerated Data is mirrored across storage servers 41

42 Exadata Database Machine Product Family Quarter Rack Half Rack Full Rack 2-8 Full Racks Database Servers Exadata Storage Servers Total Disk Capacity 21 TB 50 TB 100 TB TB User Data uncompressed 6 TB 14 TB 28 TB TB I/O Throughput (disks) 4.5 GB/sec 10.5 GB/sec 21 GB/sec GB/sec I/O Throughput (flash) 11 GB/sec 25 GB/sec 50 GB/sec GB/sec I/O per Second (IOPS) 225, ,000 1,000,000 1M 8M Racks

43 Exadata Product Capacity Quarter Rack Half Rack Full Rack SAS 21 TB 50 TB 100 TB Raw Disk 1 SATA 72 TB 168 TB 336 TB Raw Flash TB 2.6 TB 5.3 TB User Data 2 SAS 6 TB 14 TB 28 TB (assuming no compression) SATA 21 TB 50 TB 100 TB 1 Raw capacity calculated using 1 GB = 1000 x 1000 x 1000 bytes and 1 TB = 1000 x 1000 x 1000 x 1000 bytes. 2 - User Data: Actual space for end-user data, computed after single mirroring (ASM normal redundancy) and after allowing space for database structures such as temp, logs, undo, and indexes. Actual user data capacity varies by application. User Data capacity calculated using 1 TB = 1024 * 1024 * 1024 * 1024 bytes. 43

44 Exadata Product Performance Quarter Rack Half Rack Full Rack Raw Disk Data SAS 4.5 GB/s 10.5 GB/s 21 GB/s Bandwidth 1,4 SATA 2.5 GB/s 6 GB/s 12 GB/s Raw Flash Data Bandwidth 1,4 11 GB/s 25 GB/s 50 GB/s Max User Data Bandwidth 2,4 (10x compression & Flash) 110 GB/s 250 GB/s 500 GB/s SAS 10,800 25,000 50,000 Disk IOPS 3,4 SATA 4,300 10,000 20,000 Flash IOPS 3,4 225, ,000 1,000,000 Data Load Rate 4 1 TB/hr 2.5 TB/hr 5 TB/hr 1 Bandwidth is peak physical disk scan bandwidth, assuming no compression. 2 - Max User Data Bandwidth assumes scanned data is compressed by factor of 10 and is on Flash. 3 IOPs Based on IO requests of size 8K 4 - Actual performance will vary by application. 44

45 Best Data Warehouse Machine OLAP ETL Massively parallel high volume hardware to quickly process vast amounts of data Exadata runs data intensive processing directly in storage Most complete analytic capabilities OLAP, Statistics, Spatial, Data Mining, Real-time transactional ETL, Efficient point queries Powerful warehouse specific optimizations Flexible Partitioning, Bitmap Indexing, Join indexing, Materialized Views, Result Cache Data Mining Dramatic new data warehousing capabilities 45

46 Exadata Storage Features Exadata Smart Scans 10X or greater reduction in data sent to database servers Exadata Storage Indexes Eliminate unnecessary I/Os to disk Hybrid Columnar Compression Efficient compression increases user data scan rates Flash doubles scan rates Combined with Hybrid Columnar Compression, scan rate is 20X more 46

47 Benefits Multiply 10 TB of user data Requires 10 TB of IO 1 TB with compression 100 GB with partition pruning 20 GB with Storage Indexes 5 GB with Smart Scans Subsecond On Database Machine Data is 10x Smaller, Scans are 2000x faster 47

48 Best OLTP Machine Only Oracle runs real-world business applications on the Grid Unique fault-tolerant scale-out OLTP database RAC, Data Guard, Online Operations Unique fault-tolerant scale-out storage suitable for OLTP ASM, Exadata Dramatic New OLTP Capabilities 48

49 Exadata Flash Solves the Random I/O Bottleneck Oracle is the First Flash Optimized Database Sun Oracle Database Machine has 5+ TB of flash storage Exadata Smart Cache caches hot data Database Machine achieves: 20x more random I/Os Over 1 million per second 2x faster sequential query I/O 50 GB/sec 10x better I/O response time Sub-millisecond Greatly Reduced Cost 10x fewer disks for IOPS Lower Power 49

50 Complete, Open, Integrated Availability Maximum Availability Architecture Real Application Clusters Active Data Guard ASM Fast Recovery Area Secure Backup WAN Protection from Server Failures Storage Failures Network Failures Site Failures Real-time remote standby open for queries Human error correction Database, table, row, transaction level Online indexing and table redefinition Online patching and upgrades 50

51 Best Consolidation Machine ERP CRM Warehouse Data Mart HR Consolidation mixes many different workloads in one system Warehouse oriented bulk data processing OLTP oriented random updates Multimedia oriented streaming files The Sun Oracle Database Machine handles any combination of workloads with extreme performance And predictable response times Dramatic new consolidation capabilities 51

52 Consolidate Servers ERP CRM Warehouse Many databases can run on Database Machine servers Shared Configuration Applications connect to a database service that runs on one or more database nodes Services can grow, shrink, & move dynamically Large databases can span nodes using RAC Multiple small databases can run on a single node HR Data Mart Predictable performance Instance caging provides predictable CPU resources when multiple databases run on the same node Restricts a database to subset of processors 52

53 Consolidate Storage Exadata and ASM allow all storage servers to be shared across databases ERP CRM Warehouse Data Mart HR Shared Configuration Advanced data striping spreads every database across all storage servers Eliminates hot-spots and captive unused space Full storage grid performance available to all databases Database or cluster level storage security Predictable Performance Exadata I/O resource manager prioritizes I/Os to ensure predictable performance At user, job, application, or database level No need for isolated storage islands 53

54 Consolidate Applications ERP CRM ERP CRM HR Warehouse Warehouse Data Mart Data Mart HR Biggest driver of ongoing cost is Multitudes of special-purpose systems Consolidate onto Database Machine High performance for all applications Low cost platform for all applications Predictable response times in a shared environment Handles all data management needs Complete, Open, Integrated 54

55 Exadata Database Machine Performance and Value to the Customer Complete Lower Cost Complete Fastest time to value & lowest risk Working database & system in weeks Server, storage, and database solution OLTP / data warehouse standard platform Server / storage consolidation Simplified management & support Fast Predictable Extreme Performance Balanced configuration out-of-the-box Database optimized for storage & Flash Scales to match growing business 55

56 Database Machine Success A query that used to take 24 hours to complete now runs in less than 30 minutes. The Oracle Database Machine beats competing solutions on bandwidth, load rate, disk capacity, and transparency. Christian Maar, CIO The Oracle Database Machine is an ideal cost-effective platform to meet our speed and scalability needs. Ketan Parekh, Manager Database Systems After carefully testing several data warehouse platforms, we chose the Oracle Database Machine. Oracle Exadata was able to speed up one of our critical processes from days to minutes.. Brian Camp, Sr. VP of Infrastructure Services 56

57 US Information & Technology Company On average 26x faster than DB2 Benchmark workload with 21 Business Objects queries Longest running query on DB2 runs 47x faster on a Database Machine Less tuning, DB2 schema with 200 indexes, DB Machine with only 12 indexes Customer purchased Database Machine in FY09 57

58 Resources Oracle.com: Oracle Exadata Technology Portal on OTN: Oracle Exadata white papers: ata-technical-whitepaper.pdf ation-to-exadata-whitepaper.pdf 58

59 Thank You D E M O N S T R A T I O N 59

60 <Insert Picture Here> South Fla Oracle Users Group Oracle/Sun Exadata Database Machine June 3, 2010