Storage Optimization with Oracle Database 11g

Transcription

1 Storage Optimization with Oracle Database 11g

2 Terabytes of Data Reduce Storage Costs by Factor of 10x Data Growth Continues to Outpace Budget Growth Rate of Database Growth Source: Winter TopTen Survey, Winter Corporation, Waltham MA, 2008.

3 Critical Storage Challenges Storage Efficient Management Reduce Cost Optimize Performance Manage Better Storage Goals Reduce Costs Mitigate Risk Data Loss Protection

4 Critical Storage Challenges Storage Efficient Management Reduce Cost Optimize Performance Manage Better Storage Goals Reduce Costs Mitigate Risk Data Loss Protection

5 Optimize Performance Key metric is I/O per second (IOPs) Assume for sizing purposes: 5 IOPs per transaction achievable IOPs per SAS disk 50 per achievable IOPs SATA disk # Disks required = # Transactions per sec * 5 Achievable IOPs Data Warehouse

6 Optimize Performance Key metric is I/O per second (IOPs) Assume for sizing purposes: 5 IOPs per transaction achievable IOPs per SAS disk 50 per achievable IOPs SATA disk # Disks required = # Transactions per sec * 5 Achievable IOPs Key metric is I/O bandwidth (MB/s) Assume for sizing purposes: 1 core requires ~ 200 MB/s to be kept busy Drives today do around MB/s # Disks required = # Cores * 200/20 Data Warehouse OLTP

7 Optimize Performance Don t Forget the Rest Double disks for mirroring Add extra for back-up, test, etc. Size HBA and switches to keep throughput balanced Plan for linear performance scalability as data volumes increase Today, database performance is limited by storage

8 Sun Oracle Database Machine Perfectly Balanced Environment Oracle Database Server Grid 8 Database Servers 400 GB DRAM Exadata Storage Server Grid 14 Storage Servers 5TB Smart Flash Cache 336 TB Disk Storage Unified Server/Storage Network 40 Gb/sec Infiniband Links 880 Gb/sec Aggregate Throughput Completely Fault Tolerant Extreme Performance out-of-the-box

9 Pre-built Database Cloud Oracle Exadata Best for Database Cloud Only database machine that runs and scales all workloads Lower total cost of ownership Faster Deployment Lower Risk Higher Quality Implementation Supports all Database Cloud capabilities

10 Exadata Storage Servers Breaks Data Bandwidth and Random I/O Bottleneck Sun Fire X4275 Server 2 Quad-Core Intel Xeon E5540 CPUs 24GB RAM Dual-port 40Gb/s InfiniBand card Disk options: 12 x 600 GB SAS disks (7.2 TB total) 12 x 2TB SATA disks (24 TB total) 4 x 96 GB Sun Flash PCIe Cards 384GB total Hardware by Software by

11 Exadata Database Machine Breaks Data Bandwidth and Random I/O Bottleneck Removes Random I/O bottlenecks Up to 75,000 IOPS with Flash storage Queries run in storage Offloading from database server CPUs Return query results sets Up to 1.5 GB/sec data bandwidth per cell Completely scalable infrastructure Storage capacity Processing power Data bandwidth

12 Database and Storage Smart Flash Cache Integrated Solid State Storage Devices Transparently extends buffer cache with flash storage Increases caching and eliminates most I/Os Faster response times using less power Available on Solaris and Unbreakable Linux servers

13 Partition Pruning Improves Performance Q: What was the total sales revenue for Q3 in 2009? Only the relevant partitions are accessed

14 Less Storage = Better Performance Using Partitioning, Compression Benefits Multiply 10 TB of user data Requires 10 TB of IO 1 TB with compression 100 GB with partition pruning 20 GB with Storage Indexes 5 GB Smart Scan on Memory or Flash Subsecond On Database Machine Data is 10x Smaller, Scans are 2000x faster

15 Eli Lysen Senior Manager, ICT TUI TUI chose the Sun Oracle Database Machine because it was the only platform that would meet both our needs for all of our database requirements, including OLTP, as well as be the best platform for a high performance data warehouse.

16 Critical Storage Challenges Storage Efficient Management Reduce Cost Optimize Performance Manage Better Storage Goals Reduce Costs Mitigate Risk Data Loss Protection

17 Traditional Computing Environments Silos of dedicated hardware and software Single application per silo Inefficient and expensive to size for peak load Inflexible and unresponsive to changing business needs Expensive to manage

18 Cloud Computing Environments Resource pooling Rapid provisioning Elasticity Dynamic QoS Self-service Pay-for-use pricing

19 Automatic Storage Management Lowers the Cost of Storage Management Virtualizes and shares storage resources Online addition and migration of storage Advanced data striping for maximum I/O performance

20 ASM Cluster File System Database Files OS Files Oracle Binaries General purpose clustered or local file system Optimized disk layout, online rebalance, mirroring Volume management, read-only snapshots

21 Manage Data Growth Partition for Better Management Archival Full partition autonomy Partitions are visible and usable for database administration Optimized local indexing technique Bulk of management operations, queries etc. Full partition-aware maintenance operations Data loading Online maintenance capabilities without user impact or interference

22 Sean Wiley CTO & Director EDS Applications Services EDS Using partitioning with Oracle Database gives us a lot of advantages we get the performance and management characteristics of a much smaller table within a larger data set."

23 Critical Storage Challenges Storage Efficient Management Reduce Cost Optimize Performance Manage Better Storage Goals Reduce Costs Mitigate Risk Data Loss Protection

24 Value at Risk Information Lifecycle Management Managing Data During its Lifetime to Reduce Storage Cost High Value Storage Networking Industry Association (SNIA) Data Management Forum Medium Value Low Value $ $$ $$$ Total Cost of Ownership (TCO)

25 Value of Information Information Lifecycle Management Managing Data during its Lifetime to Reduce Storage Cost High Value 30 kwh Storage Networking Industry Association (SNIA) Data Management Forum Medium Value 2 kwh Low Value $ $$ $$$ Total Cost of Ownership (TCO) Save on power, heating, cooling by moving data from High End to Lower Cost storage devices

26 Manage Data Growth Partition to Reduce Cost % Less Active 5% Active Distribute tables across multiple storage tiers Scale-out storage at 2-3x less cost per terabyte No changes to existing applications

27 Traditional Data Lifecycle Archive Less Less Historical Data Lifecycle Active Active Active Offline Archive $ High Performance Storage Tier $$$$

28 Information Lifecycle Management Lower Cost by Matching Data to Storage Archive Less Less Historical Data Lifecycle Active Active Active Offline Archive $ Online Archive Storage Tier $$ Low Cost Storage Tier $$$ High Performance Storage Tier $$$$

29 Information Lifecycle Management Taking Advantage of Flash Storage (R)evolution Archive Less Less Historical Data Lifecycle Active Active Active Hyper Active Offline Archive $ Online Archive Storage Tier $$ Low Cost Storage Tier $$$ High Performance Storage Tier $$$$ SSD/Flash Storage Tier $$$$$

30 Reduce Storage Requirements Advanced OLTP Compression Up to 4X Compression Compress large OLTP and Data Warehouse tables Improve query performance for table scans No changes to existing applications Cascade storage savings throughout data center

31 Oracle s Global Single Instance 215 TB of Total Storage Savings! Tables Indexes Original Compressed LOBs 3x storage saving on production database 4x table compression 2x index compression 2.3x LOB compression Savings cascade across test, backups & mirrors

32 Oracle Exadata Hybrid Columnar Compression Up to 50X Data stored by column and then compressed Query mode for data warehousing tables Typical 10x compression ratios Archival mode for old data Typical 15-50x compression ratios

33 Other Compression Techniques COMPRESSION TYPE: Basic Compression OLTP Compression SecureFiles Compression Index Compression Backup Compression Hybrid Columnar Compression Data Warehousing Hybrid Columnar Compression Archival SUITABLE FOR: Read only tables and partitions in Data Warehouse environments or inactive data partitions in OLTP environments. Active tables and partitions in OLTP and Data Warehouse environments. Non-relational data in OLTP and Data Warehouse environments. Indexes on tables in OLTP and Data Warehouse environments. All environments. Read only tables and partitions in Data Warehouse environments. Inactive data partitions in OLTP and Data Warehousing environments.

34 Feeling the Storage Squeeze?

35 Mike Prince Chief Technology Officer Burlington Coat Factory Our Chief Financial Officer likes the Advanced Compression option of Oracle Database 11g because with it we won't need two thirds of the disks we have right now.

36 Critical Storage Challenges Storage Efficient Management Reduce Cost Optimize Performance Manage Better Storage Goals Reduce Costs Mitigate Risk Data Loss Protection

37 Protect Against Data Loss ASM Mirroring ASM Disk Group Efficient 3-way mirroring and striping Flexible redundancy choices Complements hardware RAID mirror and parity protection

38 Oracle Secure Backup Unified backup management Comprehensive tape data protection: Unix / Linux / Windows / NAS file systems Oracle Databases: Oracle9i forward Secure inter-domain communications Central administration for distributed backups Supports over 200 tape devices Read-only Tables & Tablespaces reduce the need to backup

39 Comprehensive Oracle Data Validation Oracle Database checks to detect and repair corruptions In data and redo blocks using checksum validation Detects writes acknowledged, but actually lost by the I/O subsystem Various checks can be configured by the administrator Choose the desired protection level Can be configured for data blocks / data + index blocks Specific technologies provide additional validation Recovery Manager Automatic Storage Management Data Guard

40 Efficiently Backup and Restore Data Utilizing Integrated Tiered Storage Secure Backups to Cloud and Tape Automatic Storage Management Recovery Manager Data Guard Real Application Clusters Active Data Guard

41 Revolution in Error Recovery Flashback Operates on Changed Data Only Reduces correction time from hours to minutes No longer a factor of database size Applies to all types of user errors End users Developers Administrators Simple to use Single command instead of complex procedures Much faster and easier than traditional recovery Correction Time = Error Time + f(db_size)

42 Protect Against Loss Through Disaster Oracle Data Guard Production Database Standby Database Less expensive than remotely mirrored storage Less network bandwidth required Data corruptions not propagated Standby database can be utilized

43 Sue Merrigan Director, Information Management Intermap Technologies With Oracle Active Data Guard we maintain 24 by 7 availability to client application services while also making available our physical standby database to customers for read-only access for reports and queries.

44 Storage Management What Customers Think

45 Critical Storage Challenges Storage Efficient Management Reduce Cost Optimize Performance Manage Better Storage Goals Reduce Costs Mitigate Risk Data Loss Protection

46 Summary Many customers are successfully deploying Private Database Clouds today They are benefiting from high quality of service, low cost, reduced complexity and increased agility Private Database Clouds consolidate servers, storage, operating systems, databases, and workloads Exadata is a pre-integrated, highly optimized platform for deploying Private Database Clouds that maximizes ROI

47 For More Information storage management or oracle.com/database

48