Storage Optimization with Oracle Database 11g
Terabytes of Data Reduce Storage Costs by Factor of 10x Data Growth Continues to Outpace Budget Growth Rate of Database Growth 1000 800 600 400 200 1998 2000 2002 2004 2006 2008 2010 Source: Winter TopTen Survey, Winter Corporation, Waltham MA, 2008.
Critical Storage Challenges Storage Efficient Management Reduce Cost Optimize Performance Manage Better Storage Goals Reduce Costs Mitigate Risk Data Loss Protection
Critical Storage Challenges Storage Efficient Management Reduce Cost Optimize Performance Manage Better Storage Goals Reduce Costs Mitigate Risk Data Loss Protection
Optimize Performance Key metric is I/O per second (IOPs) Assume for sizing purposes: 5 IOPs per transaction 80-110 achievable IOPs per SAS disk 50 per achievable IOPs SATA disk # Disks required = # Transactions per sec * 5 Achievable IOPs Data Warehouse
Optimize Performance Key metric is I/O per second (IOPs) Assume for sizing purposes: 5 IOPs per transaction 80-110 achievable IOPs per SAS disk 50 per achievable IOPs SATA disk # Disks required = # Transactions per sec * 5 Achievable IOPs Key metric is I/O bandwidth (MB/s) Assume for sizing purposes: 1 core requires ~ 200 MB/s to be kept busy Drives today do around 20-30 MB/s # Disks required = # Cores * 200/20 Data Warehouse OLTP
Optimize Performance Don t Forget the Rest Double disks for mirroring Add extra for back-up, test, etc. Size HBA and switches to keep throughput balanced Plan for linear performance scalability as data volumes increase Today, database performance is limited by storage
Sun Oracle Database Machine Perfectly Balanced Environment Oracle Database Server Grid 8 Database Servers 400 GB DRAM Exadata Storage Server Grid 14 Storage Servers 5TB Smart Flash Cache 336 TB Disk Storage Unified Server/Storage Network 40 Gb/sec Infiniband Links 880 Gb/sec Aggregate Throughput Completely Fault Tolerant Extreme Performance out-of-the-box
Pre-built Database Cloud Oracle Exadata Best for Database Cloud Only database machine that runs and scales all workloads Lower total cost of ownership Faster Deployment Lower Risk Higher Quality Implementation Supports all Database Cloud capabilities
Exadata Storage Servers Breaks Data Bandwidth and Random I/O Bottleneck Sun Fire X4275 Server 2 Quad-Core Intel Xeon E5540 CPUs 24GB RAM Dual-port 40Gb/s InfiniBand card Disk options: 12 x 600 GB SAS disks (7.2 TB total) 12 x 2TB SATA disks (24 TB total) 4 x 96 GB Sun Flash PCIe Cards 384GB total Hardware by Software by
Exadata Database Machine Breaks Data Bandwidth and Random I/O Bottleneck Removes Random I/O bottlenecks Up to 75,000 IOPS with Flash storage Queries run in storage Offloading from database server CPUs Return query results sets Up to 1.5 GB/sec data bandwidth per cell Completely scalable infrastructure Storage capacity Processing power Data bandwidth
Database and Storage Smart Flash Cache Integrated Solid State Storage Devices Transparently extends buffer cache with flash storage Increases caching and eliminates most I/Os Faster response times using less power Available on Solaris and Unbreakable Linux servers
Partition Pruning Improves Performance 2003-2008 2009 2010 2009 Q: What was the total sales revenue for Q3 in 2009? Only the relevant partitions are accessed
Less Storage = Better Performance Using Partitioning, Compression Benefits Multiply 10 TB of user data Requires 10 TB of IO 1 TB with compression 100 GB with partition pruning 20 GB with Storage Indexes 5 GB Smart Scan on Memory or Flash Subsecond On Database Machine Data is 10x Smaller, Scans are 2000x faster
Eli Lysen Senior Manager, ICT TUI TUI chose the Sun Oracle Database Machine because it was the only platform that would meet both our needs for all of our database requirements, including OLTP, as well as be the best platform for a high performance data warehouse.
Critical Storage Challenges Storage Efficient Management Reduce Cost Optimize Performance Manage Better Storage Goals Reduce Costs Mitigate Risk Data Loss Protection
Traditional Computing Environments Silos of dedicated hardware and software Single application per silo Inefficient and expensive to size for peak load Inflexible and unresponsive to changing business needs Expensive to manage
Cloud Computing Environments Resource pooling Rapid provisioning Elasticity Dynamic QoS Self-service Pay-for-use pricing
Automatic Storage Management Lowers the Cost of Storage Management Virtualizes and shares storage resources Online addition and migration of storage Advanced data striping for maximum I/O performance
ASM Cluster File System Database Files OS Files Oracle Binaries General purpose clustered or local file system Optimized disk layout, online rebalance, mirroring Volume management, read-only snapshots
Manage Data Growth Partition for Better Management 2003-2008 2009 2010 2009 Archival Full partition autonomy Partitions are visible and usable for database administration Optimized local indexing technique Bulk of management operations, queries etc. Full partition-aware maintenance operations Data loading Online maintenance capabilities without user impact or interference
Sean Wiley CTO & Director EDS Applications Services EDS Using partitioning with Oracle Database gives us a lot of advantages we get the performance and management characteristics of a much smaller table within a larger data set."
Critical Storage Challenges Storage Efficient Management Reduce Cost Optimize Performance Manage Better Storage Goals Reduce Costs Mitigate Risk Data Loss Protection
Value at Risk Information Lifecycle Management Managing Data During its Lifetime to Reduce Storage Cost High Value Storage Networking Industry Association (SNIA) Data Management Forum Medium Value Low Value $ $$ $$$ Total Cost of Ownership (TCO)
Value of Information Information Lifecycle Management Managing Data during its Lifetime to Reduce Storage Cost High Value 30 kwh Storage Networking Industry Association (SNIA) Data Management Forum Medium Value 2 kwh Low Value $ $$ $$$ Total Cost of Ownership (TCO) Save on power, heating, cooling by moving data from High End to Lower Cost storage devices
Manage Data Growth Partition to Reduce Cost 2003-2008 2009 2009 2010 95% Less Active 5% Active Distribute tables across multiple storage tiers Scale-out storage at 2-3x less cost per terabyte No changes to existing applications
Traditional Data Lifecycle Archive Less Less Historical Data Lifecycle Active Active Active Offline Archive $ High Performance Storage Tier $$$$
Information Lifecycle Management Lower Cost by Matching Data to Storage Archive Less Less Historical Data Lifecycle Active Active Active Offline Archive $ Online Archive Storage Tier $$ Low Cost Storage Tier $$$ High Performance Storage Tier $$$$
Information Lifecycle Management Taking Advantage of Flash Storage (R)evolution Archive Less Less Historical Data Lifecycle Active Active Active Hyper Active Offline Archive $ Online Archive Storage Tier $$ Low Cost Storage Tier $$$ High Performance Storage Tier $$$$ SSD/Flash Storage Tier $$$$$
Reduce Storage Requirements Advanced OLTP Compression Up to 4X Compression Compress large OLTP and Data Warehouse tables Improve query performance for table scans No changes to existing applications Cascade storage savings throughout data center
Oracle s Global Single Instance 215 TB of Total Storage Savings! Tables Indexes Original Compressed LOBs 3x storage saving on production database 4x table compression 2x index compression 2.3x LOB compression Savings cascade across test, backups & mirrors
Oracle Exadata Hybrid Columnar Compression Up to 50X Data stored by column and then compressed Query mode for data warehousing tables Typical 10x compression ratios Archival mode for old data Typical 15-50x compression ratios
Other Compression Techniques COMPRESSION TYPE: Basic Compression OLTP Compression SecureFiles Compression Index Compression Backup Compression Hybrid Columnar Compression Data Warehousing Hybrid Columnar Compression Archival SUITABLE FOR: Read only tables and partitions in Data Warehouse environments or inactive data partitions in OLTP environments. Active tables and partitions in OLTP and Data Warehouse environments. Non-relational data in OLTP and Data Warehouse environments. Indexes on tables in OLTP and Data Warehouse environments. All environments. Read only tables and partitions in Data Warehouse environments. Inactive data partitions in OLTP and Data Warehousing environments.
Feeling the Storage Squeeze?
Mike Prince Chief Technology Officer Burlington Coat Factory Our Chief Financial Officer likes the Advanced Compression option of Oracle Database 11g because with it we won't need two thirds of the disks we have right now.
Critical Storage Challenges Storage Efficient Management Reduce Cost Optimize Performance Manage Better Storage Goals Reduce Costs Mitigate Risk Data Loss Protection
Protect Against Data Loss ASM Mirroring ASM Disk Group Efficient 3-way mirroring and striping Flexible redundancy choices Complements hardware RAID mirror and parity protection
Oracle Secure Backup Unified backup management Comprehensive tape data protection: Unix / Linux / Windows / NAS file systems Oracle Databases: Oracle9i forward Secure inter-domain communications Central administration for distributed backups Supports over 200 tape devices Read-only Tables & Tablespaces reduce the need to backup
Comprehensive Oracle Data Validation Oracle Database checks to detect and repair corruptions In data and redo blocks using checksum validation Detects writes acknowledged, but actually lost by the I/O subsystem Various checks can be configured by the administrator Choose the desired protection level Can be configured for data blocks / data + index blocks Specific technologies provide additional validation Recovery Manager Automatic Storage Management Data Guard
Efficiently Backup and Restore Data Utilizing Integrated Tiered Storage Secure Backups to Cloud and Tape Automatic Storage Management Recovery Manager Data Guard Real Application Clusters Active Data Guard
Revolution in Error Recovery Flashback Operates on Changed Data Only Reduces correction time from hours to minutes No longer a factor of database size Applies to all types of user errors End users Developers Administrators Simple to use Single command instead of complex procedures Much faster and easier than traditional recovery Correction Time = Error Time + f(db_size)
Protect Against Loss Through Disaster Oracle Data Guard Production Database Standby Database Less expensive than remotely mirrored storage Less network bandwidth required Data corruptions not propagated Standby database can be utilized
Sue Merrigan Director, Information Management Intermap Technologies With Oracle Active Data Guard we maintain 24 by 7 availability to client application services while also making available our physical standby database to customers for read-only access for reports and queries.
Storage Management What Customers Think
Critical Storage Challenges Storage Efficient Management Reduce Cost Optimize Performance Manage Better Storage Goals Reduce Costs Mitigate Risk Data Loss Protection
Summary Many customers are successfully deploying Private Database Clouds today They are benefiting from high quality of service, low cost, reduced complexity and increased agility Private Database Clouds consolidate servers, storage, operating systems, databases, and workloads Exadata is a pre-integrated, highly optimized platform for deploying Private Database Clouds that maximizes ROI
For More Information http://search.oracle.com storage management or oracle.com/database