Ray Rankins. Paul Bertucci. Chris Gallelli UNLEASHED. 800 East 96th Street, Indianapolis, Indiana USA

Transcription

1 Ray Rankins Paul Bertucci Chris Gallelli Alex T. Silverstein UNLEASHED 800 East 96th Street, Indianapolis, Indiana USA

2 V Table of Contents Introduction 1 Who This Book Is For 2 What This Book Covers 2 Conventions Used in This Book 4 Good Luck! 5 Part I Welcome to Microsoft SQL Server 1 SQL Server 2014 Overview 9 SQL Server Components and Features. 9 The SQL Server Database Engine 10 SQL Server 2014 Administration and Management Tools 12 Replication 15 Merge Replication 16 SQL Server AlwaysOn Features 17 SQL Server Service Broker 18 Full-Text and Semantic Search 18 SQL Server Integration Services (SSIS) 20 SQL Server Analysis Services (SSAS) 21 SQL Server Reporting Services (SSRS) 23 Master Data Services 23 Data Quality Services 24 SQL Server 2014 Editions 24 SQL Server 2014 Standard Edition 25 SQL Server 2014 Enterprise Edition 26 Differences Between the Enterprise and Standard Editions of SQL Server 26 Other SQL Server 2014 Editions 28 SQL Server Licensing 30 Web Edition Licensing 31 Developer Edition Licensing 32 Express Edition Licensing 32 Choosing a Licensing Model 32 Mixing Licensing Models 32 Licensing SQL Server of High Availability 32 Licensing SQL Server in a Virtual Environment 34 Summary 35

3 vi Microsoft SQL Server 2014 Unleashed 2 What's New in SQL Server New SQL Server 2014 Features 37 Memory-Optimized Tables/In-Memory OLTP 38 New Cardinality Estimation Logic 38 Delayed Durability for Transactions 38 Buffer Pool Extension 38 SQL Server Data Tools for Business Intelligence 39 SQL Server 2014 Enhancements 39 Resource Governor Enhancements 39 Security Enhancements 39 Backup and Restore Enhancements 40 Indexing Enhancements 40 Monitoring Enhancements 41 SQL Server AlwaysOn and Availability Groups Enhancements 42 New Transact-SQL Enhancements 42 Deprecated and Discontinued Features 42 Summary 45 Part II SQL Server Tools and Utilities 3 SQL Server Management Studio 49 What's New in SSMS 50 The Integrated Environment 50 Window Management 50 Integrated Help 53 Administration Tools 56 Registered Servers 56 Object Explorer 58 Activity Monitor 60 Log File Viewer 62 SQL Server Utility 64 Development Tools. 69 The Query Editor 69 Managing Projects in SSMS 77 Integrating SSMS with Source Control 78 Using SSMS Templates 80 Using SSMS Snippets 84 T-SQL Debugging 85 Multiserver Queries 86 Summary 87

4 Contents vii 4 SQL Server Command-Line Utilities 89 What's New in SQL Server Command-Line Utilities 90 The sqicmd Command-Line Utility 91 Executing the sqicmd Utility 93 Using Scripting Variables with sqicmd 95 The dta Command-Line Utility 96 The tabiedif f Command-Line Utility 99 The bcp Command-Line Utility 102 The sqidiag Command-Line Utility 103 The sqiservr Command-Line Utility 105 The sqilocaidb Command-Line Utility 106 Summary SQL Server Profiler 111 What's New with SQL Server Profiler Ill SQL Server Profiler Architecture 112 Creating Traces 113 Events 115 Data Columns 117 Filters.120 Executing Traces and Working with Trace Output 122 Saving and Exporting Traces 123 Saving Trace Output to a File 123 Saving Trace Output to a Table 124 Saving the Profiler GUI Output 124 Importing Trace Files 125 Importing a Trace File into a Trace Table 125 Analyzing Trace Output with the Database Engine Tuning Advisor 128 Replaying Trace Data 128 Denning Server-Side Traces.131 Monitoring Running Traces 141 Stopping Server-Side Traces 143 Profiler Usage Scenarios 145 Analyzing Slow Stored Procedures or Queries 145 Deadlocks 146 Identifying Ad Hoc Queries 148 Identifying Performance Bottlenecks Monitoring Auto-Update Statistics 150 Monitoring Application Progress 151 Summary 153

5 viii Microsoft SQL Server 2014 Unleashed 6 SQL Distributed Replay 155 What's New for Distributed Replay 155 Overview of Distributed Replay 155 Distributed Replay Components 156 Distributed Replay Administrative Tool 157 Distributed Replay Controller 157 Distributed Replay Clients 158 Target Server 158 Configuring Distributed Replay 158 Controller Configuration File 159 Client Configuration File 159 Preprocess Configuration File 160 Replay Configuration File 161 Replay the Trace Data 163 Configure Permissions and Security 163 Capture the Workload 165 Preprocess Apply the Workload 167 the Trace File 166 Summary 169 Part III SQL Server Administration 7 SQL Server System and Database Administration 173 What's New in SQL Server System and Database Administration 173 System Administrator Responsibilities 174 System Databases 174 The master Database 175 The resource Database 176 The model Database 176 The msdb Database 176 The distribution Database 176 The tempdb Database 177 Maintaining System Databases 177 System Tables 178 System Views 179 Compatibility Views 180 Catalog Views 182 Information Schema Views 184 Dynamic Management Views 186 System Stored Procedures 189 Useful System Stored Procedures 189 Summary 191

6 Contents ix 8 Installing SQL Server What's New in Installing SQL Server Installation Requirements 193 Hardware Requirements 194 Software Requirements 195 Installation Walkthrough 198 Install Screens, Step-by-Step 198 Installing SQL Server Documentation 217 Installing SQL Server Using a Configuration File 219 Running an Automated or Manual Install 224 Installing SQL Server Using Sysprep 226 Preparing a SQL Server Sysprep Image 226 Completing a SQL Server Sysprep Image 229 Modifying a SQL Server Sysprep Image 231 Common Uses of SQL Server Sysprep Images 232 Installing Service Packs and Cumulative Updates 233 Applying a Service Pack or Cumulative Update During a New Installation 233 Summary Upgrading to SQL Server What's New in Upgrading SQL Server 237 The SQL Server 2014 Upgrade Matrix 237 Identifying Products and Features to be Upgraded 240 Using the SQL Server Upgrade Advisor (UA) 241 Getting Started with the UA 241 The Analysis Wizard 243 The Report Viewer 249 Destination: SQL Server Side-by-Side Upgrades 251 Upgrading In-Place 259 Upgrading the Database Engine 260 Installing Product Updates (Slipstreaming) During Upgrades 263 Upgrading Using a Configuration File 264 Upgrading from Pre-SQL Server 2005 Versions 266 Upgrading Other SQL Server Components 266 Upgrading Analysis Services 266 Upgrading SQL Server Analysis Services 266 Upgrading Reporting Services 266 Upgrading SSIS Packages 269 Migrating DTS Packages 271 Summary 271

7 x Microsoft SQL Server 2014 Unleashed 10 Client Installation and Configuration 273 What's New in Client Installation and Configuration 273 Client/Server Networking Considerations 274 Server Network Protocols 275 The Server Endpoint Layer 277 The Role of SQL Browser 280 Client Installation 281 Installing the Client Tools 281 Installing SNAC 282 Client Configuration 284 Client Configuration Using SSCM 284 Connection Encryption 287 Client Data Access Technologies 289 Provider Choices 290 Connecting Using the Various Providers and Drivers 291 General Networking Considerations and Troubleshooting 296 Summary Database Backup and Restore 301 What's New in Database Backup and Restore 301 Developing a Backup and Restore Plan 302 Types of... Backups. 303 Full Database Backups 304 Differential Database Backups 304 Partial Backups 305 Differential Partial Backups 305 File and Filegroup Backups 305 Copy-Only Backups 306 Transaction Log Backups 306 Recovery Models 306 Full Recovery 307 Bulk-Logged Recovery 308 Simple Recovery 309 Backup Devices 310 Disk Devices. 310 Tape Devices 310 Network Shares 311 Media Sets and Families 311 Creating Backup Devices 311. Backing Up a Database 312 Creating Database Backups with SSMS 312 Creating Database Backups with T-SQL 315

8 Contents xi Backing Up the Transaction Log 318 Creating Transaction Log Backups with SSMS 318 Creating Transaction Log Backups with T-SQL 319 Backup Scenarios, 320 Full Database Backups Only 320 Full Database Backups with Transaction Log Backups 321 Differential Backups 322 Partial Backups 323 File/Filegroup Backups 325 Mirrored Backups 326 Copy-Only Backups 326 Compressed Backups 327 Encrypted Backups 328 System Database Backups 329 Restoring Databases and Transaction Logs 330 Restores with T-SQL 330 Restoring by Using SSMS 334 Restore Information 339 Restore Scenarios 342 Restoring to a Different Database 342 Restoring a Snapshot 344 Restoring a Transaction Log 344 Restoring to the Point of Failure 345 Restoring to a Point in Time 347 Online Restores 349 Restoring the System Databases 349 Additional Backup Considerations 351 Frequency of Backups 352 Using a Standby Server 352 Snapshot Backups 353 Considerations for Very Large Databases 354 Maintenance Plans 354 Summary Database Mail 357 What's New in Database Mail Setting Up Database Mail 358 Creating Mail Profiles and Accounts 359 Using T-SQL to Update and Delete Mail Objects 362 Setting System-Wide Mail Settings 363 Testing Your Setup 364

9 xii Microsoft SQL Server 2014 Unleashed Sending and Receiving with Database Mail 364 The Service Broker Architecture 364 Sending 365 Receiving 371 Using SQL Server Agent Mail 371 Job Mail Notifications 371 Creating an Operator 371 Enabling SQL Agent Mail 371 Creating the Job 372 Testing the Job-Completion Notification 373 Alert Mail Notifications 373 Creating an Alert 373 Testing the Alert Notification 374 Related Views and Procedures 375 Viewing the Mail Configuration Objects 375 Viewing Mail Message Data 376 Summary SQL Server Agent 379 What's New in Scheduling and Notification 380 Configuring the SQL Server Agent 380 Configuring SQL Server Agent Properties 380 Configuring the SQL Server Agent Startup Account 382 Configuring Notification 384. SQL Server Agent Proxy Account 385 Viewing the SQL Server Agent Error Log 387 SQL Server Agent Security 388 Managing Operators 389 Managing Jobs 391 Defining Job Properties 391 Defining Job Steps 392 Defining Multiple Job Steps 394 Defining Job Schedules 395 Defining Job Notifications 397 Viewing Job History 398 Managing Alerts. 399 Defining Alert Properties 399 Defining Alert Responses 402 Scripting Jobs and Alerts 404 Multiserver Job Management 405 Creating a Master Server 406 Enlisting Target Servers 407 Creating Multiserver Jobs 407

10 Contents xiii Event Forwarding 407 Summary SQL Server Policy-Based Management 409 What's New in Policy-Based Management 409 Introduction to Policy-Based Management 410 Policy-Based Management Concepts 411 Facets 411 Conditions 414 Policies 415 Categories..., 415 Targets 415 Execution Modes 415 Central Management Servers 416 Implementing Policy-Based Management 418 Creating a Condition Based on a Facet 418 Creating a Policy 420 Creating a Category 422 Evaluating Policies 424 Importing and Exporting Policies 425 Sample Templates and Real-World Examples 426 Sample I'olicy Templates 426 Evaluating Recovery Models 427 Ensuring Object Naming Conventions 427 Checking Best Practices Compliance 427 Policy-Based Management Best Practices 427 Summary Security and User Administration 429 What's New in Security and User Administration 429 An Overview of SQL Server Security 430 Authentication Methods 433 Windows Authentication Mode 433 Mixed Authentication Mode 433 Setting the Authentication Mode 433 Managing Principals 434 Logins 434 SQL Server Security: Users 437 The dbo User 438 The guest User, 439 The informatton_schema User 439 The sys User 439

11 xiv Microsoft SQL Server 2014 Unleashed User/Schema Separation, 440 Roles 441 Fixed Server Roles 442 Fixed Database Roles 443 The public Role 445 User-Defined Database Roles 446 User-Defined Server Roles 448 Application Roles 448 Managing Securables 449 Managing Permissions 450 Managing SQL Server Logins 452 Using SSMS to Manage Logins 452 Using T-SQL to Manage Logins 456 Managing SQL Server Users 457 Using SSMS to Manage Users 458 Using T-SQL to Manage Users 460 Managing Database Roles 461 Using SSMS to Manage Database Roles 461 Using T-SQL to Manage Database Roles 462 Managing Server Roles 462 Using SSMS to Manage Server Roles 463 Using T-SQL to Manage Server Roles 463 Managing SQL Server Permissions 464 Using SSMS to Manage Permissions 464 Using SSMS to Manage Permissions at the Server Level 465 Using SSMS to Manage Permissions at the Database Level 467 Using SSMS to Manage Permissions at the Object Level 470 Using T-SQL to Manage Permissions 472 The Execution Context 473 Explicit Context Switching 473 Implicit Context Switching 474 Summary Data Encryption 477 What's New in Data Encryption 478 An Overview of Data Encryption 478 SQL Server Key Management 480 Extensible Key Management 482 Column-Level Encryption 483 Encrypting Columns Using a Passphrase 484 Encrypting Columns Using a Certificate 486

12 Contents xv Transparent Data Encryption 490 Implementing Transparent Data Encryption 491 Managing TDE in SSMS 493 Backing Up TDE Certificates and Keys 495 The Limitations of TDE 496 Column-Level Encryption Versus Transparent Data Encryption 496 Summary Managing Linked Servers 499 What's New in Managing Linked Servers 500 Linked Servers 500 Distributed Queries 501 Distributed Transactions 502 Adding, Dropping, and Configuring Linked Servers 503 sp_addl inkedserver 503 sp_linkedservers 510 sp_dropserver 512 sp_serveroption 512 Mapping Local Logins to Logins sp_addlinkedsrvlogin, on Linked Servers sp_droplinkedsrvlogin 515 sp_helplinkedsrvlogin 516 Obtaining General Information About Linked Servers 517 Executing a Stored Procedure via a Linked Server 518 Setting Up Linked Servers Using SQL Server Management Studio 519 Summary SQL Server Configuration Options 525 What's New in Configuring, Tuning, and Optimizing SQL Options 525 SQL Server Instance Architecture 526 Configuration Options 527 Fixing an Incorrect Option Setting 535 Setting Configuration Options with SSMS 535 Obsolete Configuration Options 535 Configuration Options and Performance 536 access check cache bucket count 536 access check cache quota 536 ad hoc distributed queries 537 affinity I/O mask 537 affinity mask 539 Agent XP 540

13 xvi Microsoft SQL Server 2014 Unleashed backup checksum default 541 backup compression default 541 blocked process threshold 542 c2 audit mode 542 clr enabled 543 common criteria compliance enabled 543 contained database authentication 543 cost threshold for parallelism 544 cross db ownership chaining 545 cursor threshold Database Mail XPs 546 default full-text language 546 default language. 548 default trace enabled 550 disallow results from triggers 551 EKM provider enabled 551 f ilestream_access_level 551 fill factor 552 index create memory 552 in-doubt xact resolution 553 lightweight pooling 553 locks 554 max degree of parallelism max server memory and min server memory 554 max text repl size 556 max worker threads 557 media retention 558 min memory per query.558 nested triggers 559 network packet size 559 Ole Automation Procedures 560 optimize for ad hoc workloads 560 PH_timeout 561 priority boost 561 query governor cost limit 562 query wait 562 recovery interval 563 remote access 564 remote admin connections 564 remote login timeout 564 remote proc trans 565

14 Contents xvii remote query timeout 565 scan for startup procs 565 show advanced options 566 user connections user options 567 XP-Related Configuration Options 568 Summary Working with and Deploying to Azure SQL Database 571 Setting Up Subscriptions, Servers, and Databases 571 Setting Up Your Windows Azure Subscription 572 Creating a Logical Database Server 574 Managing Your Server 576 Configuring Your Firewall 577 Using SQL Server Management Studio 578 Using Management Portal 579 Working with Databases 580 Understanding SQL Database Service Tiers 580 Managing Databases Using T-SQL 584 Migrating Data into SQL Database 586 Copying Exporting Databases 587 Databases 588 Backing Up and Restoring Databases 590 Using SQL Database Backup, Replication, and Recovery 590 Using Database Copies for Backup and Restore 592 Using BACPAC Files for Backup and Restore 593 Managing Logins, Users, and Roles 595 Understanding Roles 595 Managing Logins and Users 596 Considerations for SQL Database Client Applications 598 Connectivity Limitations 598 Connection String Differences 599 Understanding SQL Database Billing 599 Baseline Billing 599 Tracking Your Usage 601 Understanding SQL Database Limitations 603 Unsupported and Partially Supported Functionality 603 References 606 Summary 606

15 xviii Microsoft SQL Server 2014 Unleashed Part IV Database Administration 20 Creating and Managing Databases 609 What's New in Creating and Managing Databases 610 Data Storage in SQL Server 610 Database Files 611 Primary Files 612 Secondary Files 612 Using Filegroups 613 Using Partitions 616 Transaction Log Files 616 Creating Databases 617 Using SSMS to Create a Database 618 Using T-SQL to Create Databases 621 Setting Database Options, 622 The Database Options 623 Using T-SQL to Set Database Options 625 Retrieving Option Information 626 Managing Databases 629 Managing File Growth 629 Expanding Databases 630 Shrinking Databases 631 Moving Databases 636 Restoring a Database to a New Location 636 Using ALTER DATABASE 636 Detaching and Attaching Databases 637 Contained Databases 639 Creating a Contained Database 640 Connecting to a Contained Database 642 Summary Creating and Managing Tables 645 What's New in SQL Server Creating Tables ; 646 Using Object Explorer to Create Tables 646 Using Database Diagrams to Create Tables 647 Using T-SQL to Create Tables 648 Defining Columns 650 Data Types 651 Column Properties, 657 Column Sets 663 Working with Sparse Columns 664

16 Contents xix Defining Sparse Columns: Good or Bad? 667 Defining Sparse Columns in SSMS 667 Table Location 668 Defining Table Constraints 670 Modifying Tables, 672 Using T-SQL to Modify Tables 672 Using Object Explorer and the Table Designer to Modify Tables 675 Using Database Diagrams to Modify Tables 678 Dropping Tables 680 Using Partitioned Tables, 681 Creating a Partition Function 682 Creating a Partition Scheme 684 Creating a Partitioned Table 686 Adding and Dropping Table Partitions Switching Table Partitions 693 Using FILESTREAM Storage 697 Enabling FILESTREAM Storage 698 Setting Up a Database for FILESTREAM Storage 701 Using FILESTREAM Storage. for Data Columns 702., Using FileTables 705 FileTable Prerequisites 705 Creating FileTables 707 Copying Files to the FileTable 707 Creating Temporary Tables 709 Summary Creating and Managing Indexes 711 What's New in Creating and Managing Indexes 711 Types of Indexes 712 Clustered Indexes 712 Nonclustered Indexes 714 Creating Indexes 716 Creating Indexes with T-SQL 716 Creating Indexes with SSMS 720 Managing Indexes 722 Managing Indexes with T-SQL 723 Managing Indexes with SSMS 726 Dropping Indexes 727 Online Indexing Operations 727 Indexes on Views 729 Summary 730

17 XX Microsoft SQL Server 2014 Unleashed 23 Implementing Data Integrity 731 What's New in Data Integrity 731 Types of Data Integrity 732 Domain Integrity 732 Entity Integrity 732 Referential Integrity 732 Enforcing Data Integrity 732 Implementing Declarative Data Integrity 732 Implementing Procedural Data Integrity 733 Using Constraints 733 The primary key Constraint 733 The unique Constraint 735 The foreign key Referential Integrity Constraint 736 The check Constraint 740, Creating Constraints 742 Managing Constraints 747 Rules 750 Defaults., 751 Declarative Defaults 751 Bound Defaults 753 When a Default Is Applied 754 Restrictions on Defaults 755 Summary Creating and Managing What's New in Creating and Managing Views 757 Views 757 Definition of Views 757 Using Views Simplifying Data Manipulation 759 Focusing on Specific Data 760 Abstracting Data 761 Controlling Access to Data 762 Creating Views 764 Creating Views Using I -SQL 765 ENCRYPTION 767 Creating Views Using the View Designer 769 Managing Views 772 Altering Views with T-SQL 772 Dropping Views with T-SQL 773 Managing Views with SSMS 773 Data Modifications and Views 773

18 Contents xxi Partitioned Views 774 Modifying Data Through a Partitioned View 778 Distributed Partitioned Views 779 Indexed Views 780 Creating Indexed Views 781 Indexed Views and Performance 783 To Expand or Not to Expand 786 Summary Creating and Managing Stored Procedures 789 What's New in Creating and Managing Stored Procedures 789 Advantages of Stored Procedures 789 Creating Stored Procedures 791 Creating Procedures in SSMS 792 Executing Stored Procedures 799 Executing Procedures in SSMS 800 Execution Context and the execute as Clause 802 Using the with result sets Clause 804 Deferred Name Resolution 807 Identifying the Objects Referenced Within Stored Procedures 809 Viewing Stored Procedures 811 Modifying Stored Procedures 814 Viewing and Modifying Stored Procedures with SSMS 815 Using Input Parameters 816 Setting Default Values for Parameters 817 Passing Object Names as Parameters 820 Using Wildcards in Parameters 822 Using Table-Valued Parameters 823 Using Output Parameters 825 Returning Procedure Status 826 Debugging Stored Procedures Using SQL Server Management Studio 827 Startup Procedures 830 Natively Compiled Stored Procedures 834 T-SQL Stored Procedure Coding Guidelines 838 Summary Creating and Managing User-Defined Functions 841 Why Use User-Defined Functions? 841 Types of User-Defined Functions 844 Scalar Functions 844 Table-Valued Functions 847

19 xxii Microsoft SQL Server 2014 Unleashed Creating and Managing User-Defined Functions 849 Creating User-Defined Functions 849 Viewing and Modifying User-Defined Functions 860 Managing User-Defined Function Permissions 868 Rewriting Stored Procedures as Functions 869 Summary Creating and Managing Triggers 873 What's New in Creating and Managing Triggers 874 Using DM1. Triggers 874 Creating DML Triggers 875 Using after Triggers 877 Using inserted and deleted Tables 881 instead of Triggers 885 Using DDL Triggers 893 Creating DDL Triggers 897 Managing DDL Triggers 901 Using Nested Triggers 903 Using Recursive Triggers 903 Summary Transaction Management and the Transaction Log 907 What's New in Transaction Management 907 What Is a Transaction? 907 How SQL Server Manages Transactions 908 Defining Transactions 909 AutoCommit Transactions 909 Explicit User-Defined Transactions 910 Implicit Transactions 916 Implicit Transactions Versus Explicit Transactions 918 Transactions and T-SQL Batches 919 Transactions and Stored Procedures 921 Transactions and Triggers 926 Triggers and Transaction Nesting 927 Triggers and Multistatement Transactions 930 Using Savepoints in Triggers 931 Transactions and Locking 933 read_committed_snapshot Isolation 934 Coding Effective Transactions 934 Transaction Logging and the Recovery Process 935 The Checkpoint Process 939 Automatic Checkpoints 941

20 Contents xxiii Indirect Checkpoints 942 Manual Checkpoints 944 The Recovery Process 945 Managing the Transaction Log 947 Long-Running Transactions 952 Distributed Transactions 954 Summary Database Snapshots 957 What's New with Database Snapshots 958 What Are Database Snapshots? 958 Limitations and Restrictions of Database Snapshots 962 Copy-on-Write Technology 964 When to Use Database Snapshots 965 Reverting to a Snapshot for Recovery Purposes 965 Safeguarding a Database Prior to Making Mass Changes 966 Providing a Testing (or Quality Assurance) Starting Point (Baseline) 967 Providing a Point-in-Time Reporting Database 967 Providing a Highly Available and Offloaded Reporting Database from a Database Mirror 968 Setup and Breakdown of a Database Snapshot 970 Creating a Database Snapshot 970 Removing a Database Snapshot 974 Reverting to a Database Snapshot for Recovery 975 Reverting a Source Database from a Database Snapshot 975 Database Snapshots Maintenance and Security Considerations 977 Security for Database Snapshots 977 Snapshot Sparse File Size Management 977 Number of Database Snapshots per Source Database. 977 Summary Database Maintenance 979 What's New in Database Maintenance 980 The Maintenance Plan Wizard 980 Backing Up Databases 983 Checking Database Integrity 987 Shrinking Databases 988 Maintaining Indexes and Statistics 990 Scheduling a Maintenance Plan 993 Managing... Maintenance Plans Without the Wizard 997 Executing a Maintenance Plan 1001

21 xxiv Microsoft SQL Server 2014 Unleashed Maintenance Without a Maintenance Plan 1002 Database Maintenance Policies 1003 Summary 1003 Part V SQL Server Performance and Optimization 31 Understanding SQL Server Data Structures 1007 What's New for Data Structures 1007 Understanding Data Structures 1008 Database Files and Filegroups 1008 Primary Data File 1010 Secondary Data Files 1010 The Log File, 1011 File Management 1011 Using Filegroups 1012 filestream Filegroups 1015 Database Pages 1017 Page Types 1017 Data Pages 1018 Row-Overflow Pages 1024 LOB Data Pages 1025 Index Pages 1028 Space Allocation Structures 1029 Extents 1029 Global and Shared Global Allocation Map Pages 1030 Page Free Space Pages 1031 Index Allocation Map Pages 1031 Differential Changed Map Pages 1032 Bulk Changed Map Pages 1032 Data Compression 1033 Row-Level Compression 1033 Page-Level Compression 1035 The CI Record 1038 Implementing Page Compression 1038 Evaluating Page Compression 1039 with SSMS 1042 Managing Data Compression Understanding Table Structures 1043 Heap Tables 1045 Clustered Tables 1047 Understanding Index Structures 1048 Clustered Indexes 1049 Nonclustered Indexes 1052 Columnstore Indexes 1057

22 Contents xxv Data Modification and Performance 1062 Inserting Data 1062 Deleting Rows 1065 Updating Rows 1066 Summary Indexes and Performance 1069 What's New for Indexes and Performance 1069 Index Utilization 1070 Index Selection 1072 Evaluating Index Usefulness 1073 Index Statistics 1076 The Statistics Histogram 1078 How the Statistics Histogram Is Used 1080 Index Densities 1081 Estimating Rows Using Index Statistics 1082 Generating and Maintaining Index and Column Statistics 1085 SQL Server Index Maintenance 1093 Setting the Fill Factor 1103 Reapplying the Fill Factor 1105 Disabling Indexes 1106 Managing Indexes with SSMS 1107 Index Design Guidelines 1108 Clustered Index Indications 1109 Nonclustered Index Indications 1111 Index Covering 1112 Included Columns 1114 Wide Indexes Versus Multiple Indexes 1115 Indexed Views 1116 Indexes on Computed Columns 1117 Filtered Indexes and Statistics 1119 Creating and Using Filtered Indexes 1120 Creating and Using Filtered Statistics 1122 Choosing Indexes: Query versus Update Performance 1124 Identifying Missing Indexes 1125 The Database Engine Tuning Advisor 1125 Missing Index Dynamic Management Objects 1126 Missing Index Feature Versus Database Engine Tuning Advisor Identifying Unused Indexes 1129 Summary 1131

23 xxvi Microsoft SQL Server 2014 Unleashed 33 In-Memory Optimization and the Buffer Pool Extension 1133 Overview of In-Memory OLTP 1134 In-Memory OLTP Concepts and Terminology 1136 In-Memory Optimization Requirements 1137 Limitations of In-Memory OLTP 1137 Using In-Memory OLTP, Enabling a Database for In-Memory Creating Memory-Optimized Memory-Optimized 1138 OLTP 1138 Tables 1140 Tables Row Structure 1142 Indexes on Memory-Optimized Tables 1143 Garbage Collection 1151 Maintaining Statistics on Memory-Optimized Tables 1153 Memory-Optimized Index Design Guidelines 1154 Using Memory-Optimized Tables 1156 Interpreted T-SQL Support for In-Memory OLTP 1156 Native Compilation 1157 Natively Compiled Stored Procedures 1159 Memory-Optimized, Table Variables , Transactions and Memory-Optimized Tables 1162 Monitoring Transactions on Memory-Optimized Tables 1170 Logging, Checkpoint, and Recovery for In-Memory OLTP 1170 Transaction Logging 1171 Checkpoint 1171 Recovery Managing Memory for In-Memory OLTP 1175 Monitoring Memory Usage 1176 Managing Memory,. with the Resource Governor 1177 Backup and Recovery of Memory-Optimized Databases 1178 Migrating to In-Memory OLTP 1179 Using the AMR Tool 1180 Using the Table Memory Optimization Advisor to Migrate Disk-Based Tables 1181 Dynamic Management Views for In-Memory OLTP, 1183 The Buffer Pool Extension 1185 Summary Understanding Query Optimization 1187 What's New in Query Optimization 1188 What Is the Query Optimizer? 1188 Query Compilation and Optimization 1189 Compiling DML Statements 1189 Optimization Steps 1190

24 Contents xxvii Query Analysis 1191 Identifying Search Arguments 1191 Identifying or Clauses 1191 Identifying Join Clauses 1192 Row Estimation and Index Selection 1193 Evaluating SARG and Join Selectivity 1193 Estimating Using Multiple Optimizing Access Path Cost 1199 Indexes 1206 with Indexed Views 1213 Optimizing with Filtered Indexes 1216 Evaluating Cardinality Estimates 1218 Join Selection 1219 Join Processing Strategies 1219 Determining the Optimal Join Order 1224 Subquery Processing 1226 Execution Plan Selection 1228 Query Plan Caching 1231 Query Plan Reuse 1231 Query Plan Aging 1234 Recompiling Query Plans 1234 Monitoring the Plan Cache 1235 Other Query Processing Strategies 1243 Predicate Transitivity 1244 group by Optimization 1244 Queries with distinct 1245 Queries with union 1245 Queries Using Columnstore Indexes 1246 Parallel Query Processing 1247 Parallel Query Configuration Options 1249 Identifying Parallel Queries 1250 Common Query Optimization Problems 1252 Out-of-Date or Insufficient Statistics 1252 Poor Index Design 1253 Search Argument Problems 1254 Large Complex Queries 1255 Triggers 1256 The New Cardinality Estimator Changes 1256 Summary 1258

25 xxviii Microsoft SQL Server 2014 Unleashed 35 Managing the Query Optimizer 1259 What's New in Managing the Query Optimizer 1259 Should You Override the Query Optimizer? 1259 Using Optimizer Hints 1261 Forcing Index Selection with Table Hints 1261 Forcing Join Strategies with Join Hints Specifying Query Processing Hints 1264 Using Forced Parameterization 1267 Guidelines for Using Forced Parameterization 1269 Using the use plan Query Hint Using Plan Guides 1271 Creating Plan Guides 1273 Managing Plan Guides 1275 Validating Plan Guides 1275 The sys.pian_guides Catalog View 1275 Plan Guide Best Practices 1276 Verifying That a Plan Guide Is Being Applied 1277 Creating and Managing Plan Guides in SSMS 1279 Limiting Query Plan Execution with the Query Governor 1280 Summary Query Analysis 1283 What's New in Query Analysis 1284 Query Analysis in SSMS 1284 Execution Plan ToolTips 1285 Logical and Physical Operator Icons 1290 Analyzing Stored Procedures 1297 Saving and Viewing Graphical Execution Plans 1299 Displaying Execution Plan XML 1299 Missing Index Hints 1300 SSMS Client Statistics 1304 Using the set showplan Options 1306 Using sys. SHOWPLANJTEXT 1306 SHOWPLAN_ALL 1308 SHOWPLAN_XML 1309 dm_exec_query_j)lan 1310 Query Statistics 1312 STATISTICS STATISTICS TIME 1315 Using datediff () to Measure Runtime 1318 STATISTICS PROFILE 1319 STATISTICS XML 1319

26 Contents xxix Query Analysis with SQL Server Profiler 1320 Summary Locking and Performance 1323 What's New in Locking and Performance 1323 The Need for Locking 1323 Transaction Isolation Levels in SQL Server 1324 Read Uncommitted Isolation 1326 Read Committed Isolation 1326 Read Committed Snapshot Isolation 1327 Repeatable Read Isolation 1328 Serializable Read Isolation 1329 Snapshot Isolation 1329 The Lock Manager 1332 Monitoring Lock Activity in SQL Server 1333 Querying the sys. dm_tran_iocks View 1333 Viewing Locking Activity with SQL Server Profiler 1337 Monitoring Locks with Performance Monitor 1340 SQL Server Lock Types 1342 Shared Locks 1343 Update Locks 1343 Exclusive Locks 1344 Intent Locks 1345 Schema Locks 1346 Bulk Update Locks 1346 SQL Server Lock Granularity 1347 Serialization and Key-Range Locking 1348 Using Application Locks 1353 Index Locking, 1356 Row-Level Versus Page-Level Locking 1357 Lock Escalation 1358 Lock Compatibility 1359 Locking Contention and Deadlocks 1360 Identifying Locking Contention 1361 Setting the Lock Timeout Interval 1364 Minimizing Locking Contention 1364 Deadlocks 1366 Table Hints for Locking 1380 Transaction Isolation-Level Hints 1381 Lock Granularity Hints 1382 Lock Type Hints 1383

27 XXX Microsoft SQL Server 2014 Unleashed Optimistic Locking 1383 Optimistic Locking Using the rowversion Data Type 1384 Optimistic Locking with Snapshot Isolation 1386 Summary Database Design and Performance 1391 What's New in Database Design and Performance 1391 Basic Tenets of Designing for Performance 1392 Logical Database Design Issues 1393 Normalization Conditions 1393 Normalization Forms 1394 Benefits of Normalization 1395 Drawbacks of Normalization 1395 Denormalizing a Database 1396 Denormalization Guidelines 1396 Essential Denormalization Techniques 1397 Database Filegroups and Performance 1403 RAID Technology 1405 RAID Level RAID Level RAID Level RAID Level SQL Server and SAN Technology 1410 What Is a SAN? 1411 SAN Considerations for SQL Server 1411 SQL Server and VM Technology 1412 VM Host Recommendations 1413 VM Guest Recommendations 1414 SQL Server in a VM 1415 Summary Monitoring SQL Server Performance 1417 What's New in Monitoring SQL Server Performance 1418 Performance Monitoring Tools 1419 The Data Collector and the MDW 1419 SQL Server Utility 1442 SQL Server Extended Events 1446 Windows Performance Monitor 1480 Summary 1493

28 Contents xxxi 40 SQL Server Database Engine Tuning Advisor 1495 What's New in SQL Server Database Engine Tuning Advisor , SQL Server Instance Architecture Database Engine Tuning Advisor 1497 The Database Engine Tuning Advisor GUI 1498 The Database Engine Tuning Advisor Command Line 1506 Summary Managing Workloads with the Resource Governor 1515 What's New for Resource Governor 1516 Overview of Resource Governor 1516 Resource Governor Components 1518 Classification 1518 Resource Pools 1518 Workload Groups 1520 Configuring Resource Governor 1521 Enabling Resource Governor 1521 Defining Resource Pools 1523 Defining Workload Groups 1525 Creating a Classifier Function 1529 Monitoring Resource Usage 1532 Modifying Your Resource Governor Configuration 1536 Deleting Workload Groups 1538 Deleting Resource Pools 1539 Modifying a Classifier Function 1539 Summary 1540 Part VI SQL Server High Availability 42 SQL Server High Availability Fundamentals 1543 What's New in High Availability 1544 What Is High Availability? 1545 The Fundamentals of HA 1547 Hardware Factors 1547 Backup Considerations 1547 Operating System Upgrades 1548 Vendor Agreements Followed 1548 Training Kept Up-to-Date 1548 Quality Assurance Done Well 1548 Standards/Procedures Followed 1548 Server Instance Isolation 1548

29 xxxii Microsoft SQL Server 2014 Unleashed Building Solutions with One or More HA Options 1SS1 Failover Cluster Services (FCS) 1551 SQL Clustering 1552 AlwaysOn Failover Clustering Instance (FCI) AlwaysOn Availability Groups 1555 Data Replication 1557 Change Data Capture 1558 Log Shipping 1559 Database Mirroring 1561 Combining Failover with Scale-Out Options 1561 Other HA Techniques That Yield Great Results 1561 High Availability from the Windows Server Family Side 1564 Microsoft Virtual Machines and Hyper-V 1564 Summary Data Replication 1567 What's New in Data Replication 1568 What Is Replication?,, 1569 The Publisher, Distributor, and Subscriber Magazine Metaphor 1571 Publications and Articles 1572 Filtering Articles 1572, Replication Scenarios 1577 The Central Publisher Replication Model 1577 The Central Publisher with Remote Distributor Replication Model 1578 The Publishing Subscriber Replication Model 1579 The Central Subscriber Replication Model 1580 The Multiple Publishers with Multiple Subscribers Replication Model 1581 The Updating Subscribers Replication Model 1582 The Peer-to-Peer Replication Model 1584 Subscriptions 1585 Anonymous Subscriptions (Pull Subscriptions) 1586 The Distribution Database 1587 Replication Agents 1588 The Snapshot Agent 1589 The Log Reader Agent 1592 The Distribution Agent 1593 The Merge Agent 1593 Other Specialized Agents 1594 Planning for SQL Server Data Replication 1595 Autonomy, Timing, and Latency of Data 1595 Methods of Data Distribution 1596

30 Contents xxxiii SQL Server Replication Types 1597 Snapshot Replication 1597 Transactional Replication 1597 Merge Replication 1598 Basing the Replication Design on User Requirements Data Characteristics 1601 Setting Up Replication 1602 Creating a Distributor and Enabling Publishing 1604 Creating a Publication 1609 Horizontal and Vertical Filtering 1616 Creating Subscriptions 1617 Scripting Replication 1624 Monitoring Replication 1627 Replication Monitoring SQL Statements 1628 Monitoring Replication within SQL Server Management Studio , Troubleshooting Replication Failures 1632 Peer-to-Peer Replication 1633 The Performance Monitor 1638 Replication in Heterogeneous Environments. Backup and Recovery in a Replication Configuration 1640 Some Thoughts on Performance 1641 Log Shipping 1642 Change Data Capture 1642 The Change Data Capture Tables 1643 Enabling CDC for a Database 1644 Enabling CDC for a Table 1645 Querying the CDC Tables 1647 CDC and DDL Changes to Source Tables 1653 CDC and AlwaysOn Availability Groups 1654 Change Tracking 1655 Implementing Change Tracking 1656 Identifying Tracked Changes 1658 Identifying Changed Columns 1661 Change Tracking Overhead 1662 Summary SQL Server Failover Clustering 1665 What's New in SQL Server AlwaysOn Failover Clustering 1666 How Microsoft SQL Server Failover Clustering Works 1667 Understanding WSFC 1668 Extending WSFC with NLB 1672 How WSFC Sets the Stage for SQL Server Clustering 1673

31 xxxiv Microsoft SQL Server 2014 Unleashed Installing SQL Server Failover Clustering 1674 Configuring SQL Server Database Disks 1676 Installing Network Interfaces 1677 Installing WSFC 1677 Cluster Events 1678 Installing SQL Server within WSFC 1678 Fail Over to Another Node 1688 The Client Connection Impact of a Failover 1688 Potential Problems to Watch Out for with SQL Server Failover Clustering 1691 Summary SQL Server AlwaysOn and Availability Groups 1693 What's New in SQL Server AlwaysOn and Availability Groups 1693 SQL Server AlwaysOn and Availability Groups 1694 Windows Failover Cluster Services 1694 AlwaysOn Failover Clustering Instances 1694 AlwaysOn Availability Groups 1696 Combining Failover with Scale-Out Options 1698 Building a Multinode AlwaysOn Configuration 1698 Adding Replicas 1713 Dashboard and Monitoring 1715 Summary 1716 Part VII SQL Server Business Intelligence Features 46 SQL Server 2014 Analysis Services 1719 What's New in SSAS 1719 Understanding Understanding SSAS and OLAP 1721 the SSAS Environment Wizards 1723 OLAP Versus OLTP 1727 An Analytics Design Methodology 1729 An Analytics Mini-Methodology 1729 An OLAP Requirements Example: CompSales International 1731 CompSales International Requirements 1732 OLAP Cube Creation 1733 Using SQL Server Visual Studio BI 1734 an Creating OLAP Database 1735 Defining Dimensions and Hierarchies 1741 Creating the Other Dimensions 1750 Creating the Cube 1752 Building and Deploying the Cube 1755

32 Contents xxxv Populating the Cube with Data 1757 Aggregating Data Within the Cube 1758 Browsing Data in the Cube 1762 Delivering Data to Users 1766 ADO MD 1768 Query Analysis and Optimization 1770 Generating a Relational Database 1771 Limitations of a Relational Database 1772 Cube Perspectives 1772 Data Mining 1774 Security and Roles 1783 Tabular Models and SSAS 1784 OLAP Performance 1785 Summary 1786 SQL Server Integration Services 1787 What's New with SSIS 1788 SSIS Basics SSIS Architecture and Concepts 1793 SSIS Tools and Utilities 1797 A Data Transformation Requirement 1802 Running the Import and Export Wizard 1804 The SSIS Designer 1813 The Package Execution Utility 1821 The dtexec Utility 1823 Running Packages 1824 Running Package Examples 1828 The dtutii Utility 1829 dtutii Examples 1832 Change Data Capture and SSIS 1834 Using bcp 1834 Fundamentals of Exporting and Importing Data 1838 File Data Types 1840 Format Files 1840 Using Views 1850 Logged and Nonlogged Operations 1850 Batches 1851 Parallel Loading 1851 Supplying Hints to bcp 1852 Summary 1853

33 xxxvi Microsoft SQL Server 2014 Unleashed Chapters are available online for readers of the printed edition of this book. You can register your book and access those chapters here: informit.com/title/ SQL Server 2014 Reporting Services 1855 What's New in SSRS Discontinued Functionality and Breaking Changes 1857 Reporting Services Architecture 1857 HTTP Architecture 1859 Installing and Configuring SSRS 1861 The Installation Sequence 1861 SSRS Configuration Using RSCM 1865 Developing Reports 1869 Tools of the Trade 1870 Report Basics 1870 Overview of the Report Development Process 1871 Data Planning and Preparation 1871 Using Shared Data Sources 1872 Using Datasets 1873 Using Shared Datasets 1873 Developing Reports Using SSDT 1873 Working with the Tablix 1881 Understanding Expressions 1882 Report Design Fundamentals 1885 Designing Reports Using Report Builder 1897 Report Builder and Report Model Security 1912 Enabling Report Builder.1913 Management and Security 1913 Securing Reports 1913 Subscriptions 1915 Report Execution Options 1917 Performance and Monitoring 1919 SSRS Trace Log 1919 Execution Log 1919 Windows Event Log 1920 Performance Counters Summary 1920

34 Contents xxxvii 49 Data Quality Services 1921 Data Quality Services 1921 What's New in DQS 1922 Master Data Management 1922 Data Quality Services 1923 Summary Master Data Services 1941 Master Data Services 1941 Data Quality Services 1942 What's New in MDS 1942 Master Data Management 1943 Master Data Services Terms and Concepts 1944 Master Data Services 1947 Summary Parallel Data Warehouse 1971 What's New in Parallel Data Warehouse 1971 Understanding MPP and PDW 1972 MPP Architecture 1973 The PDW 1975 Data on a PDW 1976 PDW and Big Data (Hadoop) 1979 xvelocity Columnstore Indexes 1981 Columnstore Indexes 1981 Summary 1984 Index 1985