Peter A Carter. Pro SQL Server Administration

Transcription

1 Peter A Carter Pro SQL Server Administration

2 Pro SQL Server Administration Copyright 2015 by Peter A Carter This work is subject to copyright. All rights are reserved by the Publisher, whether the whole or part of the material is concerned, specifically the rights of translation, reprinting, reuse of illustrations, recitation, broadcasting, reproduction on microfilms or in any other physical way, and transmission or information storage and retrieval, electronic adaptation, computer software, or by similar or dissimilar methodology now known or hereafter developed. Exempted from this legal reservation are brief excerpts in connection with reviews or scholarly analysis or material supplied specifically for the purpose of being entered and executed on a computer system, for exclusive use by the purchaser of the work. Duplication of this publication or parts thereof is permitted only under the provisions of the Copyright Law of the Publisher s location, in its current version, and permission for use must always be obtained from Springer. Permissions for use may be obtained through RightsLink at the Copyright Clearance Center. Violations are liable to prosecution under the respective Copyright Law. ISBN-13 (pbk): ISBN-13 (electronic): Trademarked names, logos, and images may appear in this book. Rather than use a trademark symbol with every occurrence of a trademarked name, logo, or image we use the names, logos, and images only in an editorial fashion and to the benefit of the trademark owner, with no intention of infringement of the trademark. The use in this publication of trade names, trademarks, service marks, and similar terms, even if they are not identified as such, is not to be taken as an expression of opinion as to whether or not they are subject to proprietary rights. While the advice and information in this book are believed to be true and accurate at the date of publication, neither the authors nor the editors nor the publisher can accept any legal responsibility for any errors or omissions that may be made. The publisher makes no warranty, express or implied, with respect to the material contained herein. Managing Director: Welmoed Spahr Lead Editor: Jonathan Gennick Technical Reviewers: Alex Grinberg and Louis Davidson Editorial Board: Steve Anglin, Mark Beckner, Gary Cornell, Louise Corrigan, Jim DeWolf, Jonathan Gennick, Robert Hutchinson, Michelle Lowman, James Markham, Susan McDermott, Matthew Moodie, Jeffrey Pepper, Douglas Pundick, Ben Renow-Clarke, Gwenan Spearing, Matt Wade, Steve Weiss Coordinating Editor: Jill Balzano Copy Editor: Rebecca Rider Compositor: SPi Global Indexer: SPi Global Artist: SPi Global Cover Designer: Anna Ishchenko Distributed to the book trade worldwide by Springer Science+Business Media New York, 233 Spring Street, 6th Floor, New York, NY Phone SPRINGER, fax (201) , orders-ny@springer-sbm.com, or visit Apress Media, LLC is a California LLC and the sole member (owner) is Springer Science + Business Media Finance Inc (SSBM Finance Inc). SSBM Finance Inc is a Delaware corporation. For information on translations, please rights@apress.com, or visit Apress and friends of ED books may be purchased in bulk for academic, corporate, or promotional use. ebook versions and licenses are also available for most titles. For more information, reference our Special Bulk Sales ebook Licensing web page at Any source code or other supplementary material referenced by the author in this text is available to readers at For detailed information about how to locate your book s source code, go to

3 This book is dedicated to my darling wife Danielle a wonderful woman.

4

5 Contents at a Glance About the Author...xxiii About the Technical Reviewers...xxv Part I: Installing and Configuring SQL Server... 1 Chapter 1: Planning the Deployment... 3 Chapter 2: GUI Installation Chapter 3: Server Core Installation Chapter 4: Configuring the Instance Part II: Database Administration Chapter 5: Files and Filegroups Chapter 6: Configuring Tables Chapter 7: Indexes and Statistics Chapter 8: Database Consistency Part III: Security, Resilience, and Scaling Chapter 9: SQL Server Security Model Chapter 10: Encryption Chapter 11: High Availability and Disaster Recovery Concepts Chapter 12: Implementing Clustering Chapter 13: Implementing AlwaysOn Availability Groups v

6 at a Glance Chapter 14: Implementing Log Shipping Chapter 15: Backups and Restores Chapter 16: Scaling Workloads Part IV: Monitoring and Maintenance Chapter 17: SQL Server Metadata Chapter 18: Locking and Blocking Chapter 19: Extended Events Chapter 20: Distributed Replay Chapter 21: Automating Maintenance Routines Chapter 22: Policy-Based Management Chapter 23: Resource Governor Chapter 24: Triggers Part V: Managing a Hybrid Cloud Environment Chapter 25: Cloud Backups and Restores Chapter 26: SQL Data Files in Windows Azure Chapter 27: Migrating to the Cloud Index vi

7 Contents About the Author...xxiii About the Technical Reviewers...xxv Part I: Installing and Configuring SQL Server... 1 Chapter 1: Planning the Deployment... 3 Editions and License Models... 3 Hardware Considerations... 6 Specifying Strategic Minimum Requirements... 6 Storage... 6 Operating Systems Considerations Configuring the Operating System Azure Options Azure SQL Database Azure SQL Server Virtual Machine Selecting Features Database Engine Service Analysis Services Reporting Services Reporting Services Add-in for SharePoint Products Data Quality Client Client Connectivity Tools Integration Services Client Tools Backward Compatibility Client Tools SDK vii

8 Documentation Components Management Tools Distributed Replay Controller Distributed Replay Client SQL Client Connectivity SDK Master Data Services Summary Chapter 2: GUI Installation Installation Center The Planning Tab The Installation Tab The Maintenance Tab The Tools Tab The Resources Tab The Advanced Tab...35 The Options Tab...36 Installing a Stand-Alone Database Engine Instance Preparation Steps The Feature Selection Page The Instance Configuration Page Selecting Service Accounts Choosing the Collation Provisioning Instance Security Configuring the Instance Configuring Distributed Replay Completing the Installation Summary viii

9 Chapter 3: Server Core Installation Considerations for Server Core Installations Installing an Instance Required Parameters Basic Installation Smoke Tests Troubleshooting the Installation Optional Parameters Product Update Using a Config File Automatic Installation Routines Summary Chapter 4: Configuring the Instance Instance Configuration Using sp_configure Processor and Memory Configuration Trace Flags Ports and Firewalls Process of Communication Ports Required By SQL Server Configuring the Port That the Instance Will Listen On Implementing Windows Firewall Rules System Databases mssqlsystemresource (Resource) MSDB Master Model TempDB Buffer Pool Extension Uninstall an Instance ix

10 Uninstall from Control Panel Uninstall from PowerShell Summary Part II: Database Administration Chapter 5: Files and Filegroups Data Storage Filegroups FILESTREAM Filegroups Memory-Optimized Filegroups Strategies for Structured Filegroups Strategies for Memory-Optimized Filegroups File and Filegroup Maintenance Adding Files Expanding Files Shrinking Files Log Maintenance Recovery Model Log File Count Shrinking the Log Log Fragmentation Summary Chapter 6: Configuring Tables Table Partitioning Partitioning Concepts Implementing Partitioning Monitoring Partitioned Tables Sliding Windows Partition Elimination x

11 Table Compression Row Compression Page Compression Columnstore Compression Implementing Compression Memory-Optimized Tables Durability Creating and Managing Memory-Optimized Tables Performance Profile Table Memory Optimization Advisor Limitations of Memory-Optimized Tables Natively Compiled Objects Summary Chapter 7: Indexes and Statistics Clustered Indexes Tables without a Clustered Index Tables with a Clustered Index Clustering the Primary Key Performance Considerations for Clustered Indexes Administering Clustered Indexes Nonclustered Indexes Covering Indexes Administering Nonclustered Indexes Performance Considerations Filtered Indexes Indexes for Specialized Application Columnstore Indexes Clustered Columnstore Indexes Nonclustered Columnstore Indexes Performance Considerations for Columnstore Indexes xi

12 In-memory Indexes XML Indexes Maintaining Indexes Index Fragmentation Missing Indexes Partitioned Indexes Statistics Filtered Statistics Incremental Statistics Managing Statistics Summary Chapter 8: Database Consistency Consistency Errors Understand Consistency Errors Detecting Consistency Errors System Database Corruption DBCC CHECKDB Checking for Errors Fixing Errors Emergency Mode Other DBCC Commands for Corruption Consistency Checks on VLDBs DBCC CHECKDB with PHYSICAL_ONLY Backing Up WITH CHECKSUM and DBCC CHECKALLOC Splitting the Workload Offloading to a Secondary Server Summary xii

13 Part III: Security, Resilience, and Scaling Chapter 9: SQL Server Security Model Security Hierarchy Implementing Instance-Level Security Server Roles Logins Granting Permissions Implementing Database-Level Security Database Roles Schemas Creating and Managing Contained Users Implementing Object-Level Security Ownership Chaining Server Audit Creating a Server Audit Creating a Server Audit Specification Enabling and Invoking Audits Database Audit Specifications Auditing the Audit Summary Chapter 10: Encryption Encryption Hierarchy Encryption Concepts SQL Server Encryption Concepts Transparent Data Encryption Implementing TDE Managing TDE xiii

14 Managing Cell-Level Encryption Accessing Encrypted Data Performance Considerations for Cell-Level Encryption Summary Chapter 11: High Availability and Disaster Recovery Concepts Availability Concepts Level of Availability Recovery Point Objective and Recovery Time Objective Cost of Downtime Classification of Standby Servers High Availability and Recovery Technologies AlwaysOn Failover Clustering Database Mirroring AlwaysOn Availability Groups Log Shipping Combining Technologies Summary Chapter 12: Implementing Clustering Building the Cluster Installing the Failover Cluster Feature Creating the Cluster Configuring the Cluster Building the AlwaysOn Failover Cluster Instance Preparation Steps Cluster-Specific Steps Installing the Instance with PowerShell Adding a Node Managing a Cluster Moving the Instance between Nodes Removing a Node from the Cluster Summary xiv

15 Chapter 13: Implementing AlwaysOn Availability Groups Implementing High Availability with AlwaysOn Availability Groups Configuring SQL Server Creating the Availability Group Performance Considerations for Synchronous Commit Mode Implementing Disaster Recovery with Availability Group Configuring the Cluster Configuring the Availability Group Managing AlwaysOn Availability Groups Failover Synchronizing Uncontained Objects Monitoring Adding Multiple Listeners Other Administrative Considerations Summary Chapter 14: Implementing Log Shipping Implementing Log Shipping for DR GUI Configuration T-SQL Configuration Log Shipping Maintenance Failing Over Log Shipping Switching Roles Monitoring Summary Chapter 15: Backups and Restores Backup Fundamentals Recovery Models Changing the Recovery Model Backup Types Backup Media xv

16 Backup Strategies Full Backup Only Full and Transaction Log Backups Full, Differential, and Transaction Log Backups Filegroup Backups Partial Backup Backing Up a Database Backing Up in SQL Server Management Studio Backing Up via T-SQL Restoring a Database Restoring in SQL Server Management Studio Restoring via T-SQL Restoring to a Point in Time Restoring Files and Pages Restoring a File Restoring a Page Piecemeal Restores Summary Chapter 16: Scaling Workloads Database Snapshots Implementing Database Snapshots Recovering Data from a Snapshot Replication Replication Concepts Types of Replication Implementing Transactional Replication Adding AlwaysOn Readable Secondary Replicas Summary xvi

17 Part IV: Monitoring and Maintenance Chapter 17: SQL Server Metadata Introducing Metadata Objects Server- and Instance-Level Metadata Exposing Registry Values Exposing Service Details Analyzing Buffer Cache Usage Metadata for Capacity Planning Exposing File Stats Using File Stats for Capacity Analysis Metadata for Troubleshooting and Performance Tuning Retrieving Perfmon Counters Analyzing Waits Finding and Tuning Expensive Queries Metadata Driven Automation Dynamically Cycling Database Snapshots Rebuilding Only Fragmented Indexes Summary Chapter 18: Locking and Blocking Understanding Locking Lock Granularity Locking Behaviors for Online Maintenance Lock Compatibility Lock Partitioning Understanding Deadlocks How Deadlocks Occur Minimizing Deadlocks Understanding Transactions Transactional Properties xvii

18 Transaction with In-Memory OLTP Isolation Levels Cross-Container Transactions Retry Logic Observing Transactions, Locks, and Deadlocks Observing Transactions Observing Locks and Contention Observing Deadlocks Summary Chapter 19: Extended Events Extended Events Concepts Packages Events Targets Actions Predicates Types and Maps Sessions Creating an Event Session Using the New Session Wizard Using the New Session Dialog Box Using T-SQL Viewing the Collected Data Analyzing Data with Data Viewer Analyzing Data with T-SQL Correlating Extended Events with Operating System Data Correlating Events with Perfmon Data Integrating Event Sessions with Operating System Level Events Summary xviii

19 Chapter 20: Distributed Replay Distributed Replay Concepts Distributed Replay Components Distributed Replay Architecture Configuring the Environment Configuring the Controller Configuring Clients Configuring the Replay Working with Distributed Replay Synchronizing the Target Creating a Trace Replaying the Trace Summary Chapter 21: Automating Maintenance Routines SQL Server Agent SQL Server Agent Concepts SQL Server Agent Security Creating SQL Server Agent Jobs Monitoring and Managing Jobs Creating Alerts Multiserver Jobs Configuring the MSX and TSX Servers Creating Master Jobs Managing Target Servers Maintenance Plans Creating a Maintenance Plan with the Wizard Creating a Maintenance Plan Manually Automating Administration with SSIS Summary xix

20 Chapter 22: Policy-Based Management PBM Concepts Facets Conditions Targets Policies Central Management Servers Creating Policies Creating Simple Policies Creating an Advanced Policy Managing Policies Importing and Exporting Policies Enterprise Management with Policies Evaluating Policies with PowerShell Summary Chapter 23: Resource Governor Resource Governor Concepts Resource Pool Workload Group Classifier Function Implementing Resource Governor Creating Resource Pools Creating Workload Groups Creating a Classifier Function Testing the Classifier Function Monitoring Resource Governor Monitoring with Performance Monitor Monitoring with DMVs Summary xx

21 Chapter 24: Triggers DDL Triggers Understanding DDL Triggers Implementing DDL Triggers Logon Triggers Controlling Trigger Order Summary Part V: Managing a Hybrid Cloud Environment Chapter 25: Cloud Backups and Restores Understanding Cloud Backups Simple Back Up and Restore to Windows Azure Creating a Container Backing Up a Database Viewing Backup Files from SQL Server Management Studio Restoring from a Backup SQL Server Managed Backup to Windows Azure Understanding Managed Backup to Windows Azure Configuring Managed Backup to Windows Azure for an Individual Database Configuring Managed Backup to Windows Azure for an Instance Managed Backup to Windows Azure Advanced Configuration Disabling Managed Backup to Windows Azure Summary Chapter 26: SQL Data Files in Windows Azure Understanding SQL Data Files in Windows Azure Implementing SQL Data Files in Windows Azure Preparing Windows Azure Preparing the SQL Server Instance Creating a Database Monitoring and Managing SQL Server Data Files in Windows Azure Summary xxi

22 Chapter 27: Migrating to the Cloud Working with Azure SQL Database Creating an Azure SQL Database Migrating a Database to Azure SQL Database Managing Azure SQL Database Migrating to an Azure VM Creating a VM Deploying a Database Summary Index xxii

23 About the Author Peter Carter is a SQL Server expert with over a decade of experience in developing, administering, and architecting SQL Server platforms, data-tier applications, and ETL solutions. Peter has a passion for SQL Server and hopes that his enthusiasm for this technology helps or inspires others. xxiii

24

25 About the Technical Reviewers Louis Davidson has been in the IT industry for more than 15 years as a corporate database developer and architect. He has spent the majority of his career working with Microsoft SQL Server, beginning in the early days of version 1.0. He has a bachelor s degree from the University of Tennessee at Chattanooga in computer science, with a minor in mathematics. Louis is the data architect for Compass Technology (Compass.net) in Chesapeake, Virginia, leading database development on their suite of nonprofit-oriented customer relationship management (CRM) products, which are built on the Microsoft CRM platform and SQL Server technologies. Alex Grinberg is a senior SQL Server database administrator (DBA) with more than 20 years of IT experience. He has been working on Microsoft SQL Server products since version 6.5. Alex currently works in the Pennsylvania branch of Cox Automotive, headquartered in Atlanta, GA. His primary duties are to provide architecture, tuning, optimization, analysis, operational, and development services; to create new applications; to convert legacy technologies (SQL Server, VB.NET, and C# ); and to provide on-site training with the latest Microsoft technologies including.net (VB and C#), SSRS, and SSIS. Alex is a frequent speaker at professional IT events, including SQLSaturdays, Code Camps, SQL Server User Groups, and other industry seminars, where he shares his cumulative knowledge. He is the guest author for SQLServerSentral.com and is also the cofounder of HexaArt Inc., an IT consulting services company for small and mid-size corporations. For any questions or consulting needs, Alex can be reached at hexaart@gmail.com. xxv