Advanced SQL Programming and Optimization. Everything you wanted to know about Stored Procedures!

Transcription

1 Advanced SQL Programming and Optimization Everything you wanted to know about Stored Procedures!

2 About Soaring Eagle Since 1997, Soaring Eagle Consulting has been helping enterprise clients improve their overall system performance at the database tier, arguably the most volatile and critical component of distributed application architecture. Our clients range in size from fledgling startups through Fortune 100 companies and leading financial institutions. Soaring Eagle has been a leader in managed services, database architecture, performance and tuning databases, while promoting mentoring and training all over the world for over a decade and a half. Many of our employees, and partners have written books, speak at seminars about leading edge technologies. We have expertise in all business tiers, financial; health, manufacturing, government agencies and many ecommerce businesses. Whatever your business needs are we can help improve performance! Consulting Performance & Tuning Data Performance Management Emergency Triage Performance & Security Audits Staff Augmentation Project management Database architecture Scalability assessment and planning Training Onsite/Web based Microsoft Sybase Oracle APM Six Sigma Managed Services Remote Database Management Performance management Emergency db Service Proactive mitigation Problem notification Problem resolution Software Application Performance Management Database performance management Database Security 2-43 Soaring Eagle Consulting 8/19/2013

3 Acknowledgements Microsoft SQL server, SSMS are trademarks of Microsoft Inc. This presentation is copyrighted by Soaring Eagle Consulting, August 7, 2013 This presentation is not for re-sale This presentation shall not be used, modified, or redistributed without express written consent of Soaring Eagle Consulting, Inc. Solarwinds Ignite is registered trademark of Solarwinds Inc Soaring Eagle Consulting 8/19/2013

4 Topics Review stored procedure coding recommendations Define appropriate error handling, return status and parameter techniques Understand compilation issues Examine performance factors 4-43 Soaring Eagle Consulting 8/19/2013

5 SP Coding Standards and Conventions Follow normal standard coding guidelines as you would for any programming language Use explanatory comments Use indentation to improve readability Develop structured methods of handling errors within stored procedures Develop a method for maintaining versions of stored procedure source code 5-43 Soaring Eagle Consulting 8/19/2013

6 Structured Error Handling in Stored Procedures There are two valid options: Try catch blocks Check for errors after every SQL statements take appropriate error handling steps Check value Always use the return statement with status codes when procedure encounters an error Always check the return status of called stored procedures Set up defaults for all parameters and perform parameter checks at the beginning of procedure 6-43 Soaring Eagle Consulting 8/19/2013

7 Returning Procedure Status Every stored procedure automatically returns an integer status value Zero is returned on successful completion -1 through -99 are returned for SQL Server detected errors Use a return statement to specify a return value greater than or equal to 0 or less than -99 The calling program can set up a local variable to receive and check the return status 7-43 Soaring Eagle Consulting 8/19/2013

8 Returning Procedure Status (Cont d) create proc procedure_name [ (parm_name datatype = default_value [output] [,... ] ) ] as SQL Statements return [integer_status_value] [execute] [@status_var = ] procedure_name [[parm_name = ] expression [output] [, ] 8-43 Soaring Eagle Consulting 8/19/2013

9 Procedure Creation /* procedure sets an error status on error */ create proc titles_for_a_pub varchar(40) = null ) as = null return 15 if not exists (select * from publishers where pub_name return -101 select title from publishers p join titles t on p.pub_id = t.pub_id where pub_name return Soaring Eagle Consulting 8/19/2013

10 Return Status Example Procedure Usage /* check for status and report errors */ int = titles_for_a_pub 'New Age Books' = 15 print 'Invalid Syntax' else = -101 print 'No publisher by that name found' Soaring Eagle Consulting 8/19/2013

11 SQL Server Status Codes Following is a list of return status codes currently in use by SQL Server Status Code Meaning 0 Successful return -1 Missing object referenced -2 Datatype mismatch error -3 Process chosen as deadlock victim -4 Permission error -5 Syntax error -6 Miscellaneous user error -7 Resource error, such as out of space -8 Non-fatal internal problem (bug) -9 System limit reached -10 Fatal internal inconsistency (bug) -11 Fatal internal inconsistency (bug) -12 Table or index corrupted -13 Database corrupt -14 Hardware error Soaring Eagle Consulting 8/19/2013

12 Default Parameter Values Stored procedure parameters can be assigned default values if no value is supplied during execution You can improve your stored procedure code by defining defaults for all parameters create proc procedure_name (parameter_name datatype = default_value [,...]) as SQL Statements [return [status_value]] Soaring Eagle Consulting 8/19/2013

13 Default Parameter Values (Cont d) Procedure Creation Example /* check for a pub_name before executing query */ create proc titles_for_a_pub (@pub_name varchar(40) = null) as = null begin print Pass in the pub_name as a parameter return end select t.title from publishers p join titles t on p.pub_id = t.pub_id where pub_name + % return Soaring Eagle Consulting 8/19/2013

14 Executing with Parameters At execution time, parameters may be specified by position or by name If passed by name, parameters can be passed in any order [exec[ute]] procedure_name = ]expression] [,... ] Soaring Eagle Consulting 8/19/2013

15 Executing with Parameters (Cont d) Procedure Creation Example create proc myproc int) as... go /* parameters passed by position here */ exec myproc 10,20,15 /* parameter passed by name here */ exec = = = Soaring Eagle Consulting 8/19/2013

16 Notes on Parameters Once you have started passing parameters by name, all subsequent parameters must be passed by name If you want to skip any parameters and have them take default values, you will need to pass parameters by name unless they are the last parameter(s) in the procedure In programming environments, passing parameters by name is more flexible and self-documenting than passing parameters by position Soaring Eagle Consulting 8/19/2013

17 Stored Procedure Recompilation The SQL Server optimizer caches a query plan based on parameters passed at the time the query plan was generated. This procedure could conceivably generate two distinctly different query plans based upon the values supplied Consider the following procedure create proc range_value (@low int) as select sum (total_sales) from titles where price return Soaring Eagle Consulting 8/19/2013

18 Stored Procedure Recompilation (Cont d) Subsequent executions of the procedure will use any available procedure query plan To guarantee the proper query plan for each execution, create the stored procedure with the with recompile option create proc range_value int) with recompile as select sum (price) from titles where price return Soaring Eagle Consulting 8/19/2013

19 Stored Procedure Recompilation (Cont d) To generate a new query plan for a specific execution use the with recompile option when executing the procedure execute range_value 10, 200 with recompile To generate new query plans for all procedures dependent on a specific table, execute sp_recompile table_name Soaring Eagle Consulting 8/19/2013

20 Recompiling Stored Procedures Creating the proc with the with recompile option causes a new query plan to be generated for each execution. This creates a lot of overhead with the optimizer The effect of using with recompile on stored procedure execution will generate a new query plan for the current execution, but does not affect any existing query plans in cache The query plan used for subsequent executions is indeterminate Soaring Eagle Consulting 8/19/2013

21 Recompiling Stored Procedures Procedure query plans are not automatically recompiled if indexes are added or statistics are updated Run sp_recompile on the affected table If indexes associated with the query plan are dropped, all procedure query plans will be automatically recompiled The only ways to flush all existing query plans from cache are to: Drop and recreate the stored procedure Run dbcc freeproccache (clears ALL procedure cache) Cycle the SQL Server Soaring Eagle Consulting 8/19/2013

22 Other Compilation Issues create proc get_data int) as = 1 begin select * from titles where price exec end else begin select * from salesdetail where qty exec end Soaring Eagle Consulting 8/19/2013

23 Alternatives to Recompile (Cont d) On first execution, the optimizer will generate a query plan for ALL select statements based upon the passed in parameters, regardless of the conditional branching Note: This could result in the wrong query plan being generated for one of the select statements Recommendation: If this type of stored procedure must be written, have it call multiple stored procedures (as opposed to creating it with recompile) Soaring Eagle Consulting 8/19/2013

24 Calling Stored Procedures from Transactions A rollback inside a stored procedure can lead to unexpected results because it does not abort the batch /* transaction in the batch */ begin tran insert tally values (1) 0 rollback tran else execute the_proc insert tally values (3) 0 rollback tran else commit tran Continued Next Page Soaring Eagle Consulting 8/19/2013

25 Calling Stored Procedures from Transactions (Cont d) Rolls back to outermost tran in calling batch Subsequent statements in batch are processed What values are inserted in the tally table? How many transactions are active during the procedure? After the procedure returns? /* proc has a tran also */ create procedure the_proc as begin tran proc_tran insert tally values (2) 0 rollback tran else commit tran return Soaring Eagle Consulting 8/19/2013

26 Stored Procedures and Transactions: Notes SQL Server notes the transaction nesting level before calling a stored procedure. If the transaction nesting level when the procedure returns is different from the level when executed, SQL Server will display the following message: Transaction count after EXECUTE indicates that a COMMIT or ROLLBACK TRANSACTION statement is missing Soaring Eagle Consulting 8/19/2013

27 Stored Procedures and Transactions: Notes (Cont d) This message indicates that transaction nesting is not synchronized Because a stored procedure does not abort the batch on a rollback tran, a rollback tran inside the proc could result in a loss of data integrity if subsequent statements are executed and committed A rollback tran rolls back all statements to the outermost transaction, including any work performed inside nested stored procedures that have not been fully committed > 0) A commit tran within the stored procedure only by one Soaring Eagle Consulting 8/19/2013

28 Stored Procedures and Transactions: Guidelines Develop a consistent error handling strategy for failed transactions or other errors that occur within transactions Implement this strategy consistently across procedures/applications Implement transaction control in nested stored procedures Check whether the procedure is being called from within a transaction before issuing a begin tran Because rollback tran from a procedure does not abort the batch calling the procedure, follow these guidelines: Procedures should make no net change Issue a rollback tran only if the stored procedure issues the begin tran statement Soaring Eagle Consulting 8/19/2013

29 How To: Called or Stand-Alone Procedure Template /* proc to demonstrate no net change to ** but rolls back changes within the proc ** VERY IMPORTANT: return an error code ** to tell the calling procedure rollback occurred */ create proc p1 as int -- value = 0 -- transaction has not begun begin tran p1 -- begin tran increments nest level to 1 else -- already in a transaction save tran p1 -- save tran doesn t increment nest level Continued Next Page Soaring Eagle Consulting 8/19/2013

30 How To: Called or Stand-Alone Procedure Template /* do some processing */ if <> 0) -- or other error condition begin rollback tran p1 -- rollback to savepoint, -- or begin tran return return error code -- indicating rollback end /* more processing if required */ = 0 -- this proc issued begin tran commit tran p1 -- commit tran, -- to 0 -- commit not required with -- save tran return 0 /* successful return */ Continued Next Page Soaring Eagle Consulting 8/19/2013

31 Using Temporary Tables in Stored Procedures Temporary tables must be created before they can be referenced within a stored procedure A single stored procedure can create and reference a temp table as long as the creation statement is executed before any SQL statements which reference the table If a called-procedure references a temporary table or a regular table created externally, a temporary table with the same name and structure no longer has to exist at the time the stored procedure is created Soaring Eagle Consulting 8/19/2013

32 Temporary Table Performance Tips Keep temporary tables as small as possible, vertically and horizontally Select only required columns, rather than select * Consider creating indexes on temp tables within your stored procedure If the temporary table is of sufficient size and is going to be accessed multiple times, it may be cost effective to create an index on it Always drop temporary tables as soon as possible Watch out for mysterious periodic slowdowns if you are creating very large temporary tables: the server may be checkpointing tempdb Soaring Eagle Consulting 8/19/2013

33 Indexes on Temporary Tables create proc p1 as select title_id, type, pub_id, ytd_sales into #temp_titles from titles where price between $8 and $10 create clustered index tmp on #temp_titles(pub_id) select sum(ytd_sales) from #temp_titles where pub_id ='1324' Continued Next Page Soaring Eagle Consulting 8/19/2013

34 Indexes on Temporary Tables (Cont d) select min(ytd_sales) from #temp_titles where pub_id = '4324' return Question Will the stored procedure use the index? -YES! Soaring Eagle Consulting 8/19/2013

35 Stored Procedure Debugging Techniques Write it as a batch first To get the syntax right on a stored procedure, write small parts of it as a batch first, then store the procedure once the whole operation starts working Get showplan output with recompile showplan output are generated by the optimizer, which is only operating when a procedure is recompiled. To see the effect of different parameters on optimization, create the procedure with recompile, then drop and recreate the procedure without it when you go into production Soaring Eagle Consulting 8/19/2013

36 Temp Procedures SQL Server provides the capability of creating temporary stored procedures A stored procedure with a # in front of its name is a temporary procedure accessed only by the current connection A stored procedure with a ## in front of its name is a temporary procedure accessible by other connections They both go away when the connection is lost With SQL Server, you should not create a temporary stored procedure. Instead use the sp_executesql stored procedure or exec (@string) Soaring Eagle Consulting 8/19/2013

37 Procedure Optimization Object references are resolved at execution time The query plan is generated at execution time Long procedures will still run faster than in-line SQL, because there will be fewer network packets sent to the server Soaring Eagle Consulting 8/19/2013

38 Summary Use proper error handling and return status methods Watch out for rollback in a transaction Soaring Eagle Consulting 8/19/2013

39 Lab: Stored Procedures Part 1 Set statistics io and display actual plan, then run the following queries and compare the query plans and I/O select count(id) from pt_sample_ciidnck where key2 between 0 and 500 select count(id) from pt_sample_ciidnck where key2 between and Write a stored procedure called procn where N is your user number as follows create proc procn (@lo int = int = null) as = null = null begin Soaring Eagle Consulting 8/19/2013

40 Lab: Stored Procedures print Syntax: procn 1,500 return end select * from pt_sample_ciidnck where key2 return Make sure showplan and statistics io are on and execute your stored procedure as follows, comparing query plans and total I/O for each execution exec procn 0, 500 exec procn 35000, exec procn 35000, with recompile exec procn 0, Soaring Eagle Consulting 8/19/2013

41 Lab: Stored Procedures Create a second version of procn as procn_2 with the with recompile option Set statistics io, statistics time on, look at these and the graphical plan. Execute procn and procn_2 as follows exec procn 35000, exec procn_ , exec procn_2 0, 500 exec procn 0,500 exec procn 0,500 with recompile Soaring Eagle Consulting 8/19/2013

42 Lab: Stored Procedures Compare query plans, I/O, and compile, cpu, and elapsed times Part 2 Create a proc that creates a temporary table with an index inside the procedure, then execute a select statement to make use of the index (don't force an index). Execute and look at query plan and statistics. Now rewrite the proc to force the index and review the statistics Soaring Eagle Consulting 8/19/2013

43 Thank you! Questions? Jeff Garbus Soaring Eagle Consulting 8/19/2013