Sorting Quicksort analysis Bubble sort November 20, 2017 Hassan Khosravi / Geoffrey Tien 1
Quicksort analysis How long does Quicksort take to run? Let's consider the best and the worst case These differ because the partitioning algorithm may not always do a good job Let's look at the best case first Each time a sub-array is partitioned the pivot is the exact midpoint of the slice (or as close as it can get) So it is divided in half What is the running time? November 20, 2017 Hassan Khosravi / Geoffrey Tien 2
Quicksort best case Each sub-array is divided in half in each partition Each time a series of sub-arrays are partitioned n (approximately) comparisons are made The process ends once all the sub-arrays left to be partitioned are of size 1 How many times does n have to be divided in half before the result is 1? log 2 n times Running time Quicksort performs n log 2 n operations in the best case Same complexity as Merge sort November 20, 2017 Hassan Khosravi / Geoffrey Tien 3
Quicksort worst case Every partition step ends with no values on one side of the pivot The array has to be partitioned n times, not log 2 n times n comparisons in the first partition step n 1 comparisons in the second step n 2 comparisons in the third step n + n 1 + n 2 + + 2 + 1 = n(n 1) 2 So in the worst case Quicksort performs around n 2 operations The worst case usually occurs when the array is nearly sorted (in either direction) As bad as selection sort! November 20, 2017 Hassan Khosravi / Geoffrey Tien 4
Quicksort average case With a large array we would have to be very, very unlucky to get the worst case Unless there was some reason for the array to already be partially sorted The average case is much more like the best case than the worst case There is an easy way to fix a partially sorted array to that it is ready for Quicksort Randomize the positions of the array elements! What is the complexity of performing a random scramble of the array? November 20, 2017 Hassan Khosravi / Geoffrey Tien 5
Quicksort average case Let s assume that pivot choice is random Half the time the pivot will be from the centre half of the array Thus at worst the split will be n 4 and 3n 4 We can apply this to the notion of a good split Every "good" split: 2 partitions of size n/4 and 3n/4 Or, divides n by 4/3 Expected number of partitions is at most 2 log 4/3 n O log n Intuition Given n comparisons at each partitioning step, we have Θ n log n Same best-case complexity as Merge sort, but in practice, Quicksort tends to be slightly faster. Why? November 20, 2017 Hassan Khosravi / Geoffrey Tien 6
Merge sort vs Quicksort and Quicksort summary If Quicksort worst case is so bad, why use it? worst case is exceedingly rare and can be easily avoided in practice, faster than Merge sort. can be sorted in-place using O log n stack space also highly parallelizable Name Best Average Worst Stable Memory Selection sort O n 2 O n 2 O n 2 challenging O 1 Insertion sort O n O n 2 O n 2 Yes O 1 Merge sort O n log n O n log n O n log n Yes O n Quicksort O n log n O n log n O n 2 challenging O log n November 20, 2017 Hassan Khosravi / Geoffrey Tien 7
Bubble sort Bubble sort is a simple sorting algorithm with a good best case performance, but generally poor performance in average and worst case Scans the array from left to right checks adjacent pairs and swaps if out of order If any swap was performed during a scan, re-scan the array The next largest item is put into place during each scan, so each scan does not need to go all the way to the end of the array Array is sorted if a scan can complete without performing any swaps November 20, 2017 Hassan Khosravi / Geoffrey Tien 8
Bubble sort Example swapped = TRUE FALSE swapped = TRUE FALSE swapped = TRUE FALSE swapped = TRUE FALSE swapped = TRUE FALSE swapped = TRUE FALSE 6 5 3 1 8 7 2 4 i 5 3 1 6 7 2 4 8 i 3 1 5 6 2 4 7 8 i 1 3 5 2 4 6 7 8 i 1 3 2 4 5 6 7 8 i 1 2 3 4 5 6 7 8 i Completed scan with no swaps November 20, 2017 Hassan Khosravi / Geoffrey Tien 9
Bubble sort algorithm #define TRUE 1 #define FALSE 0 void bubblesort(int arr[], int size) { int i, j, temp; int swapped = FALSE; for (i = 0; i < n; i++) { swapped = FALSE; // reset flag for this scan iteration for (j = 0; j < n-i-1; j++) { if (arr[j] > arr[j+1]) { temp = arr[j+1]; arr[j+1] = arr[j]; arr[j] = temp; swapped = TRUE; // a swap occurred during this scan } } if (!swapped) return; } } November 20, 2017 Hassan Khosravi / Geoffrey Tien 10
Bubble sort analysis Inner loop increments and swaps Outer loop repeats if a swap occurred if no swap occurred, algorithm terminates Best case everything already in order! O n An item out of place can only move to the left by one position per outer loop iteration if the smallest item is at the rightmost position, it requires n 1 outer loop iterations worst case! O n 2 Average case is more similar to worst case November 20, 2017 Hassan Khosravi / Geoffrey Tien 11
When do we use Bubble sort Rarely, in practice When we want to show some "bad" (but easy to implement) sorting algorithms for comparison in a second-year computer science class but it is far from the worst, e.g. Bogosort Name Best Average Worst Stable Memory Selection sort O n 2 O n 2 O n 2 challenging O 1 Insertion sort O n O n 2 O n 2 Yes O 1 Merge sort O n log n O n log n O n log n Yes O n Quicksort O n log n O n log n O n 2 challenging O log n Bubble sort O n O n 2 O n 2 Yes O 1 Heapsort O n log n O n log n O n log n No O 1 November 20, 2017 Hassan Khosravi / Geoffrey Tien 12
Exercise Suppose we implemented Merge sort, to split the array into 3 (roughly) equally-sized subarrays, and the Merge function repeatedly copies in the smallest of the three values in each subarray index Perform a recurrence analysis to see how the (asymptotic) running time will be affected. For the following sequence of values, perform a single round of Quicksort partition using the implementation described in these notes; identify which element becomes the pivot value 9, 6, 7, 17, 11, -1, -5, 19, 1, 2 November 20, 2017 Hassan Khosravi / Geoffrey Tien 13
Readings for this lesson Thareja Chapter 14.11, 14.7 (Quicksort, Bubble sort) Next class: Thareja Chapter 15.1 15.3 (Hash tables, hash functions) November 20, 2017 Hassan Khosravi / Geoffrey Tien 14