CMSC 341 Lecture 15 Leftist Heaps

Similar documents
CMSC 341 Lecture 15 Leftist Heaps

CMSC 341 Leftist Heaps

CMSC 341 Lecture 14: Priority Queues, Heaps

CMSC 341 Priority Queues & Heaps. Based on slides from previous iterations of this course

CMSC 341. Binary Heaps. Priority Queues

Chapter 6 Heaps. Introduction. Heap Model. Heap Implementation

Arrays aren t going to work. What can we do? Use pointers Copy a large section of a heap, with a single pointer assignment

Heap Model. specialized queue required heap (priority queue) provides at least

CMSC 341 Lecture 10 Binary Search Trees

Data Structures and Algorithms

Multi-way Search Trees. (Multi-way Search Trees) Data Structures and Programming Spring / 25

! Tree: set of nodes and directed edges. ! Parent: source node of directed edge. ! Child: terminal node of directed edge

Priority Queues and Binary Heaps

Binary heaps (chapters ) Leftist heaps

Tree: non-recursive definition. Trees, Binary Search Trees, and Heaps. Tree: recursive definition. Tree: example.

CS102 Binary Search Trees

CSE 5311 Notes 4a: Priority Queues

CSCI-1200 Data Structures Fall 2018 Lecture 23 Priority Queues II

! Tree: set of nodes and directed edges. ! Parent: source node of directed edge. ! Child: terminal node of directed edge

COMP : Trees. COMP20012 Trees 219

CS350: Data Structures Heaps and Priority Queues

Chapter 5. Binary Trees

Trees. A tree is a directed graph with the property

Priority Queues. Lecture15: Heaps. Priority Queue ADT. Sequence based Priority Queue

Binary Heaps. CSE 373 Data Structures Lecture 11

Multi-way Search Trees! M-Way Search! M-Way Search Trees Representation!

Advanced Algorithms. Class Notes for Thursday, September 18, 2014 Bernard Moret

Data Structures and Algorithms

Recall: Properties of B-Trees

3. Priority Queues. ADT Stack : LIFO. ADT Queue : FIFO. ADT Priority Queue : pick the element with the lowest (or highest) priority.

Data Structures Week #8. Heaps (Priority Queues)

l So unlike the search trees, there are neither arbitrary find operations nor arbitrary delete operations possible.

Trees. (Trees) Data Structures and Programming Spring / 28

Advanced Set Representation Methods

CSCI2100B Data Structures Heaps

Data Structures Lesson 9

Lecture Notes for Advanced Algorithms

CSCI-1200 Data Structures Spring 2016 Lecture 22 Priority Queues, part II (& Functors)

Section 1: True / False (1 point each, 15 pts total)

l Heaps very popular abstract data structure, where each object has a key value (the priority), and the operations are:

CSCI Trees. Mark Redekopp David Kempe

An AVL tree with N nodes is an excellent data. The Big-Oh analysis shows that most operations finish within O(log N) time

4. Trees. 4.1 Preliminaries. 4.2 Binary trees. 4.3 Binary search trees. 4.4 AVL trees. 4.5 Splay trees. 4.6 B-trees. 4. Trees

Binary Trees, Binary Search Trees

INF2220: algorithms and data structures Series 4

Binary Heaps in Dynamic Arrays

Sorted Arrays. Operation Access Search Selection Predecessor Successor Output (print) Insert Delete Extract-Min

Computational Optimization ISE 407. Lecture 16. Dr. Ted Ralphs

CSCI 136 Data Structures & Advanced Programming. Lecture 22 Fall 2018 Instructor: Bills

Thus, it is reasonable to compare binary search trees and binary heaps as is shown in Table 1.

SKEW HEAPS: Self-Adjusting Heaps

Priority Queues. 04/10/03 Lecture 22 1

Binary Heaps. COL 106 Shweta Agrawal and Amit Kumar

Algorithms. Deleting from Red-Black Trees B-Trees

CS 231 Data Structures and Algorithms Fall Recursion and Binary Trees Lecture 21 October 24, Prof. Zadia Codabux

Module 4: Index Structures Lecture 13: Index structure. The Lecture Contains: Index structure. Binary search tree (BST) B-tree. B+-tree.

CSE 214 Computer Science II Heaps and Priority Queues

CE 221 Data Structures and Algorithms

Sorting and Searching

Data Structures and Algorithms

Priority Queues. 1 Introduction. 2 Naïve Implementations. CSci 335 Software Design and Analysis III Chapter 6 Priority Queues. Prof.

Readings. Priority Queue ADT. FindMin Problem. Priority Queues & Binary Heaps. List implementation of a Priority Queue

I2206 Data Structures TS 6: Binary Trees - Binary Search Trees

Implementations. Priority Queues. Heaps and Heap Order. The Insert Operation CS206 CS206

Sorting and Searching

CSI33 Data Structures

Lec 17 April 8. Topics: binary Trees expression trees. (Chapter 5 of text)

Trees, Part 1: Unbalanced Trees

Trees. Eric McCreath

CMSC 341. Binary Search Trees CMSC 341 BST

Heaps. 2/13/2006 Heaps 1

Leftist Heaps and Skew Heaps. (Leftist Heaps and Skew Heaps) Data Structures and Programming Spring / 41

9/29/2016. Chapter 4 Trees. Introduction. Terminology. Terminology. Terminology. Terminology

Operations on Heap Tree The major operations required to be performed on a heap tree are Insertion, Deletion, and Merging.

CSE 530A. B+ Trees. Washington University Fall 2013

Binary Trees

CmpSci 187: Programming with Data Structures Spring 2015

Dictionaries. Priority Queues

Test #2. Login: 2 PROBLEM 1 : (Balance (6points)) Insert the following elements into an AVL tree. Make sure you show the tree before and after each ro

CS 361 Data Structures & Algs Lecture 9. Prof. Tom Hayes University of New Mexico

(2,4) Trees. 2/22/2006 (2,4) Trees 1

Topic: Heaps and priority queues

Priority Queues and Huffman Trees

Chapter 20: Binary Trees

Heaps Outline and Required Reading: Heaps ( 7.3) COSC 2011, Fall 2003, Section A Instructor: N. Vlajic

Binary Tree. Preview. Binary Tree. Binary Tree. Binary Search Tree 10/2/2017. Binary Tree

Announcements. Midterm exam 2, Thursday, May 18. Today s topic: Binary trees (Ch. 8) Next topic: Priority queues and heaps. Break around 11:45am

Fall, 2015 Prof. Jungkeun Park

Heaps Goodrich, Tamassia. Heaps 1

CSCI212 Computer Science. Binary Trees/Heaps/Binary Search Trees

CS 234. Module 8. November 15, CS 234 Module 8 ADT Priority Queue 1 / 22

Binary Search Trees. Analysis of Algorithms

The heap is essentially an array-based binary tree with either the biggest or smallest element at the root.

9. Heap : Priority Queue

/633 Introduction to Algorithms Lecturer: Michael Dinitz Topic: Priority Queues / Heaps Date: 9/27/17

Priority queues. Priority queues. Priority queue operations

Lecture 6: Analysis of Algorithms (CS )

Learning Goals. CS221: Algorithms and Data Structures Lecture #3 Mind Your Priority Queues. Today s Outline. Back to Queues. Priority Queue ADT

Trees, Binary Trees, and Binary Search Trees

Heaps with merging. We can implement the other priority queue operations in terms of merging!

Transcription:

Based on slides from previous iterations of this course CMSC 341 Lecture 15 Leftist Heaps Prof. John Park

Review of Heaps

Min Binary Heap A min binary heap is a Complete binary tree Neither child is smaller than the value in the parent No order between left and right In other words, smaller items go above larger ones

Min Binary Heap Performance Performance (n is the number of elements in the heap) construction O( n ) findmin() O( 1 ) insert() O( lg n ) deletemin() O( lg n )

Introduction to Leftist Heaps

Leftist Heap Concepts Structurally, a leftist heap is a min tree where each node is marked with a rank value The rank of a node is the depth of the nearest leaf Uses a binary tree The tree is not balanced, however just the opposite Use a true tree May use already established links to merge with a new node

Leftist Heap Concepts True heap: values do obey heap order Uses a null path length (npl)to maintain the structure (related to s-value or rank) Additional constraint: the npl of a node s left child is >= npl of the right child At every node, the shortest path to a non-full node is along the rightmost path

Leftist Heap Example A leftist heap, then, is a purposefully unbalanced binary tree (leaning to the left, hence the name) that keeps its smallest value at the top Benefit: has an inexpensive merge operation 2 4 3 6 8 5 6 8 9

Leftist Heap Performance Leftist Heaps support: findmin() = O(1) deletemin() = O(log n) insert() = O(log n) construct = O(n) merge() = O(log n)

Null Path Length (npl) Length of shortest path from current node (X) to a node without 2 children analogous to path to dummy leaf in full tree w/internal value nodes), minus 1 leaves: npl = 0 nodes with only 1 child: npl = 0

Null Path Length (npl) Calculation 2 4 3 To calculate the npl for each node, we look to see how many nodes we need to traverse to get to an open node 6 8 5 6 8 9

Null Path Length (npl) Calculation 2 4 3 In the leaves case, there is a null position 0 nodes away 6 8 5 6 8 0 / 0 9 0 / 0 0 / 0 0 / 0

Null Path Length (npl) Calculation In these cases, one side is 0 and the other side is 1 2 4 3 0 / 1 6 8 5 6 8 0 / 1 9

Null Path Length (npl) Calculation 2 / 1 2 / 1 2 4 3 In the root, it will take two levels to get to null to the left; one to the right. 1 / 1 6 8 5 6 8 9

Leftist Node The node for a leftist heap will have an additional member variable tracking npl links (left and right) element (data) npl

Leftist Node Code private: struct LeftistNode { Comparable element; LeftistNode *left; LeftistNode *right; int npl; Looks like a binary tree node except the npl being stored. }; LeftistNode( const Comparable & theelement, LeftistNode *lt = NULL, LeftistNode *rt = NULL, int np = 0 ) : element( theelement ), left( lt ), right( rt ), npl( np ) { } LeftistNode *root;

Building a Leftist Heap

Building a Leftist Heap Value of node still matters Still a min Heap, so min value will be root Data entered is random Uses current npl of a node to determine where the next node will be placed

Merging Nodes/Subtrees Place lower value as (sub)root, higher value as right child. If the lower node already has right child, then recursively merge the higher valued node with the the right child (ultimately equiv. to place as far right as possible ) After merging, the npl of the lower valued node might have changed, so recompute

Merging Nodes/Subtrees (cont) If the lower-valued node does not have left child, swing right child to the left If lower-valued node does have left child, then order children so left has higher npl

Moves in Building Leftist Heap 50 New leftist heap with one node

Moves in Building Leftist Heap 50 Normal insertion of a new node into the tree value 75. 75 First place as far right as possible. Then swing left to satisfy npls.

Moves in Building Leftist Heap 25 50 Normal insertion of a new node into the tree value 25. 75 As this is a min Tree, 25 is the new root. Then swing left to satisfy npls.

Moves in Building Leftist Heap 50 25 55 Normal insertion of a new node into the tree value 55. 75 No swing required.

Moves in Building Leftist Heap 75 25 50 55 40 What is wrong with this? Normal insertion of a new node into the tree value 40. Not a min heap at this point. Need to swap 40 and 55 and swing.

Moves in Building Leftist Heap 50 25 40 Normal insertion of a new node into the tree value 40. 75 55 Not a min heap at this point. Need to swap 40 and 55 and swing.

Moves in Building Leftist Heap 1/2 50 25 40 Normal insertion of a new node into the tree value 65. 75 55 65 While this is still a min heap, the npl at the root is leftist

Moves in Building Leftist Heap 2/1 40 25 50 We need change this from 1/2 to 2/1 so that it remains leftist. 55 65 75 To do this, we switch the left and the right subtrees. After we do the swap, the npl of the root is compliant.

Leftist Heap Algorithm Add new node to right-side of tree, in order If new node is to be inserted as a parent (parent < children) make new node parent link children to it link grandparent down to new node (now new parent) If leaf, attach to right of parent If no left sibling, push to left (hence left-ist) Else left node is present, leave at right child Update all ancestors npls Check each time that all nodes left npl > right npls if not, swap children or node where this condition exists

Building a Leftist Heap Example 21, 14, 17, 10, 3, 23, 26, 8 21

Building a Leftist Heap Example 21, 14, 17, 10, 3, 23, 26, 8 21 14 Insert 14 as the new root

Building a Leftist Heap Example 21, 14, 17, 10, 3, 23, 26, 8 14 21 17 Insert 17 as the right child of 14

Building a Leftist Heap Example 14 21 17 10 21, 14, 17, 10, 3, 23, 26, 8 Insert 10 as the new root

Building a Leftist Heap Example 14 21 17 10 3 21, 14, 17, 10, 3, 23, 26, 8 Insert 3 as the new root

Building a Leftist Heap Example 10 3 23 21, 14, 17, 10, 3, 23, 26, 8 14 21 17 Insert 23 as the right child of 3

Building a Leftist Heap Example 10 3 23 21, 14, 17, 10, 3, 23, 26, 8 14 21 17 26 Insert 26 as the right child of 23 Swing 26 to the left

Building a Leftist Heap Example 10 3 8 21, 14, 17, 10, 3, 23, 26, 8 14 21 17 26 23 Take the right subtree of root 3: nodes 23 & 26 Insert 8 as the new root (parent of 23) Reattach to original root

Leftist Heap Animation https://www.cs.usfca.edu/~galles/visualizatio n/leftistheap.html

Merging Leftist Heaps

Merging Leftist Heaps Leftist heaps actually optimized for merging entire trees Adding a single node is treated as special case: merging a heap of one node with an existing heap s root

Merging Leftist Heaps The two constituent heaps we are about to merge must already be leftist heaps Result will be a new leftist heap

Merging Leftist Heaps The Merge procedure takes two leftist trees, A and B, and returns a leftist tree that contains the union of the elements of A and B. In a program, a leftist tree is represented by a pointer to its root.

Merging Leftist Heaps Example 10 1 0 5 15 0 1 0 50 2 1 7 20 25 0 99 1 0 0 75 0 22 Where should we attempt to merge?

Merging Leftist Heaps Example 7 20 25 75 22 50 99 In the right sub-tree

Merging Leftist Heaps Example 22 25 75 All the way down to the right most node

Merging Leftist Heaps Example 22 75 25 As there are two nodes in the right subtree, swap. Important: We don t split a heap, so 22 must be the parent in this merge

Merging Leftist Heaps Example 22 75 25 Merge two subtrees

Merging Leftist Heaps Example 7 20 22 50 99 75 25 Next level of the tree

Merging Leftist Heaps Example 1 5 1 7 2 10 15 20 22 50 99 75 25 Right side of the tree has a npl of 2 so we need to swap

Merging Leftist Heaps Example 7 2 2 1 1 5 20 22 10 15 50 99 75 25 Now the highest npl is on the left.

Merging Leftist Heaps Code /** * Merge rhs into the priority queue. * rhs becomes empty. rhs must be different from this. */ void merge( LeftistHeap & rhs ) { if( this == &rhs ) // Avoid aliasing problems return; } root = merge( root, rhs.root ); rhs.root = NULL;

Merging Leftist Heaps Code /** * Internal method to merge two roots. * Deals with deviant cases and calls recursive merge1. */ LeftistNode * merge( LeftistNode *h1, LeftistNode *h2 ) { if( h1 == NULL ) return h2; if( h2 == NULL ) return h1; if( h1->element < h2->element ) return merge1( h1, h2 ); else return merge1( h2, h1 ); }

Merging Leftist Heaps Code /** * Internal method to merge two roots. * Assumes trees are not empty, & h1's root contains smallest item. */ LeftistNode * merge1( LeftistNode *h1, LeftistNode *h2 ) { if( h1->left == NULL ) // Single node h1->left = h2; // Other fields in h1 already accurate else { h1->right = merge( h1->right, h2 ); if( h1->left->npl < h1->right->npl ) swapchildren( h1 ); h1->npl = h1->right->npl + 1; } return h1; }

Deleting from Leftist Heap

Deleting from Leftist Heap Simple to just remove a node (since at top) this will make two trees Merge the two trees like we just did

Deleting from Leftist Heap 1 3 8 0 0 0 14 23 2 10 21 17 0 26 1 0 We remove the root.

Deleting from Leftist Heap 1 3 8 0 0 0 14 23 2 10 21 17 0 26 1 0 Then we do a merge and because min is in left subtree, we recursively merge right into left

Deleting from Leftist Heap 1 3 8 0 0 0 14 23 2 10 21 17 0 26 1 0 Then we do a merge and because min is in left subtree, we recursively merge right into left

Deleting from Leftist Heap 0 21 23 1 8 1 0 10 14 1 0 17 26 0 After Merge

Leftist Heaps Merge with two trees of size n O(log n), we are not creating a totally new tree!! some was used as the LEFT side! Inserting into a left-ist heap O(log n) same as before with a regular heap deletemin with heap size n O(log n) remove and return root (minimum value) merge left and right subtrees