Algorithms and Data Structures Group. Gerth Stølting Brodal

Size: px
Start display at page:

Download "Algorithms and Data Structures Group. Gerth Stølting Brodal"

Transcription

1 Algorithms and Data Structures Group Gerth Stølting Brodal Faculty Meeting, Department of Computer Science, Aarhus University, October 3, 2014

2 VIP Lars Arge (Professor) Gerth Stølting Brodal (Lektor) Peyman Afshani (Adjunkt) Kasper Green Larsen (Adjunkt) PostDocs Allan Grønlund Jørgensen (HTF) Wanbin Son Zengfeng Huang Constantinos Tsirogiannis (AUFF) PhD students Bryan Wilkinson Edvin Berglin Ingo van Duijn Jakob Truelsen Jesper Asbjørn Sindahl Nielsen Jungwoo Yang Morten Revsbæk Sarfraz Raza Mathias Rav Konstantinos Mampentzidis MSc students Claus Jespersen Mikkel Engelbrecht Hougaard Bo Mortensen Weekly visitors Peder Klith Bøcher Brody Steven Sandel (Biodiversity Group) Programmer Svend Christian Svendsen Administration Trine Ji Holmgaard Jensen, Katrine Østerlund Rasmussen, Ellen Kjemtrup

3 Events Workshop on Massive Data Algorithmis (2009 -) Symposium on Computational Geometry (2009) European Symposium on Algorithms / ALGO 2016 MADALGO Summer Schools 2007, 2008, MADALGO retreat (October)

4 Research Efficiency O(n 3 ) O(n 2 ) O(n log 2 n) O(n log n)? log n O(n loglog n ) quartet distance between two trees Less practical? Deeper insights Improved asymptotics More complicated? algorithm engineering? O(log n) log n O( loglog n ) O(loglog n) O( loglog n)? O(1) lower bound? integer sorting, cost per element

5 Algorithms Research Theory Gerth Kasper Peyman Lars EcoInformatics BioInformatics COWI, DES, EIVA, Algorithm engineering Applications

6 Research Models of Computation RAM model memory access and other operations O(1), sometimes * is (1) Pointer model disallow arrays, memory is a graph with O(1) out-degree Functional model pointer model with no side-effects, implies persistence Comparison model/decision trees simple lower bounds Cell-probe model strong lower bounds, applies to RAM model Bit-probe model fundamental lower bounds, special case of cell-probe Implicit model O(1) working space, store information as input permutation IO model focus on number of memory-disk transfers Cache-oblivious model abstract model to model multiple memory layers Streaming model limited working space, single or multiple scans of input

7 Integer Sorting Time per element Results (n words of w bits) O log log n O(1) 1 log n? 2 NEW 3 log 2 n loglog n log 2+ε n w Bucket sort O(n+2 w ) Radix sort; Hollerith 1887 O n w log n van Emde Boas 1975 O n log w Willard 1983 superlinear space expected Kirkpatrick and Reicsh 1983 O n log w log n Merge sort: von Neumann 1945 O n log n comparison based optimal Thorup and Han 2002 O n log (w/log n) O n log log n expected Andersson et al O(n) expected, w Ω log 2+ε n Belazzougui, Brodal, Nielsen 2014 O(n) expected, w Ω log 2 n log log n

8 Threesomes, Degenerates, and Love Triangles Allan Grønlund, Seth Pettie FOCS SUM problem : Given real numbers x 1,..., x n, does there exist x i + x j + x k = 0? Conjecture : 3SUM requires time Θ(n 2 ) Theorem : 3SUM can be solved in time O(n 2 / (log n/loglog n) 2/3 ) Theorem : 3SUM has decision tree complexity O(n 3/2 log n)

9 Gerth Brodal, Kasper Larsen SWAT 2014 Planar Orthogonal Skyline Queries Space (words) Query Reporting O(n) O(n lglg n) O(n lg ε n) O(k lg ε n) O(k lglg n + lg n/lglg n) O(k + lg n/lglg n) Counting O(n) O(n lg O(1) n) O(lg n/lglg n) (lg n/lglg n)

10 Peyman Afshani JCGA 2013 Half-Space Range Reporting Query time Q(n) Space n Q(n) d

11 Memory Hierarchies CPU Processor R L1 L2 L3 A M Disk bottleneck increasing access times and memory sizes

12 IO Model Cost = # block transfers Cache-Oblivious Model Memory, size M Disk Block size B I/O model...but algorithms do not know B and M Assume optimal cache replacement strategy Optimal on all levels (under some assumptions) Scanning O(N/B) IOs, Sorting O(N/B log M/B N/B) IOs Alok Aggarwal and Jeff Vitter. The Input/Output Complexity of Sorting and Related Problems. Communications of the ACM 31(9) Matteo Frigo, Charles E. Leiserson, Harald Prokop, Sridhar Ramachandran. Cache-Oblivious Algorithms. ACM Transactions on Algorithms, 8(1), Article No. 4, 2012.

13 Computing Multiresolution Rasters average Output size = n =1 n 2 2 = O(n 2 ) Input x Output RAM algorithm O(n 2 ) time n x n n x n n 2 x n 2 n 3 x n 3 n 4 x n 4 n x n... 1x1 IO Model - O(Sort(n 2 )) IOs Lars Arge, Herman Haverkort and Constantinos Tsirogiannis. ACM SIGSPATIAL Cache Oblivious Model - O(Scan(n 2 )) IOs Lars Arge, Gerth Stølting Brodal, Jakob Truelsen, and Constantinos Tsirogiannis. ESA 2013.

14

15 Terrain Research Height matrix Terrain model

16

17 Lars Arge, Morten Revsbæk, and Norbert Zeh SoCG 2010 Areas Flooded by 100 mm Rain SoCG 2010 MADALGO prototype SCALGO prodct

18 Algorithms Research Theory Kasper Peyman Gerth Lars EcoInformatics BioInformatics COWI, DES, EIVA, Algorithm engineering Applications

BRICS Research Activities Algorithms

BRICS Research Activities Algorithms BRICS Research Activities Algorithms Gerth Stølting Brodal BRICS Retreat, Sandbjerg, 21 23 October 2002 1 Outline of Talk The Algorithms Group Courses Algorithm Events Expertise within BRICS Examples Algorithms

More information

An optimal and practical cache-oblivious algorithm for computing multiresolution rasters

An optimal and practical cache-oblivious algorithm for computing multiresolution rasters An optimal and practical cache-oblivious algorithm for computing multiresolution rasters Lars Arge, Gerth Stølting Brodal, Jakob Truelsen, Constantinos Tsirogiannis MADALGO, Department of Computer Science,

More information

Planar Point Location in Sublogarithmic Time

Planar Point Location in Sublogarithmic Time Planar Point Location in Sublogarithmic Time Mihai Pătraşcu (MIT) Point Location in o(log n) Time, Voronoi Diagrams in o(n log n) Time, and Other Transdichotomous Results in Computational Geometry Timothy

More information

Cache-Oblivious String Dictionaries

Cache-Oblivious String Dictionaries Cache-Oblivious String Dictionaries Gerth Stølting Brodal University of Aarhus Joint work with Rolf Fagerberg #"! Outline of Talk Cache-oblivious model Basic cache-oblivious techniques Cache-oblivious

More information

Cache-Oblivious Algorithms A Unified Approach to Hierarchical Memory Algorithms

Cache-Oblivious Algorithms A Unified Approach to Hierarchical Memory Algorithms Cache-Oblivious Algorithms A Unified Approach to Hierarchical Memory Algorithms Aarhus University Cache-Oblivious Current Trends Algorithms in Algorithms, - A Unified Complexity Approach to Theory, Hierarchical

More information

38 Cache-Oblivious Data Structures

38 Cache-Oblivious Data Structures 38 Cache-Oblivious Data Structures Lars Arge Duke University Gerth Stølting Brodal University of Aarhus Rolf Fagerberg University of Southern Denmark 38.1 The Cache-Oblivious Model... 38-1 38.2 Fundamental

More information

Introduction to I/O Efficient Algorithms (External Memory Model)

Introduction to I/O Efficient Algorithms (External Memory Model) Introduction to I/O Efficient Algorithms (External Memory Model) Jeff M. Phillips August 30, 2013 Von Neumann Architecture Model: CPU and Memory Read, Write, Operations (+,,,...) constant time polynomially

More information

Lecture 9 March 15, 2012

Lecture 9 March 15, 2012 6.851: Advanced Data Structures Spring 2012 Prof. Erik Demaine Lecture 9 March 15, 2012 1 Overview This is the last lecture on memory hierarchies. Today s lecture is a crossover between cache-oblivious

More information

Algorithms for dealing with massive data

Algorithms for dealing with massive data Computer Science Department Federal University of Rio Grande do Sul Porto Alegre, Brazil Outline of the talk Introduction Outline of the talk Algorithms models for dealing with massive datasets : Motivation,

More information

Lecture 24 November 24, 2015

Lecture 24 November 24, 2015 CS 229r: Algorithms for Big Data Fall 2015 Prof. Jelani Nelson Lecture 24 November 24, 2015 Scribes: Zhengyu Wang 1 Cache-oblivious Model Last time we talked about disk access model (as known as DAM, or

More information

Massive Data Algorithmics. Lecture 1: Introduction

Massive Data Algorithmics. Lecture 1: Introduction . Massive Data Massive datasets are being collected everywhere Storage management software is billion-dollar industry . Examples Phone: AT&T 20TB phone call database, wireless tracking Consumer: WalMart

More information

Report Seminar Algorithm Engineering

Report Seminar Algorithm Engineering Report Seminar Algorithm Engineering G. S. Brodal, R. Fagerberg, K. Vinther: Engineering a Cache-Oblivious Sorting Algorithm Iftikhar Ahmad Chair of Algorithm and Complexity Department of Computer Science

More information

External Memory. Philip Bille

External Memory. Philip Bille External Memory Philip Bille Outline Computationals models Modern computers (word) RAM I/O Cache-oblivious Shortest path in implicit grid graphs RAM algorithm I/O algorithms Cache-oblivious algorithm Computational

More information

Lecture 19 Apr 25, 2007

Lecture 19 Apr 25, 2007 6.851: Advanced Data Structures Spring 2007 Prof. Erik Demaine Lecture 19 Apr 25, 2007 Scribe: Aditya Rathnam 1 Overview Previously we worked in the RA or cell probe models, in which the cost of an algorithm

More information

Simple and Semi-Dynamic Structures for Cache-Oblivious Planar Orthogonal Range Searching

Simple and Semi-Dynamic Structures for Cache-Oblivious Planar Orthogonal Range Searching Simple and Semi-Dynamic Structures for Cache-Oblivious Planar Orthogonal Range Searching ABSTRACT Lars Arge Department of Computer Science University of Aarhus IT-Parken, Aabogade 34 DK-8200 Aarhus N Denmark

More information

External Memory Pipelining Made Easy With TPIE

External Memory Pipelining Made Easy With TPIE External Memory Pipelining Made Easy With TPIE Lars Arge 1, Mathias Rav 1, Svend C. Svendsen 1 MADALGO, Dept. of Computer Science Aarhus University Aarhus, Denmark {large,rav,svendcs}@madalgo.au.dk Jakob

More information

Massive Data Algorithmics

Massive Data Algorithmics Massive Data Algorithmics University of Aarhus Department of Computer Science Faglig Dag, January 17, 2008 running time The core problem... Normal algorithm I/O-efficient algorithm data size Main memory

More information

3.2 Cache Oblivious Algorithms

3.2 Cache Oblivious Algorithms 3.2 Cache Oblivious Algorithms Cache-Oblivious Algorithms by Matteo Frigo, Charles E. Leiserson, Harald Prokop, and Sridhar Ramachandran. In the 40th Annual Symposium on Foundations of Computer Science,

More information

External Memory Algorithms and Data Structures. Winter 2004/2005

External Memory Algorithms and Data Structures. Winter 2004/2005 External Memory Algorithms and Data Structures Winter 2004/2005 Riko Jacob Peter Widmayer Assignments: Yoshio Okamoto EMADS 04/ 05: Course Description Page 1 External Memory Algorithms and Data Structures

More information

The History of I/O Models Erik Demaine

The History of I/O Models Erik Demaine The History of I/O Models Erik Demaine MASSACHUSETTS INSTITUTE OF TECHNOLOGY Memory Hierarchies in Practice CPU 750 ps Registers 100B Level 1 Cache 100KB Level 2 Cache 1MB 10GB 14 ns Main Memory 1EB-1ZB

More information

Computing Visibility on Terrains in External Memory

Computing Visibility on Terrains in External Memory Computing Visibility on Terrains in External Memory Herman Haverkort Laura Toma Yi Zhuang TU. Eindhoven Netherlands Bowdoin College USA Visibility Problem: visibility map (viewshed) of v terrain T arbitrary

More information

Improved Visibility Computation on Massive Grid Terrains

Improved Visibility Computation on Massive Grid Terrains Improved Visibility Computation on Massive Grid Terrains Jeremy Fishman Herman Haverkort Laura Toma Bowdoin College USA Eindhoven University The Netherlands Bowdoin College USA Laura Toma ACM GIS 2009

More information

Multi-core Computing Lecture 2

Multi-core Computing Lecture 2 Multi-core Computing Lecture 2 MADALGO Summer School 2012 Algorithms for Modern Parallel and Distributed Models Phillip B. Gibbons Intel Labs Pittsburgh August 21, 2012 Multi-core Computing Lectures: Progress-to-date

More information

I/O-Efficient Data Structures for Colored Range and Prefix Reporting

I/O-Efficient Data Structures for Colored Range and Prefix Reporting I/O-Efficient Data Structures for Colored Range and Prefix Reporting Kasper Green Larsen MADALGO Aarhus University, Denmark larsen@cs.au.dk Rasmus Pagh IT University of Copenhagen Copenhagen, Denmark pagh@itu.dk

More information

Adaptive and Approximate Orthogonal Range Counting

Adaptive and Approximate Orthogonal Range Counting Adaptive and Approximate Orthogonal Range Counting Timothy M. Chan Bryan T. Wilkinson Abstract We present three new results on one of the most basic problems in geometric data structures, 2-D orthogonal

More information

Cache-Aware and Cache-Oblivious Adaptive Sorting

Cache-Aware and Cache-Oblivious Adaptive Sorting Cache-Aware and Cache-Oblivious Adaptive Sorting Gerth Stølting rodal 1,, Rolf Fagerberg 2,, and Gabriel Moruz 1 1 RICS, Department of Computer Science, University of Aarhus, IT Parken, Åbogade 34, DK-8200

More information

Lecture 7 8 March, 2012

Lecture 7 8 March, 2012 6.851: Advanced Data Structures Spring 2012 Lecture 7 8 arch, 2012 Prof. Erik Demaine Scribe: Claudio A Andreoni 2012, Sebastien Dabdoub 2012, Usman asood 2012, Eric Liu 2010, Aditya Rathnam 2007 1 emory

More information

Cache-Oblivious Planar Orthogonal Range Searching and Counting

Cache-Oblivious Planar Orthogonal Range Searching and Counting Cache-Oblivious Planar Orthogonal Range Searching and Counting Lars Arge BRICS Dept. of Computer Science University of Aarhus IT Parken, Aabogade 34 8200 Aarhus N, Denmark large@daimi.au.dk Gerth Stølting

More information

Funnel Heap - A Cache Oblivious Priority Queue

Funnel Heap - A Cache Oblivious Priority Queue Alcom-FT Technical Report Series ALCOMFT-TR-02-136 Funnel Heap - A Cache Oblivious Priority Queue Gerth Stølting Brodal, Rolf Fagerberg Abstract The cache oblivious model of computation is a two-level

More information

Computing Visibility on Terrains in External Memory

Computing Visibility on Terrains in External Memory Computing Visibility on Terrains in External Memory HERMAN HAVERKORT Technische Universiteit Eindhoven, The Netherlands. LAURA TOMA Bowdoin College, Maine, USA. and YI ZHUANG Bowdoin College, Maine, USA.

More information

Handling Massive Terrains and Unreliable Memory

Handling Massive Terrains and Unreliable Memory Handling Massive Terrains and Unreliable Memory Thomas Mølhave PhD Dissertation Department of Computer Science Aarhus University Denmark Handling Massive Terrains and Unreliable Memory A Dissertation

More information

Algorithms and Data Structures: Efficient and Cache-Oblivious

Algorithms and Data Structures: Efficient and Cache-Oblivious 7 Ritika Angrish and Dr. Deepak Garg Algorithms and Data Structures: Efficient and Cache-Oblivious Ritika Angrish* and Dr. Deepak Garg Department of Computer Science and Engineering, Thapar University,

More information

Cache-Oblivious and Data-Oblivious Sorting and Applications

Cache-Oblivious and Data-Oblivious Sorting and Applications Cache-Oblivious and Data-Oblivious Sorting and Applications T-H. Hubert Chan, Yue Guo, Wei-Kai Lin, and Elaine Shi Jan, 2018 External Memory Model Cache efficiency: # of blocks Time: # of words Memory

More information

Computing Visibility on Terrains in External Memory

Computing Visibility on Terrains in External Memory Computing Visibility on Terrains in External Memory Herman Haverkort Laura Toma Yi Zhuang TU. Eindhoven Netherlands Bowdoin College USA ALENEX 2007 New Orleans, USA Visibility Problem: visibility map (viewshed)

More information

Lecture 22 November 19, 2015

Lecture 22 November 19, 2015 CS 229r: Algorithms for ig Data Fall 2015 Prof. Jelani Nelson Lecture 22 November 19, 2015 Scribe: Johnny Ho 1 Overview Today we re starting a completely new topic, which is the external memory model,

More information

Cache-Oblivious Algorithms

Cache-Oblivious Algorithms Cache-Oblivious Algorithms Matteo Frigo, Charles Leiserson, Harald Prokop, Sridhar Ramchandran Slides Written and Presented by William Kuszmaul THE DISK ACCESS MODEL Three Parameters: B M P Block Size

More information

Computational Geometry in the Parallel External Memory Model

Computational Geometry in the Parallel External Memory Model Computational Geometry in the Parallel External Memory Model Nodari Sitchinava Institute for Theoretical Informatics Karlsruhe Institute of Technology nodari@ira.uka.de 1 Introduction Continued advances

More information

Lists Revisited: Cache Conscious STL lists

Lists Revisited: Cache Conscious STL lists Lists Revisited: Cache Conscious STL lists Leonor Frias, Jordi Petit, Salvador Roura Departament de Llenguatges i Sistemes Informàtics. Universitat Politècnica de Catalunya. Overview Goal: Improve STL

More information

Level-Balanced B-Trees

Level-Balanced B-Trees Gerth Stølting rodal RICS University of Aarhus Pankaj K. Agarwal Lars Arge Jeffrey S. Vitter Center for Geometric Computing Duke University January 1999 1 -Trees ayer, McCreight 1972 Level 2 Level 1 Leaves

More information

Cache-Oblivious Traversals of an Array s Pairs

Cache-Oblivious Traversals of an Array s Pairs Cache-Oblivious Traversals of an Array s Pairs Tobias Johnson May 7, 2007 Abstract Cache-obliviousness is a concept first introduced by Frigo et al. in [1]. We follow their model and develop a cache-oblivious

More information

Simplifying massive planar subdivisions

Simplifying massive planar subdivisions Simplifying massive planar subdivisions Lars Arge, Jakob Truelsen, Jungwoo Yang Abstract We present the first I/O- and practically-efficient algorithm for simplifying a planar subdivision, such that no

More information

Cache Oblivious Distribution Sweeping

Cache Oblivious Distribution Sweeping Cache Oblivious Distribution Sweeping Gerth Stølting Brodal 1,, and Rolf Fagerberg 1, BRICS, Department of Computer Science, University of Aarhus, Ny Munkegade, DK-8000 Århus C, Denmark. E-mail: {gerth,rolf}@brics.dk

More information

Two-Dimensional Range Diameter Queries

Two-Dimensional Range Diameter Queries Two-Dimensional Range Diameter Queries Pooya Davoodi 1, Michiel Smid 2, and Freek van Walderveen 1 1 MADALGO, Department of Computer Science, Aarhus University, Denmark. 2 School of Computer Science, Carleton

More information

Lecture 12 March 16, 2010

Lecture 12 March 16, 2010 6.851: Advanced Data Structures Spring 010 Prof. Erik Demaine Lecture 1 March 16, 010 1 Overvie In the last lecture e covered the round elimination technique and loer bounds on the static predecessor problem.

More information

arxiv: v1 [cs.ds] 1 May 2015

arxiv: v1 [cs.ds] 1 May 2015 Strictly Implicit Priority Queues: On the Number of Moves and Worst-Case Time Gerth Stølting Brodal, Jesper Sindahl Nielsen, and Jakob Truelsen arxiv:1505.00147v1 [cs.ds] 1 May 2015 MADALGO, Department

More information

Lecture April, 2010

Lecture April, 2010 6.851: Advanced Data Structures Spring 2010 Prof. Eri Demaine Lecture 20 22 April, 2010 1 Memory Hierarchies and Models of Them So far in class, we have wored with models of computation lie the word RAM

More information

Fully Persistent B-Trees

Fully Persistent B-Trees rd Annual ACM-SIAM Symposium on Discrete Algorithms, Kyoto, Japan, January 8, 0 Fully Persistent B-Trees Gerth Stølting Brodal Konstantinos Tsakalidis Aarhus University, Denmark Spyros Sioutas Ionian University,

More information

arxiv: v2 [cs.ds] 1 Jul 2014

arxiv: v2 [cs.ds] 1 Jul 2014 Cache-Oblivious Persistence Pooya Davoodi 1, Jeremy T. Fineman 2, John Iacono 1, and Özgür Özkan1 1 New York University 2 Georgetown University arxiv:1402.5492v2 [cs.ds] 1 Jul 2014 Abstract Partial persistence

More information

Report on Cache-Oblivious Priority Queue and Graph Algorithm Applications[1]

Report on Cache-Oblivious Priority Queue and Graph Algorithm Applications[1] Report on Cache-Oblivious Priority Queue and Graph Algorithm Applications[1] Marc André Tanner May 30, 2014 Abstract This report contains two main sections: In section 1 the cache-oblivious computational

More information

Bichromatic Line Segment Intersection Counting in O(n log n) Time

Bichromatic Line Segment Intersection Counting in O(n log n) Time Bichromatic Line Segment Intersection Counting in O(n log n) Time Timothy M. Chan Bryan T. Wilkinson Abstract We give an algorithm for bichromatic line segment intersection counting that runs in O(n log

More information

Cache-Oblivious String Dictionaries

Cache-Oblivious String Dictionaries Cache-Oblivious String Dictionaries Gerth Stølting Brodal Rolf Fagerberg Abstract We present static cache-oblivious dictionary structures for strings which provide analogues of tries and suffix trees in

More information

Hierarchical Memory. Modern machines have complicated memory hierarchy

Hierarchical Memory. Modern machines have complicated memory hierarchy Hierarchical Memory Modern machines have complicated memory hierarchy Levels get larger and slower further away from CPU Data moved between levels using large blocks Lecture 2: Slow IO Review Disk access

More information

On External-Memory Planar Depth-First Search

On External-Memory Planar Depth-First Search On External-Memory Planar Depth-First Search Laura Toma Duke University Lars Arge Ulrich Meyer Norbert Zeh Duke University Max-Plank Institute Carlton University August 2 External Graph Problems Applications

More information

Optimal Planar Orthogonal Skyline Counting Queries

Optimal Planar Orthogonal Skyline Counting Queries Optimal Planar Orthogonal Skyline Counting Queries Gerth Stølting Brodal and Kasper Green Larsen MADALGO, Department of Computer Science, Aarhus University, {gerth,larsen}@cs.au.dk Abstract. The skyline

More information

Massive Data Algorithmics. Lecture 12: Cache-Oblivious Model

Massive Data Algorithmics. Lecture 12: Cache-Oblivious Model Typical Computer Hierarchical Memory Basics Data moved between adjacent memory level in blocks A Trivial Program A Trivial Program: d = 1 A Trivial Program: d = 1 A Trivial Program: n = 2 24 A Trivial

More information

Linear-Space Data Structures for Range Mode Query in Arrays

Linear-Space Data Structures for Range Mode Query in Arrays Linear-Space Data Structures for Range Mode Query in Arrays Timothy M. Chan 1, Stephane Durocher 2, Kasper Green Larsen 3, Jason Morrison 2, and Bryan T. Wilkinson 1 1 University of Waterloo, Waterloo,

More information

Multi-core Computing Lecture 1

Multi-core Computing Lecture 1 Hi-Spade Multi-core Computing Lecture 1 MADALGO Summer School 2012 Algorithms for Modern Parallel and Distributed Models Phillip B. Gibbons Intel Labs Pittsburgh August 20, 2012 Lecture 1 Outline Multi-cores:

More information

On the Cell Probe Complexity of Dynamic Membership or

On the Cell Probe Complexity of Dynamic Membership or On the Cell Probe Complexity of Dynamic Membership or Can We Batch Up Updates in External Memory? Ke Yi and Qin Zhang Hong Kong University of Science & Technology SODA 2010 Jan. 17, 2010 1-1 The power

More information

Master Thesis Preparation. Algorithms. Gerth Stølting Brodal

Master Thesis Preparation. Algorithms. Gerth Stølting Brodal Master Thesis Preparation Algorithms Gerth Stølting Brodal Overview Algorithms group at DAIMI Who? Where? Courses Research Master thesis in Algorithms Types of thesis Recent thesis topics Algorithms Group

More information

Memory Management Algorithms on Distributed Systems. Katie Becker and David Rodgers CS425 April 15, 2005

Memory Management Algorithms on Distributed Systems. Katie Becker and David Rodgers CS425 April 15, 2005 Memory Management Algorithms on Distributed Systems Katie Becker and David Rodgers CS425 April 15, 2005 Table of Contents 1. Introduction 2. Coarse Grained Memory 2.1. Bottlenecks 2.2. Simulations 2.3.

More information

On Dynamic Range Reporting in One Dimension

On Dynamic Range Reporting in One Dimension On Dynamic Range Reporting in One Dimension Christian Mortensen 1 Rasmus Pagh 1 Mihai Pǎtraşcu 2 1 IT U. Copenhagen 2 MIT STOC May 22, 2005 Range Reporting in 1D Maintain a set S, S = n, under: INSERT(x):

More information

Cache-Oblivious Index for Approximate String Matching

Cache-Oblivious Index for Approximate String Matching Cache-Oblivious Index for Approximate String Matching Wing-Kai Hon 1, Tak-Wah Lam 2, Rahul Shah 3, Siu-Lung Tam 2, and Jeffrey Scott Vitter 3 1 Department of Computer Science, National Tsing Hua University,

More information

Cache-Oblivious Data Structures and Algorithms for Undirected Breadth-First Search and Shortest Paths

Cache-Oblivious Data Structures and Algorithms for Undirected Breadth-First Search and Shortest Paths Cache-Oblivious Data Structures and Algorithms for Undirected Breadth-First Search and Shortest Paths Gerth Stølting Brodal 1,,, Rolf Fagerberg 2,, Ulrich Meyer 3,,, and Norbert Zeh 4 1 BRICS, Department

More information

Cache-Adaptive Analysis

Cache-Adaptive Analysis Cache-Adaptive Analysis Michael A. Bender1 Erik Demaine4 Roozbeh Ebrahimi1 Jeremy T. Fineman3 Rob Johnson1 Andrea Lincoln4 Jayson Lynch4 Samuel McCauley1 1 3 4 Available Memory Can Fluctuate in Real Systems

More information

Dynamic Indexability and Lower Bounds for Dynamic One-Dimensional Range Query Indexes

Dynamic Indexability and Lower Bounds for Dynamic One-Dimensional Range Query Indexes Dynamic Indexability and Lower Bounds for Dynamic One-Dimensional Range Query Indexes Ke Yi HKUST 1-1 First Annual SIGMOD Programming Contest (to be held at SIGMOD 2009) Student teams from degree granting

More information

I/O Model. Cache-Oblivious Algorithms : Algorithms in the Real World. Advantages of Cache-Oblivious Algorithms 4/9/13

I/O Model. Cache-Oblivious Algorithms : Algorithms in the Real World. Advantages of Cache-Oblivious Algorithms 4/9/13 I/O Model 15-853: Algorithms in the Real World Locality II: Cache-oblivious algorithms Matrix multiplication Distribution sort Static searching Abstracts a single level of the memory hierarchy Fast memory

More information

Dynamic Indexability and the Optimality of B-trees and Hash Tables

Dynamic Indexability and the Optimality of B-trees and Hash Tables Dynamic Indexability and the Optimality of B-trees and Hash Tables Ke Yi Hong Kong University of Science and Technology Dynamic Indexability and Lower Bounds for Dynamic One-Dimensional Range Query Indexes,

More information

Instance-Optimal Geometric Algorithms

Instance-Optimal Geometric Algorithms Instance-Optimal Geometric Algorithms Timothy Chan School of CS U. Waterloo joint work with Peyman Afshani (MADALGO, Aarhus U) Jérémy Barbay (U. Chile) Theme Beyond worst-case analysis Adaptive algorithms

More information

Computing visibility on terrains in external memory

Computing visibility on terrains in external memory Computing visibility on terrains in external memory Haverkort, H.J.; Toma, L.; Zhuang, Yi Published in: Proceedings of the Workshop on Algorithm Engineering and Experiments (ALENEX 2007) 6 January 2007,

More information

I/O-Algorithms Lars Arge Aarhus University

I/O-Algorithms Lars Arge Aarhus University I/O-Algorithms Aarhus University April 10, 2008 I/O-Model Block I/O D Parameters N = # elements in problem instance B = # elements that fits in disk block M = # elements that fits in main memory M T =

More information

Lecture 8 13 March, 2012

Lecture 8 13 March, 2012 6.851: Advanced Data Structures Spring 2012 Prof. Erik Demaine Lecture 8 13 March, 2012 1 From Last Lectures... In the previous lecture, we discussed the External Memory and Cache Oblivious memory models.

More information

Cache-Oblivious Algorithms and Data Structures

Cache-Oblivious Algorithms and Data Structures Cache-Oblivious Algorithms and Data Structures Erik D. Demaine MIT Laboratory for Computer Science, 200 Technology Square, Cambridge, MA 02139, USA, edemaine@mit.edu Abstract. A recent direction in the

More information

Simplifying Massive Contour Maps

Simplifying Massive Contour Maps Simplifying Massive Contour Maps Lars Arge 1, Lasse Deleuran 1, Thomas Mølhave 2, Morten Revsbæk 1, and Jakob Truelsen 3 1 MADALGO, Department of Computer Science, Aarhus University 2 Department of Computer

More information

Buffer Heap Implementation & Evaluation. Hatem Nassrat. CSCI 6104 Instructor: N.Zeh Dalhousie University Computer Science

Buffer Heap Implementation & Evaluation. Hatem Nassrat. CSCI 6104 Instructor: N.Zeh Dalhousie University Computer Science Buffer Heap Implementation & Evaluation Hatem Nassrat CSCI 6104 Instructor: N.Zeh Dalhousie University Computer Science Table of Contents Introduction...3 Cache Aware / Cache Oblivious Algorithms...3 Buffer

More information

Optimal Static Range Reporting in One Dimension

Optimal Static Range Reporting in One Dimension of Optimal Static Range Reporting in One Dimension Stephen Alstrup Gerth Stølting Brodal Theis Rauhe ITU Technical Report Series 2000-3 ISSN 1600 6100 November 2000 Copyright c 2000, Stephen Alstrup Gerth

More information

Integer Algorithms and Data Structures

Integer Algorithms and Data Structures Integer Algorithms and Data Structures and why we should care about them Vladimír Čunát Department of Theoretical Computer Science and Mathematical Logic Doctoral Seminar 2010/11 Outline Introduction Motivation

More information

Orthogonal Point Location and Rectangle Stabbing Queries in 3-d

Orthogonal Point Location and Rectangle Stabbing Queries in 3-d Orthogonal Point Location and Rectangle Stabbing Queries in 3-d Timothy M. Chan Dept. of Computer Science, University of Illinois at Urbana-Champaign, USA tmc@illinois.edu Yakov Nekrich Cheriton School

More information

Cache-efficient string sorting for Burrows-Wheeler Transform. Advait D. Karande Sriram Saroop

Cache-efficient string sorting for Burrows-Wheeler Transform. Advait D. Karande Sriram Saroop Cache-efficient string sorting for Burrows-Wheeler Transform Advait D. Karande Sriram Saroop What is Burrows-Wheeler Transform? A pre-processing step for data compression Involves sorting of all rotations

More information

Massive Data Algorithmics

Massive Data Algorithmics In the name of Allah Massive Data Algorithmics An Introduction Overview MADALGO SCALGO Basic Concepts The TerraFlow Project STREAM The TerraStream Project TPIE MADALGO- Introduction Center for MAssive

More information

Theoretical Computer Science

Theoretical Computer Science Theoretical Computer Science 412 (2011) 3579 3588 Contents lists available at ScienceDirect Theoretical Computer Science journal homepage: www.elsevier.com/locate/tcs Cache-oblivious index for approximate

More information

Cache-oblivious comparison-based algorithms on multisets

Cache-oblivious comparison-based algorithms on multisets Cache-oblivious comparison-based algorithms on multisets Arash Farzan 1, Paolo Ferragina 2, Gianni Franceschini 2, and J. Ian unro 1 1 {afarzan, imunro}@uwaterloo.ca School of Computer Science, University

More information

Path Minima Queries in Dynamic Weighted Trees

Path Minima Queries in Dynamic Weighted Trees Path Minima Queries in Dynamic Weighted Trees Gerth Stølting Brodal 1, Pooya Davoodi 1, S. Srinivasa Rao 2 1 MADALGO, Department of Computer Science, Aarhus University. E-mail: {gerth,pdavoodi}@cs.au.dk

More information

Deterministic Rectangle Enclosure and Offline Dominance Reporting on the RAM

Deterministic Rectangle Enclosure and Offline Dominance Reporting on the RAM Deterministic Rectangle Enclosure and Offline Dominance Reporting on the RAM Peyman Afshani 1, Timothy M. Chan 2, and Konstantinos Tsakalidis 3 1 MADALGO, Department of Computer Science, Aarhus University,

More information

Optimality in External Memory Hashing

Optimality in External Memory Hashing Optimality in External Memory Hashing Morten Skaarup Jensen and Rasmus Pagh April 2, 2007 Abstract Hash tables on external memory are commonly used for indexing in database management systems. In this

More information

The Batched Predecessor Problem in External Memory

The Batched Predecessor Problem in External Memory The Batched Predecessor Problem in External Memory Michael A. Bender 12, Martín Farach-Colton 23, Mayank Goswami 4, Dzejla Medjedovic 5, Pablo Montes 1, and Meng-Tsung Tsai 3 1 Stony Brook University,

More information

Cache-Oblivious Persistence

Cache-Oblivious Persistence Cache-Oblivious Persistence Pooya Davoodi 1,, Jeremy T. Fineman 2,, John Iacono 1,,andÖzgür Özkan 1 1 New York University 2 Georgetown University Abstract. Partial persistence is a general transformation

More information

ICS 691: Advanced Data Structures Spring Lecture 8

ICS 691: Advanced Data Structures Spring Lecture 8 ICS 691: Advanced Data Structures Spring 2016 Prof. odari Sitchinava Lecture 8 Scribe: Ben Karsin 1 Overview In the last lecture we continued looking at arborally satisfied sets and their equivalence to

More information

Cache Oblivious Search Trees via Binary Trees of Small Height

Cache Oblivious Search Trees via Binary Trees of Small Height Alcom-FT Technical Report Series ALCOMFT-TR-02-53 Cache Oblivious Search Trees via Binary Trees of Small Height Gerth Stølting Brodal, Rolf Fagerberg Riko Jacob Abstract We propose a version of cache oblivious

More information

Lower bound for comparison-based sorting

Lower bound for comparison-based sorting COMP3600/6466 Algorithms 2018 Lecture 8 1 Lower bound for comparison-based sorting Reading: Cormen et al, Section 8.1 and 8.2 Different sorting algorithms may have different running-time complexities.

More information

Improved Bounds for Orthogonal Point Enclosure Query and Point Location in Orthogonal Subdivisions in R 3

Improved Bounds for Orthogonal Point Enclosure Query and Point Location in Orthogonal Subdivisions in R 3 Improved Bounds for Orthogonal Point Enclosure Query and Point Location in Orthogonal Subdivisions in R 3 Saladi Rahul Abstract In this paper, new results for two fundamental problems in the field of computational

More information

Lecture 12 March 21, 2007

Lecture 12 March 21, 2007 6.85: Advanced Data Structures Spring 27 Oren Weimann Lecture 2 March 2, 27 Scribe: Tural Badirkhanli Overview Last lecture we saw how to perform membership quueries in O() time using hashing. Today we

More information

A Faster Cache-Oblivious Shortest-Path Algorithm for Undirected Graphs with Bounded Edge Lengths

A Faster Cache-Oblivious Shortest-Path Algorithm for Undirected Graphs with Bounded Edge Lengths A Faster Cache-Oblivious Shortest-Path Algorithm for Undirected Graphs with Bounded Edge Lengths Luca Allulli Peter Lichodzijewski Norbert Zeh Abstract We present a cache-oblivious algorithm for computing

More information

Dynamic Range Majority Data Structures

Dynamic Range Majority Data Structures Dynamic Range Majority Data Structures Amr Elmasry 1, Meng He 2, J. Ian Munro 3, and Patrick K. Nicholson 3 1 Department of Computer Science, University of Copenhagen, Denmark 2 Faculty of Computer Science,

More information

Cache-Oblivious R-Trees

Cache-Oblivious R-Trees Cache-Oblivious R-Trees Lars Arge BRICS, Department of Computer Science, University of Aarhus IT-Parken, Aabogade 34, DK-8200 Aarhus N, Denmark. large@daimi.au.dk Mark de Berg Department of Computing Science,

More information

Expected Time in Linear Space

Expected Time in Linear Space Optimizing Integer Sorting in O(n log log n) Expected Time in Linear Space Ajit Singh M. E. (Computer Science and Engineering) Department of computer Science and Engineering, Thapar University, Patiala

More information

Objective of the present work

Objective of the present work Objective of the present work Optimize Road Network Optimize Airline Network Optimize Rail Network Optimize Computer Network Optimize Social Network Spanners and Emulators For most graph algorithms, the

More information

Lecture 13 March 17, 2005

Lecture 13 March 17, 2005 6.897: Advanced Data Structures Spring 25 Prof. Erik Demaine ecture 3 March 7, 25 Scribe: Brian Jacokes Overview The sorting problem, in which we wish to sort n elements according to a given ordering,

More information

How many leaves on the decision tree? There are n! leaves, because every permutation appears at least once.

How many leaves on the decision tree? There are n! leaves, because every permutation appears at least once. Chapter 8. Sorting in Linear Time Types of Sort Algorithms The only operation that may be used to gain order information about a sequence is comparison of pairs of elements. Quick Sort -- comparison-based

More information

I/O Efficieny of Highway Hierarchies

I/O Efficieny of Highway Hierarchies I/O Efficieny of Highway Hierarchies Riko Jacob Sushant Sachdeva Departement of Computer Science ETH Zurich, Technical Report 531, September 26 Abstract Recently, Sanders and Schultes presented a shortest

More information

Engineering a Cache-Oblivious Sorting Algorithm

Engineering a Cache-Oblivious Sorting Algorithm Alcom-FT Technical Report Series ALCOMFT-TR-03-101 Engineering a Cache-Oblivious Sorting Algorithm Gerth Stølting Brodal, Rolf Fagerberg Kristoffer Vinther Abstract The cache-oblivious model of computation

More information