Sensors. Outline. Sensor networks. Tributaries and Deltas: Efficient and Robust Aggregation in Sensor Network Streams

Size: px
Start display at page:

Download "Sensors. Outline. Sensor networks. Tributaries and Deltas: Efficient and Robust Aggregation in Sensor Network Streams"

Transcription

1 ributaries and s: Efficient and Robust Aggregation in Sensor Network Streams Acknowledgements for slides: Amit Manjhi, SIGMOD 5 Amit Manjhi, Suman Nath, Phillip B. Gibbons Carnegie Mellon University Intel Research Pittsburgh Presented by: Simrat Wason Duke University Background and Motivation ributary- Approach Simple Aggregates in D framework Frequent items in D Framework Sensors -Battery operated tiny devices Constraints: - Conserving battery power is important - Comm. Consumes more energy than local computation - Operate in dynamic, harsh environments Sensor networks Important type of query is computing aggregates e.g., total number of live sensors (route all the sensor readings to the base station) 3 Count 3 Existing energy-efficient in-network approaches: ree and Multi-path ree Multi-path [inydb, Cougar] [Considine et al. ICDE 4] In-network aggregation is performed to save - Non-robust topology + Exact answer + Robust opology - Approximate answer

2 ree and Multi-path radeoffs R M S E r r o r.4 Robust topology Exact answer ree Multi-path Loss rate Loss rate varies with change in conditions Can we get the best of both by adapting to changing loss rates? SOLUION: ributary- Approach to In-network aggregation in sensor networks Run tree and multi-path simultaneously in diff. parts of the Network - as Energy-efficient as tree or multi-path - Significant error reduction - multi-path region adapts to loss rate (Multi-path region) ributary (ree region) ributary- How does ributary- work? Correctness: A tree node should not receive aggregates from a multi-path node Gives rise to a delta at the centre (multi-path aggregation is used in the nodes at the centre) (Multi-path region) ributary (ree region) How does ributary- adapt? Expand or shrink the delta region Expand delta increases robustness Shrink delta lowers approximation error D-Coarse: uniform expansion D: focused expansion ributary Computing Aggregates in the ributary- Framework 3. Nodes at the boundary Conversion Function: Convert tree results to multi-path results 2. Each multi-path node Multi-path Algorithm: Generate multi-path partial results 1. Each tree node ree Algorithm: Generate tree partial results

3 Example Aggregates Many useful aggregates can be readily computed within the ributary- framework Missing piece: a suitable conversion function Conversion functions for several aggregates: -Count -Sum, Average -op-k -Uniform sample ributary- Finding Frequent Items ree Algorithm: Previous work [Greenwald, Khanna PODS 4, Manjhi et al. ICDE 5] ree algorithm achieves optimal bound for total Multi-path Algorithm: Previous work [Nath et al. SenSys 4] Multi-path algorithm is more accurate than previous work Conversion Function Framework for finding Freq. Items 1. Add frequency counts from children 2. Decrement frequency counts 3. Drop counters that are below zero hese steps are repeated at each internal node; decrements depend on height in the tree Max possible error ε How much to decrement at different levels? Error Exact Minimizes total Leaf Minimizes Need Geometric to balance decrease two competing decrement, pressures: 1. e.g.: Early.5%, reduction 5%, of data.125%, (near on any leaf) link 2. Informed.5%, reduction.75%,.875%,., of data (near ε=.1% root) Height Early Drop Late Drop Root Multi-path Algorithm for Freq. Items 1. Add Duplicate insensitive addition 2. Decrement Duplicate insensitive subtraction 3. Drop counters below zero 2. Drop counters below (rising) threshold hreshold is maintained based on careful analysis Paper has details on lowering

4 ributary- Related works and conclusion Evaluation Methodology he AG Simulator [Madden et al. OSDI 2] opology: 6 random sensors in 2 x 2 Base station is at the center Approaches: ree-based scheme: AG Multi-path scheme: Synopsis Diffusion [Nath et al. SenSys 4] D-Coarse: uniform expansion f d i Effects of regional loss rate Effects of global loss rate Loss rate =.5 Varying loss rate R M S E r r o r ree Multi-path D-Coarse D Loss rate in shaded region All four approaches use same energy Varying.5 loss rate Loss Rate 1.Methods effectively combine the benefits: perform better than either.4 existing.6.8 approach 1 2. All four approaches use Loss same Rate energy RMS Error ree Multi-path.15 D-coarse D RMS Error ree Multi-path D-coarse D.1 Computation of frequent items Data from real sensor deployment Loss rate =.5 Varying loss rate False negatives in % False positives < 3% ree Multi-path D Loss rate in shaded region RELAED WORK: Existing in-network aggregation algorithms ree: inydb [Madden et al. SIGMOD 3] Multi-path: Considine et al. ICDE 4, Bawa et al. SIGMOD 4, Nath et al. SenSys 4 Adapting to changes in the environment Directed Diffusion [Intanagowiwat et al. MobiCOM ], AG [Madden et al. OSDI 2] Frequent items and quantiles Manku, Motwani VLDB 2, Greenwald, Khanna PODS 4, Manjhi et al. ICDE 5

5 Discussion Are frequent item queries interesting in sensor networks? Can we lift the constraint that an M edge can never be incident of on a vertex? hreshold on the minimum percentage of nodes that should contribute to the aggregate answer Overhead, convergence, and speed of adaptivity CONCLUSION: ributary-: energy-efficient, and robust solution Combines benefits of existing tree- and multi-path based approaches Adapt to changing network conditions Algorithms for finding frequent items Results confirm the advantages Error reduction is up to a factor of 3 FUURE WORK: Deployment in a real scenario incorporate in inydb Add other aggregates to the suite of aggregates

Tributaries and Deltas: Efficient and Robust Aggregation in Sensor Network Streams

Tributaries and Deltas: Efficient and Robust Aggregation in Sensor Network Streams Tributaries and Deltas: Efficient and Robust Aggregation in Sensor Network Streams Amit Manjhi Carnegie Mellon University manjhi@cs.cmu.edu Suman Nath Carnegie Mellon University sknath@cs.cmu.edu Phillip

More information

Tributaries and Deltas: Efficient and Robust Aggregation in Sensor Network Streams

Tributaries and Deltas: Efficient and Robust Aggregation in Sensor Network Streams Tributaries and Deltas: Efficient and Robust Aggregation in Sensor Network Streams Amit Manjhi Carnegie Mellon Univerity manjhi@cs.cmu.edu Suman Nath Carnegie Mellon Univerity sknath@cs.cmu.edu Phillip

More information

Sensor Network Protocol Design and Implementation. Philip Levis UC Berkeley

Sensor Network Protocol Design and Implementation. Philip Levis UC Berkeley Sensor Network Protocol Design and Implementation Philip Levis UC Berkeley Sensor Network Constraints Distibuted, wireless networks with limited resources Energy, energy, energy. Communication is expensive.

More information

CE693: Adv. Computer Networking

CE693: Adv. Computer Networking CE693: Adv. Computer Networking L-13 Sensor Networks Acknowledgments: Lecture slides are from the graduate level Computer Networks course thought by Srinivasan Seshan at CMU. When slides are obtained from

More information

Synopsis Diffusion for Robust Aggregation in Sensor Networks

Synopsis Diffusion for Robust Aggregation in Sensor Networks Synopsis Diffusion for Robust Aggregation in Sensor Networks SUMAN NATH Microsoft Research PHILLIP B. GIBBONS Intel Research Pittsburgh SRINIVASAN SESHAN Carnegie Mellon University and ZACHARY ANDERSON

More information

Data Streams Algorithms

Data Streams Algorithms Data Streams Algorithms Phillip B. Gibbons Intel Research Pittsburgh Guest Lecture in 15-853 Algorithms in the Real World Phil Gibbons, 15-853, 12/4/06 # 1 Outline Data Streams in the Real World Formal

More information

Security of Aggregated Data in Wireless Sensor Network

Security of Aggregated Data in Wireless Sensor Network Security of Aggregated Data in Wireless Sensor Network Surabhi Singhal Abstract A Wireless Sensor Network can be defined as a group of sensors which are distributed spatially to monitor physical or spatial

More information

Data Stream Processing

Data Stream Processing Data Stream Processing Part II 1 Data Streams (recap) continuous, unbounded sequence of items unpredictable arrival times too large to store locally one pass real time processing required 2 Reservoir Sampling

More information

Approximate Aggregation Techniques for Sensor Databases

Approximate Aggregation Techniques for Sensor Databases Approximate Aggregation Techniques for Sensor Databases John Byers Computer Science Department Boston University Joint work with Jeffrey Considine, George Kollios and Feifei Li Sensor Network Model Large

More information

Slides based on the Cormode/Garofalakis VLDB 2006 tutorial

Slides based on the Cormode/Garofalakis VLDB 2006 tutorial User Query Q(fi, fj,...) Approximate Answer for Q(fi, fj,...) Global Streams f f s Coordinator Site State Update Messages Site k f, f s, f,k f s,k local update streams local update streams Slides based

More information

FEDA: Fault-tolerant Energy-Efficient Data Aggregation in Wireless Sensor Networks

FEDA: Fault-tolerant Energy-Efficient Data Aggregation in Wireless Sensor Networks : Fault-tolerant Energy-Efficient Data Aggregation in Wireless Sensor Networks Mohammad Hossein Anisi Department of Electrical and Computer Engineering Azad University of Qazvin, Qazvin, Iran anisi@qazviniau.ac.ir

More information

Cushion: Autonomically Adaptive Data Fusion in Wireless Sensor Networks. Technical Report August 2005

Cushion: Autonomically Adaptive Data Fusion in Wireless Sensor Networks. Technical Report August 2005 Cushion: Autonomically Adaptive Data Fusion in Wireless Sensor Networks Jungmin So Jintae Kim Indranil Gupta Department of Computer Science, University of Illinois at Urbana-Champaign {jso1, kim28, indy}@cs.uiuc.edu

More information

TAG: A TINY AGGREGATION SERVICE FOR AD-HOC SENSOR NETWORKS

TAG: A TINY AGGREGATION SERVICE FOR AD-HOC SENSOR NETWORKS TAG: A TINY AGGREGATION SERVICE FOR AD-HOC SENSOR NETWORKS SAMUEL MADDEN, MICHAEL J. FRANKLIN, JOSEPH HELLERSTEIN, AND WEI HONG Proceedings of the Fifth Symposium on Operating Systems Design and implementation

More information

Sweeps Over Sensor Networks. Primoz Skraba, An Nguyen, Qing Fang, Leonidas Guibas AHPCRC Stanford University August 3, 2007

Sweeps Over Sensor Networks. Primoz Skraba, An Nguyen, Qing Fang, Leonidas Guibas AHPCRC Stanford University August 3, 2007 Sweeps Over Sensor Networks Primoz Skraba, An Nguyen, Qing Fang, Leonidas Guibas AHPCRC Stanford University August 3, 2007 Data aggregation over entire network - Exact aggregate - Only a few nodes need

More information

The Journal of Systems and Software

The Journal of Systems and Software The Journal of Systems and Software 83 (2010) 2627 2641 Contents lists available at ScienceDirect The Journal of Systems and Software journal homepage: www.elsevier.com/locate/jss Effective processing

More information

DS504/CS586: Big Data Analytics Data Management Prof. Yanhua Li

DS504/CS586: Big Data Analytics Data Management Prof. Yanhua Li Welcome to DS504/CS586: Big Data Analytics Data Management Prof. Yanhua Li Time: 6:00pm 8:50pm R Location: KH 116 Fall 2017 First Grading for Reading Assignment Weka v 6 weeks v https://weka.waikato.ac.nz/dataminingwithweka/preview

More information

Fractional Cascading in Wireless. Jie Gao Computer Science Department Stony Brook University

Fractional Cascading in Wireless. Jie Gao Computer Science Department Stony Brook University Fractional Cascading in Wireless Sensor Networks Jie Gao Computer Science Department Stony Brook University 1 Sensor Networks Large number of small devices for environment monitoring 2 My recent work Lightweight,

More information

Mining Data Streams. Outline [Garofalakis, Gehrke & Rastogi 2002] Introduction. Summarization Methods. Clustering Data Streams

Mining Data Streams. Outline [Garofalakis, Gehrke & Rastogi 2002] Introduction. Summarization Methods. Clustering Data Streams Mining Data Streams Outline [Garofalakis, Gehrke & Rastogi 2002] Introduction Summarization Methods Clustering Data Streams Data Stream Classification Temporal Models CMPT 843, SFU, Martin Ester, 1-06

More information

Securely Computing an Approximate Median in Wireless Sensor Networks

Securely Computing an Approximate Median in Wireless Sensor Networks Securely Computing an Approximate Median in Wireless Sensor Networks Sankardas Roy 1 sroy1@gmu.edu Mauro Conti 1,2 conti@di.uniroma1.it Sanjeev Setia 3 setia@gmu.edu Sushil Jajodia 1 jajodia@gmu.edu 1

More information

A Cross-Layer Perspective of Routing. Taming the Underlying Challenges of Reliable Routing in Sensor Networks. Underlying Connectivity in Reality

A Cross-Layer Perspective of Routing. Taming the Underlying Challenges of Reliable Routing in Sensor Networks. Underlying Connectivity in Reality Taming the Underlying Challenges of Reliable Routing in Sensor Networks Alec Woo, Terence Tong, and David Culler UC Berkeley and Intel Research Berkeley A Cross-Layer Perspective of Routing How to get

More information

904 IEEE/ACM TRANSACTIONS ON NETWORKING, VOL. 16, NO. 4, AUGUST 2008

904 IEEE/ACM TRANSACTIONS ON NETWORKING, VOL. 16, NO. 4, AUGUST 2008 904 IEEE/ACM TRANSACTIONS ON NETWORKING, VOL. 16, NO. 4, AUGUST 2008 Optimizing Lifetime for Continuous Data Aggregation With Precision Guarantees in Wireless Sensor Networks Xueyan Tang, Member, IEEE,

More information

Approximately Uniform Random Sampling in Sensor Networks

Approximately Uniform Random Sampling in Sensor Networks Approximately Uniform Random Sampling in Sensor Networks Boulat A. Bash, John W. Byers and Jeffrey Considine Motivation Data aggregation Approximations to COUNT, SUM, AVG, MEDIAN Existing work does not

More information

Efficient Online State Tracking Using Sensor Networks

Efficient Online State Tracking Using Sensor Networks Efficient Online State Tracking Using Sensor Networks M.Halkidi 1, V.Kalogeraki 2, D.Gunopulos 2, D.Papadopoulos 2, D.Zeinalipour-Yazti 3, and M.Vlachos 4 1 Athens U of Economics and Business, 2 UC Riverside,

More information

Information Management I: Sensor Database, Querying, Publish & Subscribe, Information Summarization + SIGMOD 2003 paper

Information Management I: Sensor Database, Querying, Publish & Subscribe, Information Summarization + SIGMOD 2003 paper Information Management I: Sensor Database, Querying, Publish & Subscribe, Information Summarization + SIGMOD 2003 paper CS428: Information Processing for Sensor Networks, and STREAM meeting Presented by

More information

Mining Frequent Itemsets from Data Streams with a Time- Sensitive Sliding Window

Mining Frequent Itemsets from Data Streams with a Time- Sensitive Sliding Window Mining Frequent Itemsets from Data Streams with a Time- Sensitive Sliding Window Chih-Hsiang Lin, Ding-Ying Chiu, Yi-Hung Wu Department of Computer Science National Tsing Hua University Arbee L.P. Chen

More information

Aggregate Threshold Queries in Sensor Networks

Aggregate Threshold Queries in Sensor Networks Aggregate Threshold Queries in Sensor Networks Izchak Sharfman 1, Assaf Schuster 1, Daniel Keren 2 1 Technion 2 Haifa University Dept. of Computer Science Dept. of Computer Science Hafia, Israel Haifa,

More information

Staying FIT: Efficient Load Shedding Techniques for Distributed Stream Processing

Staying FIT: Efficient Load Shedding Techniques for Distributed Stream Processing Staying FIT: Efficient Load Shedding Techniques for Distributed Stream Processing Nesime Tatbul Uğur Çetintemel Stan Zdonik Talk Outline Problem Introduction Approach Overview Advance Planning with an

More information

Querying the Sensor Network. TinyDB/TAG

Querying the Sensor Network. TinyDB/TAG Querying the Sensor Network TinyDB/TAG 1 TAG: Tiny Aggregation Query Distribution: aggregate queries are pushed down the network to construct a spanning tree. Root broadcasts the query and specifies its

More information

Robust Aggregation in Sensor Network: An Efficient Frequent itemset and Number of occurrence counting

Robust Aggregation in Sensor Network: An Efficient Frequent itemset and Number of occurrence counting Robust Aggregation in Sensor Network: An Efficient Frequent itemset and Number of occurrence counting Kayalvizhi s (1) and Vanitha k (2) 1 M.Phil Scholar, SITS, Dr. G R D College of Science, Coimbatore.

More information

Integrated Routing and Query Processing in Wireless Sensor Networks

Integrated Routing and Query Processing in Wireless Sensor Networks Integrated Routing and Query Processing in Wireless Sensor Networks T.Krishnakumar Lecturer, Nandha Engineering College, Erode krishnakumarbtech@gmail.com ABSTRACT Wireless Sensor Networks are considered

More information

CS 525M Mobile and Ubiquitous Computing Seminar. Mark Figura

CS 525M Mobile and Ubiquitous Computing Seminar. Mark Figura CS 525M Mobile and Ubiquitous Computing Seminar Mark Figura About the article IrisNet: An Architecture for a Worldwide Sensor Web Phillip Gibbons, Brad Karp Intel Research Pittsburg Yan Ke, Suman Nath,

More information

TiNA: A Scheme for Temporal Coherency-Aware in-network Aggregation

TiNA: A Scheme for Temporal Coherency-Aware in-network Aggregation TiNA: A Scheme for Temporal Coherency-Aware in-network Aggregation Mohamed A. Sharaf, Jonathan Beaver, Alexandros Labrinidis, Panos K. Chrysanthis Department of Computer Science University of Pittsburgh

More information

Multi-query Optimization for Sensor Networks

Multi-query Optimization for Sensor Networks Multi-query Optimization for Sensor Networks Niki Trigoni, Yong Yao, Alan Demers, Johannes Gehrke, and Rajmohan Rajaraman Department of Computer Science and Inf. Systems, Birkbeck College, University of

More information

March 20/2003 Jayakanth Srinivasan,

March 20/2003 Jayakanth Srinivasan, Definition : A simple graph G = (V, E) consists of V, a nonempty set of vertices, and E, a set of unordered pairs of distinct elements of V called edges. Definition : In a multigraph G = (V, E) two or

More information

Data Representation Floating Point

Data Representation Floating Point Data Representation Floating Point CSCI 2400 / ECE 3217: Computer Architecture Instructor: David Ferry Slides adapted from Bryant & O Hallaron s slides via Jason Fritts Today: Floating Point Background:

More information

Summarizing and mining inverse distributions on data streams via dynamic inverse sampling

Summarizing and mining inverse distributions on data streams via dynamic inverse sampling Summarizing and mining inverse distributions on data streams via dynamic inverse sampling Presented by Graham Cormode cormode@bell-labs.com S. Muthukrishnan muthu@cs.rutgers.edu Irina Rozenbaum rozenbau@paul.rutgers.edu

More information

Computing Aggregate Functions in Sensor Networks

Computing Aggregate Functions in Sensor Networks Computing Aggregate Functions in Sensor Networks Antonio Fernández Anta 1 Miguel A. Mosteiro 1,2 Christopher Thraves 3 1 LADyR, GSyC,Universidad Rey Juan Carlos 2 Dept. of Computer Science, Rutgers University

More information

arxiv: v1 [cs.ds] 1 Dec 2008

arxiv: v1 [cs.ds] 1 Dec 2008 Optimal Tracking of Distributed Heavy Hitters and Quantiles Ke Yi Qin Zhang arxiv:0812.0209v1 [cs.ds] 1 Dec 2008 Department of Computer Science and Engineering Hong Kong University of Science and Technology

More information

Data Representation Floating Point

Data Representation Floating Point Data Representation Floating Point CSCI 2400 / ECE 3217: Computer Architecture Instructor: David Ferry Slides adapted from Bryant & O Hallaron s slides via Jason Fritts Today: Floating Point Background:

More information

DUE TO RECENT advances in computing and communication

DUE TO RECENT advances in computing and communication 3146 IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, VOL. 57, NO. 5, SEPTEMBER 2008 Signature-File-Based Approach for Query Answering Over Wireless Sensor Networks Mo Li, Member, IEEE, Lei Chen, Member, IEEE,

More information

Transform & Conquer. Presorting

Transform & Conquer. Presorting Transform & Conquer Definition Transform & Conquer is a general algorithm design technique which works in two stages. STAGE : (Transformation stage): The problem s instance is modified, more amenable to

More information

Approximately Uniform Random Sampling in Sensor Networks

Approximately Uniform Random Sampling in Sensor Networks Approximately Uniform Random Sampling in Sensor Networks Boulat A. Bash John W. Byers Jeffrey Considine Computer Science Department Boston University {boulat,byers,jconsidi}@cs.bu.edu Abstract Recent work

More information

University of Waterloo Waterloo, Ontario, Canada N2L 3G1 Cambridge, MA, USA Introduction. Abstract

University of Waterloo Waterloo, Ontario, Canada N2L 3G1 Cambridge, MA, USA Introduction. Abstract Finding Frequent Items in Sliding Windows with Multinomially-Distributed Item Frequencies (University of Waterloo Technical Report CS-2004-06, January 2004) Lukasz Golab, David DeHaan, Alejandro López-Ortiz

More information

CARNEGIE MELLON UNIVERSITY DEPT. OF COMPUTER SCIENCE DATABASE APPLICATIONS

CARNEGIE MELLON UNIVERSITY DEPT. OF COMPUTER SCIENCE DATABASE APPLICATIONS CARNEGIE MELLON UNIVERSITY DEPT. OF COMPUTER SCIENCE 15-415 DATABASE APPLICATIONS C. Faloutsos Indexing and Hashing 15-415 Database Applications http://www.cs.cmu.edu/~christos/courses/dbms.s00/ general

More information

Image Transmission in Sensor Networks

Image Transmission in Sensor Networks Image Transmission in Sensor Networks King-Shan Lui and Edmund Y. Lam Department of Electrical and Electronic Engineering The University of Hong Kong Pokfulam Road, Hong Kong, China Email {kslui,elam}@eee.hku.hk

More information

New Join Operator Definitions for Sensor Network Databases *

New Join Operator Definitions for Sensor Network Databases * Proceedings of the 6th WSEAS International Conference on Applications of Electrical Engineering, Istanbul, Turkey, May 27-29, 2007 41 New Join Operator Definitions for Sensor Network Databases * Seungjae

More information

Optimal Tracking of Distributed Heavy Hitters and Quantiles

Optimal Tracking of Distributed Heavy Hitters and Quantiles Optimal Tracking of Distributed Heavy Hitters and Quantiles Qin Zhang Hong Kong University of Science & Technology Joint work with Ke Yi PODS 2009 June 30, 2009 - 2- Models and Problems Distributed streaming

More information

Routing Scheme in Energy efficient based Protocols for Wireless Sensor Networks

Routing Scheme in Energy efficient based Protocols for Wireless Sensor Networks Routing Scheme in Energy efficient based Protocols for Wireless Sensor Networks 1 Chiranjeevi Rampilla, 2 Pallikonda Anil Kumar, 1 Student, DEPT.OF CSE, PVPSIT, KANURU, VIJAYAWADA. 2 Asst.Professor, DEPT.OF

More information

Computing Frequent Elements Using Gossip

Computing Frequent Elements Using Gossip Computing Frequent Elements Using Gossip Bibudh Lahiri and Srikanta Tirthapura Iowa State University, Ames, IA, 50011, USA {bibudh,snt}@iastate.edu Abstract. We present algorithms for identifying frequently

More information

Asynchronous Data Aggregation for Real-time Monitoring in Sensor Networks

Asynchronous Data Aggregation for Real-time Monitoring in Sensor Networks Asynchronous Data Aggregation for Real-time Monitoring in Sensor Networks Jie Feng, Derek L. Eager, and Dwight Makaroff Department of Computer Science, University of Saskatchewan, Saskatoon, SK S7N 5C9,

More information

Handling Parallelisation in OpenFOAM

Handling Parallelisation in OpenFOAM Handling Parallelisation in OpenFOAM Hrvoje Jasak hrvoje.jasak@fsb.hr Faculty of Mechanical Engineering and Naval Architecture University of Zagreb, Croatia Handling Parallelisation in OpenFOAM p. 1 Parallelisation

More information

Data Streaming Algorithms for Geometric Problems

Data Streaming Algorithms for Geometric Problems Data Streaming Algorithms for Geometric roblems R.Sharathkumar Duke University 1 Introduction A data stream is an ordered sequence of points that can be read only once or a small number of times. Formally,

More information

Clustering from Data Streams

Clustering from Data Streams Clustering from Data Streams João Gama LIAAD-INESC Porto, University of Porto, Portugal jgama@fep.up.pt 1 Introduction 2 Clustering Micro Clustering 3 Clustering Time Series Growing the Structure Adapting

More information

Gyu Sang Choi Yeungnam University

Gyu Sang Choi Yeungnam University Gyu Sang Choi Yeungnam University PRAM and NAND Flash Memory, and B+Tree in PRAM Outline NAND Flash Memory PRAM Hybrid Storage of PRAM and NAND Flash Memory PRAM Translation Layer (PTL) B+Tree in PRAM

More information

Intersection Acceleration

Intersection Acceleration Advanced Computer Graphics Intersection Acceleration Matthias Teschner Computer Science Department University of Freiburg Outline introduction bounding volume hierarchies uniform grids kd-trees octrees

More information

StreamGlobe Adaptive Query Processing and Optimization in Streaming P2P Environments

StreamGlobe Adaptive Query Processing and Optimization in Streaming P2P Environments StreamGlobe Adaptive Query Processing and Optimization in Streaming P2P Environments A. Kemper, R. Kuntschke, and B. Stegmaier TU München Fakultät für Informatik Lehrstuhl III: Datenbanksysteme http://www-db.in.tum.de/research/projects/streamglobe

More information

Getting More from Segmentation Evaluation

Getting More from Segmentation Evaluation Getting More from Segmentation Evaluation Martin Scaiano University of Ottawa Ottawa, ON, K1N 6N5, Canada mscai056@uottawa.ca Diana Inkpen University of Ottawa Ottawa, ON, K1N 6N5, Canada diana@eecs.uottawa.com

More information

Stateful Detection in High Throughput Distributed Systems

Stateful Detection in High Throughput Distributed Systems Stateful Detection in High Throughput Distributed Systems Gunjan Khanna, Ignacio Laguna, Fahad A. Arshad, Saurabh Bagchi Dependable Computing Systems Lab School of Electrical and Computer Engineering Purdue

More information

Scaling Down. Robert Grimm New York University

Scaling Down. Robert Grimm New York University Scaling Down Robert Grimm New York University Scaling Down in One Slide! Target devices (roughly)! Small form factor! Battery operated! Wireless communications! Strategies! Use proxies! Avoid communications

More information

Surface Simplification Using Quadric Error Metrics

Surface Simplification Using Quadric Error Metrics Surface Simplification Using Quadric Error Metrics Authors: Michael Garland & Paul Heckbert Presented by: Niu Xiaozhen Disclaimer: Some slides are modified from original slides, which were designed by

More information

Network Scheduling for Data Archiving Applications in Sensor Networks

Network Scheduling for Data Archiving Applications in Sensor Networks Network Scheduling for Data Archiving Applications in Sensor Networks Yong Yao S. M. Nazrul Alam Johannes Gehrke Sergio D. Servetto Department of Computer Science, School of Electrical and Computer Engineering

More information

Mining Data Streams. From Data-Streams Management System Queries to Knowledge Discovery from continuous and fast-evolving Data Records.

Mining Data Streams. From Data-Streams Management System Queries to Knowledge Discovery from continuous and fast-evolving Data Records. DATA STREAMS MINING Mining Data Streams From Data-Streams Management System Queries to Knowledge Discovery from continuous and fast-evolving Data Records. Hammad Haleem Xavier Plantaz APPLICATIONS Sensors

More information

Reliability Benefit of Network Coding

Reliability Benefit of Network Coding Reliability Benefit of Majid Ghaderi, Don Towsley and Jim Kurose Department of Computer Science University of Massachusetts Amherst {mghaderi,towsley,kurose}@cs.umass.edu Abstract The capacity benefit

More information

Chapter 3: Naming Page 38. Clients in most cases find the Jini lookup services in their scope by IP

Chapter 3: Naming Page 38. Clients in most cases find the Jini lookup services in their scope by IP Discovery Services - Jini Discovery services require more than search facilities: Discovery Clients in most cases find the Jini lookup services in their scope by IP multicast/broadcast Multicast UDP for

More information

CPSC 695. Data Quality Issues M. L. Gavrilova

CPSC 695. Data Quality Issues M. L. Gavrilova CPSC 695 Data Quality Issues M. L. Gavrilova 1 Decisions Decisions 2 Topics Data quality issues Factors affecting data quality Types of GIS errors Methods to deal with errors Estimating degree of errors

More information

An Energy-Efficient Technique for Processing Sensor Data in Wireless Sensor Networks

An Energy-Efficient Technique for Processing Sensor Data in Wireless Sensor Networks An Energy-Efficient Technique for Processing Sensor Data in Wireless Sensor Networks Kyung-Chang Kim 1,1 and Choung-Seok Kim 2 1 Dept. of Computer Engineering, Hongik University Seoul, Korea 2 Dept. of

More information

Efficient Approximation of Correlated Sums on Data Streams

Efficient Approximation of Correlated Sums on Data Streams Efficient Approximation of Correlated Sums on Data Streams Rohit Ananthakrishna Cornell University rohit@cs.cornell.edu Flip Korn AT&T Labs Research flip@research.att.com Abhinandan Das Cornell University

More information

Efficient Iceberg Query Processing in Sensor Networks

Efficient Iceberg Query Processing in Sensor Networks The Computer Journal Advance Access published October 21, 2013 The British Computer Society 2013. All rights reserved. For Permissions, please email: journals.permissions@oup.com doi:10.1093/comjnl/bxt122

More information

Mobile Element Scheduling for Efficient Data Collection in Wireless Sensor Networks: A Survey

Mobile Element Scheduling for Efficient Data Collection in Wireless Sensor Networks: A Survey Journal of Computer Science 7 (1): 114-119, 2011 ISSN 1549-3636 2011 Science Publications Mobile Element Scheduling for Efficient Data Collection in Wireless Sensor Networks: A Survey K. Indra Gandhi and

More information

Parallelizing Graphics Pipeline Execution (+ Basics of Characterizing a Rendering Workload)

Parallelizing Graphics Pipeline Execution (+ Basics of Characterizing a Rendering Workload) Lecture 2: Parallelizing Graphics Pipeline Execution (+ Basics of Characterizing a Rendering Workload) Visual Computing Systems Analyzing a 3D Graphics Workload Where is most of the work done? Memory Vertex

More information

Extra: B+ Trees. Motivations. Differences between BST and B+ 10/27/2017. CS1: Java Programming Colorado State University

Extra: B+ Trees. Motivations. Differences between BST and B+ 10/27/2017. CS1: Java Programming Colorado State University Extra: B+ Trees CS1: Java Programming Colorado State University Slides by Wim Bohm and Russ Wakefield 1 Motivations Many times you want to minimize the disk accesses while doing a search. A binary search

More information

Module 4: Index Structures Lecture 13: Index structure. The Lecture Contains: Index structure. Binary search tree (BST) B-tree. B+-tree.

Module 4: Index Structures Lecture 13: Index structure. The Lecture Contains: Index structure. Binary search tree (BST) B-tree. B+-tree. The Lecture Contains: Index structure Binary search tree (BST) B-tree B+-tree Order file:///c /Documents%20and%20Settings/iitkrana1/My%20Documents/Google%20Talk%20Received%20Files/ist_data/lecture13/13_1.htm[6/14/2012

More information

Faster, Space-Efficient Selection Algorithms in Read-Only Memory for Integers

Faster, Space-Efficient Selection Algorithms in Read-Only Memory for Integers Faster, Space-Efficient Selection Algorithms in Read-Only Memory for Integers Timothy M. Chan 1, J. Ian Munro 1, and Venkatesh Raman 2 1 Cheriton School of Computer Science, University of Waterloo, Waterloo,

More information

Background: disk access vs. main memory access (1/2)

Background: disk access vs. main memory access (1/2) 4.4 B-trees Disk access vs. main memory access: background B-tree concept Node structure Structural properties Insertion operation Deletion operation Running time 66 Background: disk access vs. main memory

More information

ALL ABOUT DATA AGGREGATION IN WIRELESS SENSOR NETWORKS

ALL ABOUT DATA AGGREGATION IN WIRELESS SENSOR NETWORKS e-issn 2455 1392 Volume 1 Issue 1, November 2015 pp. 1-7 http://www.ijcter.com ALL ABOUT DATA AGGREGATION IN WIRELESS SENSOR NETWORKS Komal Shah 1, Heena Sheth 2 1,2 M. S. University, Baroda Abstract--

More information

Overview. Sampling Large Databases for Association Rules. Introduction

Overview. Sampling Large Databases for Association Rules. Introduction Large Databases for Association Rules Paper presented at the VLDB Conference in 996 Proposes a methodology for finding association rules in a sample Contributions: Negative border Sample size Lowered support

More information

Mining for Patterns and Anomalies in Data Streams. Sampath Kannan University of Pennsylvania

Mining for Patterns and Anomalies in Data Streams. Sampath Kannan University of Pennsylvania Mining for Patterns and Anomalies in Data Streams Sampath Kannan University of Pennsylvania The Problem Data sizes too large to fit in primary memory Devices with small memory Access times to secondary

More information

CS246: Mining Massive Datasets Jure Leskovec, Stanford University

CS246: Mining Massive Datasets Jure Leskovec, Stanford University CS246: Mining Massive Datasets Jure Leskovec, Stanford University http://cs246.stanford.edu [Kumar et al. 99] 2/13/2013 Jure Leskovec, Stanford CS246: Mining Massive Datasets, http://cs246.stanford.edu

More information

Optimal Workload-based Weighted Wavelet Synopses

Optimal Workload-based Weighted Wavelet Synopses Optimal Workload-based Weighted Wavelet Synopses Yossi Matias and Daniel Urieli School of Computer Science Tel-Aviv University {matias,daniel1}@tau.ac.il Abstract. In recent years wavelets were shown to

More information

Aggregation in Sensor Networks: Optimally Trading Information for Energy

Aggregation in Sensor Networks: Optimally Trading Information for Energy Aggregation in Sensor Networks: Optimally Trading Information for Energy Jen Burge Kamesh Munagala Department of Computer Science Duke University jen,kamesh@cs.duke.edu Romit Roy Choudhury Dept. of Electrical

More information

6.837 Introduction to Computer Graphics Final Exam Tuesday, December 20, :05-12pm Two hand-written sheet of notes (4 pages) allowed 1 SSD [ /17]

6.837 Introduction to Computer Graphics Final Exam Tuesday, December 20, :05-12pm Two hand-written sheet of notes (4 pages) allowed 1 SSD [ /17] 6.837 Introduction to Computer Graphics Final Exam Tuesday, December 20, 2011 9:05-12pm Two hand-written sheet of notes (4 pages) allowed NAME: 1 / 17 2 / 12 3 / 35 4 / 8 5 / 18 Total / 90 1 SSD [ /17]

More information

Improving Packing Algorithms for Server Consolidation

Improving Packing Algorithms for Server Consolidation Improving Packing Algorithms for Server Consolidation YASUHIRO A JIRO, ATSUHIRO TANAKA SYSTEM PLATFORMS RESEARCH LABORATORIES, NEC CORPORATION PRESENTED BY : BASIL ALHAKAMI Content Introduction. Background

More information

New Directions in Traffic Measurement and Accounting. Need for traffic measurement. Relation to stream databases. Internet backbone monitoring

New Directions in Traffic Measurement and Accounting. Need for traffic measurement. Relation to stream databases. Internet backbone monitoring New Directions in Traffic Measurement and Accounting C. Estan and G. Varghese Presented by Aaditeshwar Seth 1 Need for traffic measurement Internet backbone monitoring Short term Detect DoS attacks Long

More information

Approximate Quantile Computation over Sensor Networks

Approximate Quantile Computation over Sensor Networks Approximate Quantile Computation over Sensor Networks Xifeng Yan, Jiong Yang, Wei Wang, Jiawei Han University of Illinois at Urbana-Champaign, {xyan, jioyang, hanj}@cs.uiuc.edu University of North Carolina

More information

On the Use of Histograms for Processing Exact Aggregate Queries in Wireless Sensor Networks

On the Use of Histograms for Processing Exact Aggregate Queries in Wireless Sensor Networks On the Use of Histograms for Processing Exact Aggregate Queries in Wireless Sensor Networks Khaled Ammar Mario A. Nascimento Department of Computing Science, University of Alberta, Canada { kammar, mn

More information

Secure Remote Storage Using Oblivious RAM

Secure Remote Storage Using Oblivious RAM Secure Remote Storage Using Oblivious RAM Giovanni Malloy Mentors: Georgios Kellaris, Kobbi Nissim August 11, 2016 Abstract Oblivious RAM (ORAM) is a protocol that allows a user to access the data she

More information

Deep Web Content Mining

Deep Web Content Mining Deep Web Content Mining Shohreh Ajoudanian, and Mohammad Davarpanah Jazi Abstract The rapid expansion of the web is causing the constant growth of information, leading to several problems such as increased

More information

TAG: Tiny AGgregate Queries in Ad-Hoc Sensor Networks

TAG: Tiny AGgregate Queries in Ad-Hoc Sensor Networks Draft Submitted for Publication, February 19, 2002. Do not distribute or cite without permission. 1 TAG: Tiny AGgregate Queries in Ad-Hoc Sensor Networks Samuel Madden, Michael J. Franklin and Joseph Hellerstein

More information

13 Sensor networks Gathering in an adversarial environment

13 Sensor networks Gathering in an adversarial environment 13 Sensor networks Wireless sensor systems have a broad range of civil and military applications such as controlling inventory in a warehouse or office complex, monitoring and disseminating traffic conditions,

More information

Gaia: Geo-Distributed Machine Learning Approaching LAN Speeds

Gaia: Geo-Distributed Machine Learning Approaching LAN Speeds Gaia: Geo-Distributed Machine Learning Approaching LAN Speeds Kevin Hsieh Aaron Harlap, Nandita Vijaykumar, Dimitris Konomis, Gregory R. Ganger, Phillip B. Gibbons, Onur Mutlu Machine Learning and Big

More information

Big Data Analytics CSCI 4030

Big Data Analytics CSCI 4030 High dim. data Graph data Infinite data Machine learning Apps Locality sensitive hashing PageRank, SimRank Filtering data streams SVM Recommen der systems Clustering Community Detection Queries on streams

More information

Misra-Gries Summaries

Misra-Gries Summaries Title: Misra-Gries Summaries Name: Graham Cormode 1 Affil./Addr. Department of Computer Science, University of Warwick, Coventry, UK Keywords: streaming algorithms; frequent items; approximate counting

More information

Data Reduction Techniques in Sensor Networks

Data Reduction Techniques in Sensor Networks Data Reduction Techniques in Sensor Networks Antonios Deligiannakis University of Maryland adeli@cs.umd.edu Yannis Kotidis AT&T Labs-Research kotidis@research.att.com Abstract Recent advances in microelectronics

More information

Tag a Tiny Aggregation Service for Ad-Hoc Sensor Networks. Samuel Madden, Michael Franklin, Joseph Hellerstein,Wei Hong UC Berkeley Usinex OSDI 02

Tag a Tiny Aggregation Service for Ad-Hoc Sensor Networks. Samuel Madden, Michael Franklin, Joseph Hellerstein,Wei Hong UC Berkeley Usinex OSDI 02 Tag a Tiny Aggregation Service for Ad-Hoc Sensor Networks Samuel Madden, Michael Franklin, Joseph Hellerstein,Wei Hong UC Berkeley Usinex OSDI 02 Outline Introduction The Tiny AGgregation Approach Aggregate

More information

Multiple-View Object Recognition in Band-Limited Distributed Camera Networks

Multiple-View Object Recognition in Band-Limited Distributed Camera Networks in Band-Limited Distributed Camera Networks Allen Y. Yang, Subhransu Maji, Mario Christoudas, Kirak Hong, Posu Yan Trevor Darrell, Jitendra Malik, and Shankar Sastry Fusion, 2009 Classical Object Recognition

More information

Incremental Maintenance of Global Aggregates

Incremental Maintenance of Global Aggregates Incremental Maintenance of Global Aggregates Nabeel Ahmed, David Hadaller and Srinivasan Keshav School of Computer Science University of Waterloo 2 University Avenue West Waterloo, Ontario N2L 3G1 {n3ahmed,

More information

Today. Golden section, discussion of error Newton s method. Newton s method, steepest descent, conjugate gradient

Today. Golden section, discussion of error Newton s method. Newton s method, steepest descent, conjugate gradient Optimization Last time Root finding: definition, motivation Algorithms: Bisection, false position, secant, Newton-Raphson Convergence & tradeoffs Example applications of Newton s method Root finding in

More information

Energy-Efficient Dynamic Query Routing Tree Algorithm for Wireless Sensor Networks

Energy-Efficient Dynamic Query Routing Tree Algorithm for Wireless Sensor Networks Energy-Efficient Dynamic Query Routing Tree Algorithm for Wireless Sensor Networks Si Gwan Kim Dept. of Computer Software Kumoh Nat l Inst. of Technology Gumi, Korea Abstract To exploit in answering queries

More information

Estimating Quantiles from the Union of Historical and Streaming Data

Estimating Quantiles from the Union of Historical and Streaming Data Estimating Quantiles from the Union of Historical and Streaming Data Sneha Aman Singh, Iowa State University Divesh Srivastava, AT&T Labs - Research Srikanta Tirthapura, Iowa State University Quantiles

More information

Optimizing Multiple Distributed Stream Queries Using Hierarchical Network Partitions

Optimizing Multiple Distributed Stream Queries Using Hierarchical Network Partitions Optimizing Multiple Distributed Stream Queries Using Hierarchical Network Partitions Sangeetha Seshadri, Vibhore Kumar, Brian F. Cooper and Ling Liu College of Computing, Georgia Institute of Technology

More information