Survey of Evolutionary and Probabilistic Approaches for Source Term Estimation!

Size: px
Start display at page:

Download "Survey of Evolutionary and Probabilistic Approaches for Source Term Estimation!"

Transcription

1 Survey of Evolutionary and Probabilistic Approaches for Source Term Estimation! Branko Kosović" " George Young, Kerrie J. Schmehl, Dustin Truesdell (PSU), Sue Ellen Haupt, Andrew Annunzio, Luna Rodriguez (NCAR), Roger D. Aines, Rich D. Belles, Kathleen M. Dyer, William G. Hanley, Gardar Johannesson, Shawn C. Larsen, Art A. Mirin, John J. Nitao, Gayle A. Sugiyama, Phil J. Vogt (LLNL), Fotini K. Chow (Univ. California at Berkeley) Julie K. Lundquist (Univ. Colorado), Luca Delle Monache (NCAR) NATIONAL CENTER FOR ATMOSPHERIC RESEARCH!

2 Outline! Common components of source term estimation (STE)! Probabilistic approach using Bayesian inference Example: Algeciras accidental release! Optimization using Genetic Algorithms Example: Redoubt volcano release! Summary

3 Source Term Estimation Problem Requirements for STE methodology:! Effective (quantitative & accurate)! Efficient (within time constraints)! Flexible (adaptable, multiple data types)! Robust (operational use)! Quantifies uncertainty (probabilistic) wind

4 Source Term Estimation Process Input Data Sensor Data Met Data (Measurements, NWP) Initial Source Parameter Estimates (Guesses/Samples from Prior) Transport and Dispersion Analytic, Eulerian, Lagrangian Forward Backtrajectory Adjoint Metric Cost Function Likelihood Function Updated Parameter Estimate Variational Approach Optimization/Minimization Stochastic Sampling Convergence

5 Source Term Estimation Process Input Data Sensor Data Met Data (Measurements, NWP) Initial Source Parameter Estimates (Guesses/Samples from Prior) Transport and Dispersion Analytic, Eulerian, Lagrangian Forward Backtrajectory Adjoint Metric Cost Function Likelihood Function Updated Parameter Estimate Variational Approach Optimization/Minimization Stochastic Sampling Convergence

6 Source Term Estimation Process Input Data Sensor Data Met Data (Measurements, NWP) Initial Source Parameter Estimates (Guesses/Samples form Prior) Transport and Dispersion Analytic, Eulerian, Lagrangian Forward Backtrajectory Adjoint Metric Cost Function Likelihood Function Updated Parameter Estimate Variational Approach Optimization/Minimization Stochastic Sampling Convergence

7 Source Term Estimation Process Input Data Sensor Data Met Data (Measurements, NWP) Initial Source Parameter Estimates (Guesses/Samples from Prior) Transport and Dispersion Analytic, Eulerian, Lagrangian Forward Backtrajectory Adjoint Metric Cost Function Likelihood Function Updated Parameter Estimate Variational Approach Optimization/Minimization Stochastic Sampling Convergence

8 Source Term Estimation Process Input Data: Sensor Data Met Data (Measurements, NWP) Initial Source Parameter Estimates (Guesses/Samples from Prior) Transport and Dispersion Analytic, Eulerian, Lagrangian Forward Backtrajectory Adjoint Metric Cost Function Likelihood Function Updated Parameter Estimate Variational Approach Optimization/Minimization (with or without gradients) Stochastic Sampling Convergence

9 Source Term Estimation Process Input Data: Sensor Data Met Data (Measurements, NWP) Initial Source Parameter Estimates (Guesses/Samples from Prior) Transport and Dispersion Analytic, Eulerian, Lagrangian Forward Backtrajectory Adjoint Metric Cost Function Likelihood Function Updated Parameter Estimate Variational Approach Optimization/Minimization (with or without gradients) Stochastic Sampling Convergence Single Set of Parameters Probability Distribution

10 Source Term Estimation Input Data: Sensor Data Met Data (Measurements, NWP) Initial Source Parameter Estimates (Guesses/Samples from Prior) PROBABILISTIC APPROACH USING BAYESIAN INFERENCE WITH STOCHASTIC SAMPLING Transport and Dispersion Analytic, Eulerian, Lagrangian Forward Backtrajectory Adjoint Metric Cost Function Likelihood Function Updated Parameter Estimate Variational Approach Optimization/Minimization (with or without gradients) Stochastic Sampling Convergence Single Set of Parameters Probability Distribution

11 Source Term Estimation Input Data: Sensor Data Met Data (Measurements, NWP) Initial Source, Met Data Estimates (Guesses/Samples from Prior) OPTIMIZATION APPROACH USING GENETIC ALGORITHM Transport and Dispersion Analytic, Eulerian, Lagrangian Forward Backtrajectory Adjoint Metric Cost Function Likelihood Function Updated Parameter Estimate Variational Approach Optimization/Minimization (with or without gradients) Stochastic Sampling Convergence Single Set of Parameters Probability Distribution

12 Outline! Common components of source term estimation (STE)! Probabilistic approach using Bayesian inference Example: Algeciras accidental release! Optimization using Genetic Algorithms Redoubt volcano release! Summary

13 Models and Observations are Coupled Through Bayesian Inference STOCHASTIC SAMPLING OF UNKNOWN PARAMETERS Informed prior and improved proposal distribution Markov Chain Monte Carlo Sequential Monte Carlo METEOROLOGY DISPERSION MODELS Urban models: (empirical puff, CFD) Rejected configuration Hybrid and multi-resolution methods BAYESIAN COMPARISON (Bayes Theorem) P(θ d) = P(d θ) P(θ) / P(d) Accepted configuration Update likelihood until convergence to a posterior distribution Global, regional models: (2D, 3D, puff, particle) (Model predictions) OBSERVED DATA ERROR QUANTIFICATION Dynamic Data-Driven Event Reconstruction for Atmospheric Releases, UCRL-TR

14 Algeciras Accidental Release! 30

15 Simulation Set-up and Assumptions! Surface point source! Time and duration of the release ( UTC, May 30, 1998)! Sampling box (next slide)! 11 stations for 17 observations (9 on 06/02/ on 06/03/1998)! Zero concentrations not used

16 Prediction of Source Location Using Three Markov Chains! ~3600 km ~1800 km

17 Probability Contours for Source Location Using Three Markov Chains!

18 Location and Release Rate Probability Densities

19 Plume Prediction! After Several Hours 1200 UTC)! 30

20 Prediction plume after 1 day 31

21 Prediction plume after 2 days June 1

22 Prediction plume after 3 day 2

23 Prediction plume after 5 day 4

24 Prediction plume after 6 day 5

25 Outline! Common components of source term estimation (STE)! Probabilistic approach using Bayesian inference Example: Algeciras accidental release! Optimization using Genetic Algorithms Redoubt volcano release! Summary

26 Genetic Algorithm Initial Random Population of Chromosomes Q, u, θ Dispersion Model New Variables Iterate No Evaluate Cost Function Low Cost Mate Mutate High Cost Discard cost function = TS TS s= 1 [ O C ] s 2 TS [ O ] [ C ] s s= 1 s= 1 s s Convergence? Yes Final Variables

27 Redoubt Volcano Eruption March 23, 2009 Eruption The Alaska Volcano Observatory (AVO) observed eleven major explosive events during the first week, and a total of 19 events over the 14 day explosive eruptive period in March and early April. Coordinates: N W Elevation: 3108 meters (10,197 ft.) Volcano Type: Stratovolcano

28 Eruption Timeline Sunday March 22 Monday March 23 First Eruption Begins Fifth Eruption Ends!!!!!!!!!!10PM!!!!!!!11PM!!!!!!!12AM!!!!!!!1AM!!!!!!!!!!2AM!!!!!!!!!3AM!!!!!!!!!4AM!!!!!!!!!5AM!!!!!!!!!6AM!!!!!!!!!7AM! First 4 PM Second Sounding Satellite Pass

29 Satellite Data GOES-11 satellite provided data for use with the GA

30 Single Uniform Release Results Ten Runs Wind direction ( ) Wind speed (m s-1) Emission Rate (kg s-1) Cost Function Value Run x Run x Run x Run x Run x Run x Run x Run x Population 64 Generations 200 Mutation Rate 20% Run x Run x Mean x STD x Selection 50%

31 Single Uniform Release: GA Initialized Best Solution Emission Rate Total Mass Emitted Wind Direction Wind Speed 8.0x10 4 kg/s 2.6x10 9 kg m/s

32 Summary How to achieve effectiveness and efficiency while dealing with complexity and uncertainty? Both algorithms are effective but require significant computational expense. Bayesian approach: Provides probabilistic solution Flexible framework Delle Monache et al. Bayesian Inference and Markov Chain Monte Carlo Sampling to Reconstruct a Contaminant Source on a Continental Scale, J. Appl. Meteor. and Climatol., 47, Genetic Algorithm approach: Efficient exploration of parameter space Single best solution, but also probabilistic Schmehl et al. A Genetic Algorithm Variational Approach to Data Assimilation and Application to Volcanic Emissions, accepted for publication in Atmospheric Environment.

Stochastic Reconstruction of Multiple Source Atmospheric Contaminant Dispersion Events

Stochastic Reconstruction of Multiple Source Atmospheric Contaminant Dispersion Events Boise State University ScholarWorks Mechanical and Biomedical Engineering Faculty Publications and Presentations Department of Mechanical and Biomedical Engineering 8-1-2013 Stochastic Reconstruction of

More information

1.1 Temporal and Spatial Reconstruction of Atmospheric Puff Releases using Bayesian Inference

1.1 Temporal and Spatial Reconstruction of Atmospheric Puff Releases using Bayesian Inference . Temporal and Spatial Reconstruction of Atmospheric Puff Releases using Bayesian Inference Derek Wade and Inanc Senocak High Performance Simulation Laboratory for Thermo-fluids Department of Mechanical

More information

Nested Sampling: Introduction and Implementation

Nested Sampling: Introduction and Implementation UNIVERSITY OF TEXAS AT SAN ANTONIO Nested Sampling: Introduction and Implementation Liang Jing May 2009 1 1 ABSTRACT Nested Sampling is a new technique to calculate the evidence, Z = P(D M) = p(d θ, M)p(θ

More information

Sue Ellen Haupt* George S. Young. Applied Research Laboratory and Meteorology Department, The Pennsylvania State University, State College, PA

Sue Ellen Haupt* George S. Young. Applied Research Laboratory and Meteorology Department, The Pennsylvania State University, State College, PA J6.1 PARADIGMS FOR SOURCE CHARACTERIZATION Sue Ellen Haupt* George S. Young Applied Research Laboratory and Meteorology Department, The Pennsylvania State University, State College, PA 1. INTRODUCTION

More information

Modeling and Reasoning with Bayesian Networks. Adnan Darwiche University of California Los Angeles, CA

Modeling and Reasoning with Bayesian Networks. Adnan Darwiche University of California Los Angeles, CA Modeling and Reasoning with Bayesian Networks Adnan Darwiche University of California Los Angeles, CA darwiche@cs.ucla.edu June 24, 2008 Contents Preface 1 1 Introduction 1 1.1 Automated Reasoning........................

More information

Operational use of numerical dispersion/fallout models at the USGS to advise partner agencies and the public of ashfall hazards

Operational use of numerical dispersion/fallout models at the USGS to advise partner agencies and the public of ashfall hazards Operational use of numerical dispersion/fallout models at the USGS to advise partner agencies and the public of ashfall hazards Hans F. Schwaiger 1, Larry G. Mastin 2 1 Alaska Volcano Observatory, Anchorage,

More information

Parametric Approaches for Refractivity-From-Clutter Inversion

Parametric Approaches for Refractivity-From-Clutter Inversion Parametric Approaches for Refractivity-From-Clutter Inversion Peter Gerstoft Marine Physical Laboratory, Scripps Institution of Oceanography La Jolla, CA 92093-0238 phone: (858) 534-7768 fax: (858) 534-7641

More information

Approximate Bayesian Computation using Auxiliary Models

Approximate Bayesian Computation using Auxiliary Models Approximate Bayesian Computation using Auxiliary Models Tony Pettitt Co-authors Chris Drovandi, Malcolm Faddy Queensland University of Technology Brisbane MCQMC February 2012 Tony Pettitt () ABC using

More information

GNU MCSim Frederic Yves Bois Chair of mathematical modeling and system biology for predictive toxicology

GNU MCSim Frederic Yves Bois Chair of mathematical modeling and system biology for predictive toxicology GNU MCSim Frederic Yves Bois Chair of mathematical modeling and system biology for predictive toxicology frederic.bois@utc.fr 20/06/2011 1 / 11 Talk overview GNU MCSim is... What it can do Statistical

More information

Models and Heuristics for Robust Resource Allocation in Parallel and Distributed Computing Systems

Models and Heuristics for Robust Resource Allocation in Parallel and Distributed Computing Systems Models and Heuristics for Robust Resource Allocation in Parallel and Distributed Computing Systems D. Janovy, J. Smith, H. J. Siegel, and A. A. Maciejewski Colorado State University Outline n models and

More information

Tracking Algorithms. Lecture16: Visual Tracking I. Probabilistic Tracking. Joint Probability and Graphical Model. Deterministic methods

Tracking Algorithms. Lecture16: Visual Tracking I. Probabilistic Tracking. Joint Probability and Graphical Model. Deterministic methods Tracking Algorithms CSED441:Introduction to Computer Vision (2017F) Lecture16: Visual Tracking I Bohyung Han CSE, POSTECH bhhan@postech.ac.kr Deterministic methods Given input video and current state,

More information

Tianfeng Chai1,2,3, Ariel Stein2, and Fong Ngan1,2,3

Tianfeng Chai1,2,3, Ariel Stein2, and Fong Ngan1,2,3 Tianfeng Chai1,2,3, Ariel Stein2, and Fong Ngan1,2,3 1: Cooperative Institute for Climate & Satellites Maryland, USA 2: NOAA, USA 3: University of Maryland, College, Park, MD, USA HYSPLIT model CAPTEX

More information

Probabilistic Graphical Models

Probabilistic Graphical Models Probabilistic Graphical Models Lecture 17 EM CS/CNS/EE 155 Andreas Krause Announcements Project poster session on Thursday Dec 3, 4-6pm in Annenberg 2 nd floor atrium! Easels, poster boards and cookies

More information

MCMC Methods for data modeling

MCMC Methods for data modeling MCMC Methods for data modeling Kenneth Scerri Department of Automatic Control and Systems Engineering Introduction 1. Symposium on Data Modelling 2. Outline: a. Definition and uses of MCMC b. MCMC algorithms

More information

A Sample of Monte Carlo Methods in Robotics and Vision. Credits. Outline. Structure from Motion. without Correspondences

A Sample of Monte Carlo Methods in Robotics and Vision. Credits. Outline. Structure from Motion. without Correspondences A Sample of Monte Carlo Methods in Robotics and Vision Frank Dellaert College of Computing Georgia Institute of Technology Credits Zia Khan Tucker Balch Michael Kaess Rafal Zboinski Ananth Ranganathan

More information

2.5 UAV NAVIGATION BY EXPERT SYSTEM FOR CONTAMINANT MAPPING

2.5 UAV NAVIGATION BY EXPERT SYSTEM FOR CONTAMINANT MAPPING .5 UAV NAVIGATION BY EXPERT SYSTEM FOR CONTAMINANT MAPPING George S. Young *, Yuki Kuroki,, Sue Ellen Haupt The Pennsylvania State University, University Park, Pennsylvania 1. INTRODUCTION The intentional

More information

Inclusion of Aleatory and Epistemic Uncertainty in Design Optimization

Inclusion of Aleatory and Epistemic Uncertainty in Design Optimization 10 th World Congress on Structural and Multidisciplinary Optimization May 19-24, 2013, Orlando, Florida, USA Inclusion of Aleatory and Epistemic Uncertainty in Design Optimization Sirisha Rangavajhala

More information

Ecological Data Assimilation

Ecological Data Assimilation Ecological Data Assimilation The Flux Tower Story Ankur Desai, Atmospheric & Oceanic Sciences, University of Wisconsin-Madison Ameriflux Meeting, October 2007, Boulder, CO The Scene An ecosystem or land-atmosphere

More information

6.4 COUPLED RECEPTOR/DISPERSION MODELING WITH A GENETIC ALGORITHM. Sue Ellen Haupt * The Pennsylvania State University, State College, PA

6.4 COUPLED RECEPTOR/DISPERSION MODELING WITH A GENETIC ALGORITHM. Sue Ellen Haupt * The Pennsylvania State University, State College, PA 6.4 COUPLED RECEPTOR/DISPERSION MODELING WITH A GENETIC ALGORITHM Sue Ellen Haupt * The Pennsylvania State University, State College, PA. INTRODUCTION Coming transport and dispersion model output to monitored

More information

Cambridge A new puff modelling technique for short range dispersion applications. David Thomson & Andrew Jones, July 2007

Cambridge A new puff modelling technique for short range dispersion applications. David Thomson & Andrew Jones, July 2007 A ne puff modelling technique for short range dispersion applications Cambridge 7 David Thomson & Andre Jones, July 7 Cron copyright 7 Page 1 Lagrangian particle models Knoledge of mean flo and statistics

More information

Theoretical Concepts of Machine Learning

Theoretical Concepts of Machine Learning Theoretical Concepts of Machine Learning Part 2 Institute of Bioinformatics Johannes Kepler University, Linz, Austria Outline 1 Introduction 2 Generalization Error 3 Maximum Likelihood 4 Noise Models 5

More information

in:flux - Intelligent CFD Software

in:flux - Intelligent CFD Software in:flux - Intelligent CFD Software info@insightnumerics.com Fire and Gas Mapping. Optimized. Slide 1 Introduction to in:flux in:flux is a CFD software product to be used for dispersion and ventilation

More information

Particle Filters for Visual Tracking

Particle Filters for Visual Tracking Particle Filters for Visual Tracking T. Chateau, Pascal Institute, Clermont-Ferrand 1 Content Particle filtering: a probabilistic framework SIR particle filter MCMC particle filter RJMCMC particle filter

More information

Expectation-Maximization Methods in Population Analysis. Robert J. Bauer, Ph.D. ICON plc.

Expectation-Maximization Methods in Population Analysis. Robert J. Bauer, Ph.D. ICON plc. Expectation-Maximization Methods in Population Analysis Robert J. Bauer, Ph.D. ICON plc. 1 Objective The objective of this tutorial is to briefly describe the statistical basis of Expectation-Maximization

More information

Simulation Calibration with Correlated Knowledge-Gradients

Simulation Calibration with Correlated Knowledge-Gradients Simulation Calibration with Correlated Knowledge-Gradients Peter Frazier Warren Powell Hugo Simão Operations Research & Information Engineering, Cornell University Operations Research & Financial Engineering,

More information

Monte Carlo for Spatial Models

Monte Carlo for Spatial Models Monte Carlo for Spatial Models Murali Haran Department of Statistics Penn State University Penn State Computational Science Lectures April 2007 Spatial Models Lots of scientific questions involve analyzing

More information

Discussion on Bayesian Model Selection and Parameter Estimation in Extragalactic Astronomy by Martin Weinberg

Discussion on Bayesian Model Selection and Parameter Estimation in Extragalactic Astronomy by Martin Weinberg Discussion on Bayesian Model Selection and Parameter Estimation in Extragalactic Astronomy by Martin Weinberg Phil Gregory Physics and Astronomy Univ. of British Columbia Introduction Martin Weinberg reported

More information

REAL TIME FOLLOWUP OF LEAKS AND DISPERSION ACCIDENTS

REAL TIME FOLLOWUP OF LEAKS AND DISPERSION ACCIDENTS REAL TIME FOLLOWUP OF LEAKS AND DISPERSION ACCIDENTS Sharad Tripathi, Lobnat Ait Hamou, Malo Leguellec and Claude Souprayen Fluidyn Most of the hazards occurring on a petrochemical onshore platform have

More information

Monte Carlo Method for Solving Inverse Problems of Radiation Transfer

Monte Carlo Method for Solving Inverse Problems of Radiation Transfer INVERSE AND ILL-POSED PROBLEMS SERIES Monte Carlo Method for Solving Inverse Problems of Radiation Transfer V.S.Antyufeev. ///VSP/// UTRECHT BOSTON KÖLN TOKYO 2000 Contents Chapter 1. Monte Carlo modifications

More information

A Heuristic Robust Approach for Real Estate Valuation in Areas with Few Transactions

A Heuristic Robust Approach for Real Estate Valuation in Areas with Few Transactions Presented at the FIG Working Week 2017, A Heuristic Robust Approach for Real Estate Valuation in May 29 - June 2, 2017 in Helsinki, Finland FIG Working Week 2017 Surveying the world of tomorrow From digitalisation

More information

1.2 VALIDATION OF RECEPTOR/DISPERSION MODEL COUPLED WITH A GENETIC ALGORITHM

1.2 VALIDATION OF RECEPTOR/DISPERSION MODEL COUPLED WITH A GENETIC ALGORITHM 1. VALIDATION OF RECEPTOR/DISPERSION MODEL COUPLED WITH A GENETIC ALGORITHM Sue Ellen Haupt * George S. Young The Pennsylvania State University, State College, PA 1. INTRODUCTION Air pollution models can

More information

Discovery of the Source of Contaminant Release

Discovery of the Source of Contaminant Release Discovery of the Source of Contaminant Release Devina Sanjaya 1 Henry Qin Introduction Computer ability to model contaminant release events and predict the source of release in real time is crucial in

More information

Module 4: Fluid Dynamics Lecture 9: Lagrangian and Eulerian approaches; Euler's acceleration formula. Fluid Dynamics: description of fluid-motion

Module 4: Fluid Dynamics Lecture 9: Lagrangian and Eulerian approaches; Euler's acceleration formula. Fluid Dynamics: description of fluid-motion Fluid Dynamics: description of fluid-motion Lagrangian approach Eulerian approach (a field approach) file:///d /Web%20Course/Dr.%20Nishith%20Verma/local%20server/fluid_mechanics/lecture9/9_1.htm[5/9/2012

More information

Analysis of Survival Times Using Bayesian Networks

Analysis of Survival Times Using Bayesian Networks Analysis of Survival Times Using Bayesian Networks Helge Langseth Presented at ESREL 98 Trondheim, Norway, 16-19 June 1998 Two types of statistical models Neyman categorises statistical models into two

More information

Overview. EECS 124, UC Berkeley, Spring 2008 Lecture 23: Localization and Mapping. Statistical Models

Overview. EECS 124, UC Berkeley, Spring 2008 Lecture 23: Localization and Mapping. Statistical Models Introduction ti to Embedded dsystems EECS 124, UC Berkeley, Spring 2008 Lecture 23: Localization and Mapping Gabe Hoffmann Ph.D. Candidate, Aero/Astro Engineering Stanford University Statistical Models

More information

March 19, Heuristics for Optimization. Outline. Problem formulation. Genetic algorithms

March 19, Heuristics for Optimization. Outline. Problem formulation. Genetic algorithms Olga Galinina olga.galinina@tut.fi ELT-53656 Network Analysis and Dimensioning II Department of Electronics and Communications Engineering Tampere University of Technology, Tampere, Finland March 19, 2014

More information

HYSPLIT model description and operational set up for benchmark case study

HYSPLIT model description and operational set up for benchmark case study HYSPLIT model description and operational set up for benchmark case study Barbara Stunder and Roland Draxler NOAA Air Resources Laboratory Silver Spring, MD, USA Workshop on Ash Dispersal Forecast and

More information

Simulation Calibration with Correlated Knowledge-Gradients

Simulation Calibration with Correlated Knowledge-Gradients Simulation Calibration with Correlated Knowledge-Gradients Peter Frazier Warren Powell Hugo Simão Operations Research & Information Engineering, Cornell University Operations Research & Financial Engineering,

More information

Conditional Random Fields and beyond D A N I E L K H A S H A B I C S U I U C,

Conditional Random Fields and beyond D A N I E L K H A S H A B I C S U I U C, Conditional Random Fields and beyond D A N I E L K H A S H A B I C S 5 4 6 U I U C, 2 0 1 3 Outline Modeling Inference Training Applications Outline Modeling Problem definition Discriminative vs. Generative

More information

LEScape Vaarallisen päästölähteen nopea paikantaminen ja vaikutusalueen määrittäminen kaupunkiympäristössä

LEScape Vaarallisen päästölähteen nopea paikantaminen ja vaikutusalueen määrittäminen kaupunkiympäristössä LEScape Vaarallisen päästölähteen nopea paikantaminen ja vaikutusalueen määrittäminen kaupunkiympäristössä MATINE TUTKIMUSSEMINAARI 16.11.2017 Antti Hellsten, Hanna Hannuniemi, Mia Aarnio, Mikko Auvinen

More information

Computer vision: models, learning and inference. Chapter 10 Graphical Models

Computer vision: models, learning and inference. Chapter 10 Graphical Models Computer vision: models, learning and inference Chapter 10 Graphical Models Independence Two variables x 1 and x 2 are independent if their joint probability distribution factorizes as Pr(x 1, x 2 )=Pr(x

More information

Introduction to Polyphemus (translated from French) Vivien Mallet, for the development team. 27 March Polyphemus Training Day. V. Mallet.

Introduction to Polyphemus (translated from French) Vivien Mallet, for the development team. 27 March Polyphemus Training Day. V. Mallet. Introduction to (translated from French) Vivien Mallet, for the team 27 March 2007 Outline 1 2 3 4 Images Greek Mythology, cyclops in Odyssey Why this name? «Poly» : multiple «phemus» : speech Multiple

More information

Unified Model Intercomparisons for Volcanic Ash Transport Modeling

Unified Model Intercomparisons for Volcanic Ash Transport Modeling Unified Model Intercomparisons for Volcanic Ash Transport Modeling Don Morton 1, Dèlia Arnold 2, Peter Webley 3, Gerhard Wotawa 2, Barbara Stunder 4 1 Arctic Region Supercomputing Center, University of

More information

Screen3 View. Contents. Page 1

Screen3 View. Contents. Page 1 Screen3 View Contents Introduction What is EPA's SCREEN3 Model? What is the Screen3 View Interface? Toollbar Buttons Preliminary Considerations Source Inputs Screen3 Options Running SCREEN3 Model Graphic

More information

Probabilistic Robotics

Probabilistic Robotics Probabilistic Robotics Bayes Filter Implementations Discrete filters, Particle filters Piecewise Constant Representation of belief 2 Discrete Bayes Filter Algorithm 1. Algorithm Discrete_Bayes_filter(

More information

Monte Carlo Localization using Dynamically Expanding Occupancy Grids. Karan M. Gupta

Monte Carlo Localization using Dynamically Expanding Occupancy Grids. Karan M. Gupta 1 Monte Carlo Localization using Dynamically Expanding Occupancy Grids Karan M. Gupta Agenda Introduction Occupancy Grids Sonar Sensor Model Dynamically Expanding Occupancy Grids Monte Carlo Localization

More information

Bayesian Statistics Group 8th March Slice samplers. (A very brief introduction) The basic idea

Bayesian Statistics Group 8th March Slice samplers. (A very brief introduction) The basic idea Bayesian Statistics Group 8th March 2000 Slice samplers (A very brief introduction) The basic idea lacements To sample from a distribution, simply sample uniformly from the region under the density function

More information

Statistical Modeling with Spline Functions Methodology and Theory

Statistical Modeling with Spline Functions Methodology and Theory This is page 1 Printer: Opaque this Statistical Modeling with Spline Functions Methodology and Theory Mark H. Hansen University of California at Los Angeles Jianhua Z. Huang University of Pennsylvania

More information

Hierarchical Bayesian Modeling with Ensemble MCMC. Eric B. Ford (Penn State) Bayesian Computing for Astronomical Data Analysis June 12, 2014

Hierarchical Bayesian Modeling with Ensemble MCMC. Eric B. Ford (Penn State) Bayesian Computing for Astronomical Data Analysis June 12, 2014 Hierarchical Bayesian Modeling with Ensemble MCMC Eric B. Ford (Penn State) Bayesian Computing for Astronomical Data Analysis June 12, 2014 Simple Markov Chain Monte Carlo Initialise chain with θ 0 (initial

More information

Markov Chain Monte Carlo (part 1)

Markov Chain Monte Carlo (part 1) Markov Chain Monte Carlo (part 1) Edps 590BAY Carolyn J. Anderson Department of Educational Psychology c Board of Trustees, University of Illinois Spring 2018 Depending on the book that you select for

More information

GENETIC ALGORITHM with Hands-On exercise

GENETIC ALGORITHM with Hands-On exercise GENETIC ALGORITHM with Hands-On exercise Adopted From Lecture by Michael Negnevitsky, Electrical Engineering & Computer Science University of Tasmania 1 Objective To understand the processes ie. GAs Basic

More information

Christopher T. Allen *, Sue Ellen Haupt, George S. Young The Pennsylvania State University, University Park, PA

Christopher T. Allen *, Sue Ellen Haupt, George S. Young The Pennsylvania State University, University Park, PA 4. APPLICATION OF A GENETIC ALGORITH-COUPLED RECEPTOR/DISPERSION ODEL TO THE DIPOLE PRIDE 6 EXPERIENTS Christopher T. Allen *, Sue Ellen Haupt, George S. Young The Pennsylvania State University, University

More information

Validation of the Safety Lagrangian Atmospheric Model (SLAM) against a wind tunnel experiment over an industrial complex area

Validation of the Safety Lagrangian Atmospheric Model (SLAM) against a wind tunnel experiment over an industrial complex area Validation of the Safety Lagrangian Atmospheric Model (SLAM) against a wind tunnel experiment over an industrial complex area Florian Vendel 1, Lionel Soulhac 2, Patrick Méjean 2, Ludovic Donnat 3 and

More information

Clustering Relational Data using the Infinite Relational Model

Clustering Relational Data using the Infinite Relational Model Clustering Relational Data using the Infinite Relational Model Ana Daglis Supervised by: Matthew Ludkin September 4, 2015 Ana Daglis Clustering Data using the Infinite Relational Model September 4, 2015

More information

Field Verification of Oil Spill Fate & Transport Modeling and Linking CODAR Observation System Data with SIMAP Predictions

Field Verification of Oil Spill Fate & Transport Modeling and Linking CODAR Observation System Data with SIMAP Predictions Field Verification of Oil Spill Fate & Transport Modeling and Linking CODAR Observation System Data with SIMAP Predictions James R. Payne, Ph.D. Payne Environmental Consultants, Inc. Deborah French-McCay,

More information

Practical Course WS12/13 Introduction to Monte Carlo Localization

Practical Course WS12/13 Introduction to Monte Carlo Localization Practical Course WS12/13 Introduction to Monte Carlo Localization Cyrill Stachniss and Luciano Spinello 1 State Estimation Estimate the state of a system given observations and controls Goal: 2 Bayes Filter

More information

Linear Modeling with Bayesian Statistics

Linear Modeling with Bayesian Statistics Linear Modeling with Bayesian Statistics Bayesian Approach I I I I I Estimate probability of a parameter State degree of believe in specific parameter values Evaluate probability of hypothesis given the

More information

A Short History of Markov Chain Monte Carlo

A Short History of Markov Chain Monte Carlo A Short History of Markov Chain Monte Carlo Christian Robert and George Casella 2010 Introduction Lack of computing machinery, or background on Markov chains, or hesitation to trust in the practicality

More information

STAT 598L Learning Bayesian Network Structure

STAT 598L Learning Bayesian Network Structure STAT 598L Learning Bayesian Network Structure Sergey Kirshner Department of Statistics Purdue University skirshne@purdue.edu November 2, 2009 Acknowledgements: some of the slides were based on Luo Si s

More information

Probabilistic Robotics

Probabilistic Robotics Probabilistic Robotics Discrete Filters and Particle Filters Models Some slides adopted from: Wolfram Burgard, Cyrill Stachniss, Maren Bennewitz, Kai Arras and Probabilistic Robotics Book SA-1 Probabilistic

More information

Metropolis Light Transport

Metropolis Light Transport Metropolis Light Transport CS295, Spring 2017 Shuang Zhao Computer Science Department University of California, Irvine CS295, Spring 2017 Shuang Zhao 1 Announcements Final presentation June 13 (Tuesday)

More information

Applied Bayesian Nonparametrics 5. Spatial Models via Gaussian Processes, not MRFs Tutorial at CVPR 2012 Erik Sudderth Brown University

Applied Bayesian Nonparametrics 5. Spatial Models via Gaussian Processes, not MRFs Tutorial at CVPR 2012 Erik Sudderth Brown University Applied Bayesian Nonparametrics 5. Spatial Models via Gaussian Processes, not MRFs Tutorial at CVPR 2012 Erik Sudderth Brown University NIPS 2008: E. Sudderth & M. Jordan, Shared Segmentation of Natural

More information

Conditional Random Fields - A probabilistic graphical model. Yen-Chin Lee 指導老師 : 鮑興國

Conditional Random Fields - A probabilistic graphical model. Yen-Chin Lee 指導老師 : 鮑興國 Conditional Random Fields - A probabilistic graphical model Yen-Chin Lee 指導老師 : 鮑興國 Outline Labeling sequence data problem Introduction conditional random field (CRF) Different views on building a conditional

More information

Bayesian Networks. A Bayesian network is a directed acyclic graph that represents causal relationships between random variables. Earthquake.

Bayesian Networks. A Bayesian network is a directed acyclic graph that represents causal relationships between random variables. Earthquake. Bayes Nets Independence With joint probability distributions we can compute many useful things, but working with joint PD's is often intractable. The naïve Bayes' approach represents one (boneheaded?)

More information

Localization, Mapping and Exploration with Multiple Robots. Dr. Daisy Tang

Localization, Mapping and Exploration with Multiple Robots. Dr. Daisy Tang Localization, Mapping and Exploration with Multiple Robots Dr. Daisy Tang Two Presentations A real-time algorithm for mobile robot mapping with applications to multi-robot and 3D mapping, by Thrun, Burgard

More information

10703 Deep Reinforcement Learning and Control

10703 Deep Reinforcement Learning and Control 10703 Deep Reinforcement Learning and Control Russ Salakhutdinov Machine Learning Department rsalakhu@cs.cmu.edu Policy Gradient I Used Materials Disclaimer: Much of the material and slides for this lecture

More information

Computer Vision. Exercise Session 10 Image Categorization

Computer Vision. Exercise Session 10 Image Categorization Computer Vision Exercise Session 10 Image Categorization Object Categorization Task Description Given a small number of training images of a category, recognize a-priori unknown instances of that category

More information

Overview. Monte Carlo Methods. Statistics & Bayesian Inference Lecture 3. Situation At End Of Last Week

Overview. Monte Carlo Methods. Statistics & Bayesian Inference Lecture 3. Situation At End Of Last Week Statistics & Bayesian Inference Lecture 3 Joe Zuntz Overview Overview & Motivation Metropolis Hastings Monte Carlo Methods Importance sampling Direct sampling Gibbs sampling Monte-Carlo Markov Chains Emcee

More information

v Prerequisite Tutorials Required Components Time

v Prerequisite Tutorials Required Components Time v. 10.0 GMS 10.0 Tutorial MODFLOW Stochastic Modeling, Parameter Randomization Run MODFLOW in Stochastic (Monte Carlo) Mode by Randomly Varying Parameters Objectives Learn how to develop a stochastic (Monte

More information

TerraSwarm. A Machine Learning and Op0miza0on Toolkit for the Swarm. Ilge Akkaya, Shuhei Emoto, Edward A. Lee. University of California, Berkeley

TerraSwarm. A Machine Learning and Op0miza0on Toolkit for the Swarm. Ilge Akkaya, Shuhei Emoto, Edward A. Lee. University of California, Berkeley TerraSwarm A Machine Learning and Op0miza0on Toolkit for the Swarm Ilge Akkaya, Shuhei Emoto, Edward A. Lee University of California, Berkeley TerraSwarm Tools Telecon 17 November 2014 Sponsored by the

More information

Approximate Bayesian Computation. Alireza Shafaei - April 2016

Approximate Bayesian Computation. Alireza Shafaei - April 2016 Approximate Bayesian Computation Alireza Shafaei - April 2016 The Problem Given a dataset, we are interested in. The Problem Given a dataset, we are interested in. The Problem Given a dataset, we are interested

More information

Reddit Recommendation System Daniel Poon, Yu Wu, David (Qifan) Zhang CS229, Stanford University December 11 th, 2011

Reddit Recommendation System Daniel Poon, Yu Wu, David (Qifan) Zhang CS229, Stanford University December 11 th, 2011 Reddit Recommendation System Daniel Poon, Yu Wu, David (Qifan) Zhang CS229, Stanford University December 11 th, 2011 1. Introduction Reddit is one of the most popular online social news websites with millions

More information

Sampling informative/complex a priori probability distributions using Gibbs sampling assisted by sequential simulation

Sampling informative/complex a priori probability distributions using Gibbs sampling assisted by sequential simulation Sampling informative/complex a priori probability distributions using Gibbs sampling assisted by sequential simulation Thomas Mejer Hansen, Klaus Mosegaard, and Knud Skou Cordua 1 1 Center for Energy Resources

More information

The Continuous Genetic Algorithm. Universidad de los Andes-CODENSA

The Continuous Genetic Algorithm. Universidad de los Andes-CODENSA The Continuous Genetic Algorithm Universidad de los Andes-CODENSA 1. Components of a Continuous Genetic Algorithm The flowchart in figure1 provides a big picture overview of a continuous GA.. Figure 1.

More information

Neural Network Weight Selection Using Genetic Algorithms

Neural Network Weight Selection Using Genetic Algorithms Neural Network Weight Selection Using Genetic Algorithms David Montana presented by: Carl Fink, Hongyi Chen, Jack Cheng, Xinglong Li, Bruce Lin, Chongjie Zhang April 12, 2005 1 Neural Networks Neural networks

More information

Quantifying the Dynamic Ocean Surface Using Underwater Radiometric Measurement

Quantifying the Dynamic Ocean Surface Using Underwater Radiometric Measurement DISTRIBUTION STATEMENT A. Approved for public release; distribution is unlimited. Quantifying the Dynamic Ocean Surface Using Underwater Radiometric Measurement Lian Shen Department of Mechanical Engineering

More information

Data Mining Chapter 8: Search and Optimization Methods Fall 2011 Ming Li Department of Computer Science and Technology Nanjing University

Data Mining Chapter 8: Search and Optimization Methods Fall 2011 Ming Li Department of Computer Science and Technology Nanjing University Data Mining Chapter 8: Search and Optimization Methods Fall 2011 Ming Li Department of Computer Science and Technology Nanjing University Search & Optimization Search and Optimization method deals with

More information

Parameter Calibration Using Data Assimilation for Simulations of Forest Fire Spread

Parameter Calibration Using Data Assimilation for Simulations of Forest Fire Spread Supervisor: Sophie Ricci Supervisor: Arnaud Trouvé Parameter Calibration Using Data Assimilation for Simulations of Forest Fire Spread Blaise DELMOTTE CERFACS, September 1 13, 2011 Outline 2 I. Context

More information

Localization and Map Building

Localization and Map Building Localization and Map Building Noise and aliasing; odometric position estimation To localize or not to localize Belief representation Map representation Probabilistic map-based localization Other examples

More information

Empirical Bayesian Motion Segmentation

Empirical Bayesian Motion Segmentation 1 Empirical Bayesian Motion Segmentation Nuno Vasconcelos, Andrew Lippman Abstract We introduce an empirical Bayesian procedure for the simultaneous segmentation of an observed motion field estimation

More information

NOVEL HYBRID GENETIC ALGORITHM WITH HMM BASED IRIS RECOGNITION

NOVEL HYBRID GENETIC ALGORITHM WITH HMM BASED IRIS RECOGNITION NOVEL HYBRID GENETIC ALGORITHM WITH HMM BASED IRIS RECOGNITION * Prof. Dr. Ban Ahmed Mitras ** Ammar Saad Abdul-Jabbar * Dept. of Operation Research & Intelligent Techniques ** Dept. of Mathematics. College

More information

Multi-Mesh CFD. Chris Roy Chip Jackson (1 st year PhD student) Aerospace and Ocean Engineering Department Virginia Tech

Multi-Mesh CFD. Chris Roy Chip Jackson (1 st year PhD student) Aerospace and Ocean Engineering Department Virginia Tech Multi-Mesh CFD Chris Roy Chip Jackson (1 st year PhD student) Aerospace and Ocean Engineering Department Virginia Tech cjroy@vt.edu May 21, 2014 CCAS Program Review, Columbus, OH 1 Motivation Automated

More information

Introduction to Mobile Robotics Bayes Filter Particle Filter and Monte Carlo Localization. Wolfram Burgard

Introduction to Mobile Robotics Bayes Filter Particle Filter and Monte Carlo Localization. Wolfram Burgard Introduction to Mobile Robotics Bayes Filter Particle Filter and Monte Carlo Localization Wolfram Burgard 1 Motivation Recall: Discrete filter Discretize the continuous state space High memory complexity

More information

Bayesian Methods. David Rosenberg. April 11, New York University. David Rosenberg (New York University) DS-GA 1003 April 11, / 19

Bayesian Methods. David Rosenberg. April 11, New York University. David Rosenberg (New York University) DS-GA 1003 April 11, / 19 Bayesian Methods David Rosenberg New York University April 11, 2017 David Rosenberg (New York University) DS-GA 1003 April 11, 2017 1 / 19 Classical Statistics Classical Statistics David Rosenberg (New

More information

DYNAMIC DATA DRIVEN EVENT RECONSTRUCTION FOR TRAFFIC SIMULATION USING SEQUENTIAL MONTE CARLO METHODS. Xiaolin Hu Carl Engstrom

DYNAMIC DATA DRIVEN EVENT RECONSTRUCTION FOR TRAFFIC SIMULATION USING SEQUENTIAL MONTE CARLO METHODS. Xiaolin Hu Carl Engstrom Proceedings of the 2013 Winter Simulation Conference R. Pasupathy, S.-H. Kim, A. Tolk, R. Hill, and M. E. Kuhl, eds DYNAMIC DATA DRIVEN EVENT RECONSTRUCTION FOR TRAFFIC SIMULATION USING SEQUENTIAL MONTE

More information

Where s the Boss? : Monte Carlo Localization for an Autonomous Ground Vehicle using an Aerial Lidar Map

Where s the Boss? : Monte Carlo Localization for an Autonomous Ground Vehicle using an Aerial Lidar Map Where s the Boss? : Monte Carlo Localization for an Autonomous Ground Vehicle using an Aerial Lidar Map Sebastian Scherer, Young-Woo Seo, and Prasanna Velagapudi October 16, 2007 Robotics Institute Carnegie

More information

3-D Tomographic Reconstruction

3-D Tomographic Reconstruction Mitglied der Helmholtz-Gemeinschaft 3-D Tomographic Reconstruction of Atmospheric Trace Gas Concentrations for Infrared Limb-Imagers February 21, 2011, Nanocenter, USC Jörn Ungermann Tomographic trace

More information

Bayesian Segmentation and Motion Estimation in Video Sequences using a Markov-Potts Model

Bayesian Segmentation and Motion Estimation in Video Sequences using a Markov-Potts Model Bayesian Segmentation and Motion Estimation in Video Sequences using a Markov-Potts Model Patrice BRAULT and Ali MOHAMMAD-DJAFARI LSS, Laboratoire des Signaux et Systemes, CNRS UMR 8506, Supelec, Plateau

More information

Topology Inference from Co-Occurrence Observations. Laura Balzano and Rob Nowak with Michael Rabbat and Matthew Roughan

Topology Inference from Co-Occurrence Observations. Laura Balzano and Rob Nowak with Michael Rabbat and Matthew Roughan Topology Inference from Co-Occurrence Observations Laura Balzano and Rob Nowak with Michael Rabbat and Matthew Roughan Co-Occurrence observations Co-Occurrence observations Network Inference for Co- Occurrences

More information

Mixture Models and the EM Algorithm

Mixture Models and the EM Algorithm Mixture Models and the EM Algorithm Padhraic Smyth, Department of Computer Science University of California, Irvine c 2017 1 Finite Mixture Models Say we have a data set D = {x 1,..., x N } where x i is

More information

APPLICATION OF SOFTMAX REGRESSION AND ITS VALIDATION FOR SPECTRAL-BASED LAND COVER MAPPING

APPLICATION OF SOFTMAX REGRESSION AND ITS VALIDATION FOR SPECTRAL-BASED LAND COVER MAPPING APPLICATION OF SOFTMAX REGRESSION AND ITS VALIDATION FOR SPECTRAL-BASED LAND COVER MAPPING J. Wolfe a, X. Jin a, T. Bahr b, N. Holzer b, * a Harris Corporation, Broomfield, Colorado, U.S.A. (jwolfe05,

More information

CS281 Section 9: Graph Models and Practical MCMC

CS281 Section 9: Graph Models and Practical MCMC CS281 Section 9: Graph Models and Practical MCMC Scott Linderman November 11, 213 Now that we have a few MCMC inference algorithms in our toolbox, let s try them out on some random graph models. Graphs

More information

Combination of feature-based and geometric methods for positioning

Combination of feature-based and geometric methods for positioning Combination of feature-based and geometric methods for positioning Stefan Niedermayr, Andreas Wieser Institute of Geodesy and Geophysics 3 rd International Conference on Machine Control & Guidance, March

More information

Hidden Markov Models in the context of genetic analysis

Hidden Markov Models in the context of genetic analysis Hidden Markov Models in the context of genetic analysis Vincent Plagnol UCL Genetics Institute November 22, 2012 Outline 1 Introduction 2 Two basic problems Forward/backward Baum-Welch algorithm Viterbi

More information

Probability and Statistics for Final Year Engineering Students

Probability and Statistics for Final Year Engineering Students Probability and Statistics for Final Year Engineering Students By Yoni Nazarathy, Last Updated: April 11, 2011. Lecture 1: Introduction and Basic Terms Welcome to the course, time table, assessment, etc..

More information

Introduction to Genetic Algorithms

Introduction to Genetic Algorithms Advanced Topics in Image Analysis and Machine Learning Introduction to Genetic Algorithms Week 3 Faculty of Information Science and Engineering Ritsumeikan University Today s class outline Genetic Algorithms

More information

v MODFLOW Stochastic Modeling, Parameter Randomization GMS 10.3 Tutorial

v MODFLOW Stochastic Modeling, Parameter Randomization GMS 10.3 Tutorial v. 10.3 GMS 10.3 Tutorial MODFLOW Stochastic Modeling, Parameter Randomization Run MODFLOW in Stochastic (Monte Carlo) Mode by Randomly Varying Parameters Objectives Learn how to develop a stochastic (Monte

More information

Robotics. Lecture 5: Monte Carlo Localisation. See course website for up to date information.

Robotics. Lecture 5: Monte Carlo Localisation. See course website  for up to date information. Robotics Lecture 5: Monte Carlo Localisation See course website http://www.doc.ic.ac.uk/~ajd/robotics/ for up to date information. Andrew Davison Department of Computing Imperial College London Review:

More information

Distribution Unlimited Report ADVANCEMENTS OF PARTICLE FILTERING THEORY AND ITS APPLICATION TO TRACKING

Distribution Unlimited Report ADVANCEMENTS OF PARTICLE FILTERING THEORY AND ITS APPLICATION TO TRACKING ... eapproved MSD T;flIB1UT!1ON STATF-ý7M~T A for Public Release y,.,. Unlimited Distribution Unlimited 2005-2006 Report ADVANCEMENTS OF PARTICLE FILTERING THEORY AND ITS APPLICATION TO TRACKING Petar

More information

Probabilistic Robotics

Probabilistic Robotics Probabilistic Robotics Sebastian Thrun Wolfram Burgard Dieter Fox The MIT Press Cambridge, Massachusetts London, England Preface xvii Acknowledgments xix I Basics 1 1 Introduction 3 1.1 Uncertainty in

More information