A spatio-temporal model for extreme precipitation simulated by a climate model.

Size: px
Start display at page:

Download "A spatio-temporal model for extreme precipitation simulated by a climate model."

Transcription

1 A spatio-temporal model for extreme precipitation simulated by a climate model. Jonathan Jalbert Joint work with Anne-Catherine Favre, Claude Bélisle and Jean-François Angers STATMOS Workshop: Climate and Weather Extremes October 25 th, 2016 Pennsylvania State University, USA.

2 Introduction Jalbert et al. A spatio-temporal model for extreme precipitation simulated by a climate model 2016/10/25 2 / 30

3 Goal With climate, in situ experimentations are impossible. Climate models are therefore the only tools for providing quantitative predictions of the coming climate. The goal of the talk is to present a spatio-temporal statistical model especially suited for extreme precipitation simulated by a climate model. More specifically, the statistical model takes into account non-stationarity in transient time series; large spatial simulation domain; spatial dependence among grid points. Jalbert et al. A spatio-temporal model for extreme precipitation simulated by a climate model 2016/10/25 3 / 30

4 Data The dataset consists in the daily precipitation outputs from a run of the Canadian Regional Climate Model (CRCM). The data were simulated and provided by 12,570 land grid points; Daily precipitation series for the period [1961, 2100] at every grid point. Let Y ikl be the precipitation depth (mm) of day l of year k at grid point i, where 1 i 12, 570; 1 k 140; 1 l 365. Simulation domain Jalbert et al. A spatio-temporal model for extreme precipitation simulated by a climate model 2016/10/25 4 / 30

5 Non-Stationarity Jalbert et al. A spatio-temporal model for extreme precipitation simulated by a climate model 2016/10/25 5 / 30

6 Non-stationarity in the maxima series Let M ik be the annual maximum of year k at grid point i: M ik = max 1 l 365 Y ikl. Let M i be the annual maxima series at grid point i: M i = (M ik : 1 k 140). For 2/3 of the grid points, the series of maxima M i exhibits temporal non-stationarity (the grid points in red in the following figure). Jalbert et al. A spatio-temporal model for extreme precipitation simulated by a climate model 2016/10/25 6 / 30

7 Non-stationarity in the maxima series Let M ik be the annual maximum of year k at grid point i: M ik = max 1 l 365 Y ikl. Let M i be the annual maxima series at grid point i: M i = (M ik : 1 k 140). For 2/3 of the grid points, the series of maxima M i exhibits temporal non-stationarity (the grid points in red in the following figure). Pointwise Mann-Kendall stationarity test (α = 5%) Jalbert et al. A spatio-temporal model for extreme precipitation simulated by a climate model 2016/10/25 6 / 30

8 Maxima series - Montreal Maximum (mm) Year Jalbert et al. A spatio-temporal model for extreme precipitation simulated by a climate model 2016/10/25 7 / 30

9 Introduction Non-Stationarity Spatial modeling Results Conclusion Daily series - Montreal 100 Precipitation (mm) Year Jalbert et al. A spatio-temporal model for extreme precipitation simulated by a climate model 2016/10/25 8 / 30

10 Introduction Non-Stationarity Spatial modeling Results Conclusion Exceedances - Montreal 100 Precipitation (mm) Year Jalbert et al. A spatio-temporal model for extreme precipitation simulated by a climate model 2016/10/25 9 / 30

11 Preprocessing approach Suppose that there exist sequences of constants ν ik and τ ik such that ( M ik = M ) ik ν ik : 1 k 140 ; (1) τ ik can be assumed identically distributed along index k for each grid point i. Therefore, the distribution of a given transformed maximum can be approximated by M ik L GEV (µ i, σ i, ξ i ). (2) The trend in the tail should be isolated from the trend in the bulk of the distribution. Jalbert et al. A spatio-temporal model for extreme precipitation simulated by a climate model 2016/10/25 10 / 30

12 Preprocessing approach Suppose that there exist sequences of constants ν ik and τ ik such that ( M ik = M ) ik ν ik : 1 k 140 ; (1) τ ik can be assumed identically distributed along index k for each grid point i. Therefore, the distribution of a given transformed maximum can be approximated by M ik L GEV (µ i, σ i, ξ i ). (2) The trend in the tail should be isolated from the trend in the bulk of the distribution. Jalbert et al. A spatio-temporal model for extreme precipitation simulated by a climate model 2016/10/25 10 / 30

13 Introduction Non-Stationarity Spatial modeling Results Conclusion Preprocessing approach Let Zik be the vector of precipitation exceedences over the threshold ui of year k at grid point i: 100 and let Precipitation (mm) 80 Zik = (Yikl : Yikl > ui, 1 l 140) ; νik = E(Zik ) and τik2 = Var (Zik ) Year The threshold has to be chosen in order that the transformation: Mik0 = Mik νik ; τik (3) removes the trend in the maxima series Mi0. Its definition does not rely on asymptotic convergence requirements as in the Peaks-Over-Threshold model. Jalbert et al. A spatio-temporal model for extreme precipitation simulated by a climate model 2016/10/25 11 / 30

14 Introduction Non-Stationarity Spatial modeling Results Conclusion Preprocessing approach Let Zik be the vector of precipitation exceedences over the threshold ui of year k at grid point i: 100 and let Precipitation (mm) 80 Zik = (Yikl : Yikl > ui, 1 l 140) ; νik = E(Zik ) and τik2 = Var (Zik ) Year The threshold has to be chosen in order that the transformation: Mik0 = Mik νik ; τik (3) removes the trend in the maxima series Mi0. Its definition does not rely on asymptotic convergence requirements as in the Peaks-Over-Threshold model. Jalbert et al. A spatio-temporal model for extreme precipitation simulated by a climate model 2016/10/25 11 / 30

15 Preprocessed maxima series - Montreal Maximum (mm) p < Standardized Maximum Year Jalbert et al. A spatio-temporal model for extreme precipitation simulated by a climate model 2016/10/25 12 / 30

16 Preprocessed maxima series - Montreal Maximum (mm) Standardized Maximum Year Jalbert et al. A spatio-temporal model for extreme precipitation simulated by a climate model 2016/10/25 12 / 30

17 Preprocessed maxima series - Montreal 1 20 p =0.22 Maximum (mm) Standardized Maximum Year Jalbert et al. A spatio-temporal model for extreme precipitation simulated by a climate model 2016/10/25 12 / 30

18 Threshold choice We chose the 80th empirical quantiles at each grid point as the thresholds. Then, the stationarity hypothesis of the preprocessed maxima series was rejected for only 1.5% of the grid points (the grid points in red in the following figure). Pointwise Mann-Kendall stationarity test (α = 5%) for the preprocessed maxima series Jalbert et al. A spatio-temporal model for extreme precipitation simulated by a climate model 2016/10/25 13 / 30

19 Preprocessing approach Benefits of the proposed preprocessing approach are: if there exist constants a ik > 0 and b ik such that M ik b ik a ik L GEV (0, 1, ξi ); then there exists constants a ik > 0 and b ik such that M ik b ik a ik L GEV (0, 1, ξ i ). The model for the untransformed maxima is tractable: M ik L GEV (τik µ i + ν ik, τ ik σ i, ξ i ). (4) Jalbert et al. A spatio-temporal model for extreme precipitation simulated by a climate model 2016/10/25 14 / 30

20 Preprocessing approach Benefits of the proposed preprocessing approach are: if there exist constants a ik > 0 and b ik such that M ik b ik a ik L GEV (0, 1, ξi ); then there exists constants a ik > 0 and b ik such that M ik b ik a ik L GEV (0, 1, ξ i ). The model for the untransformed maxima is tractable: M ik L GEV (τik µ i + ν ik, τ ik σ i, ξ i ). (4) Jalbert et al. A spatio-temporal model for extreme precipitation simulated by a climate model 2016/10/25 14 / 30

21 Spatial modeling Jalbert et al. A spatio-temporal model for extreme precipitation simulated by a climate model 2016/10/25 15 / 30

22 Spatial dependence structure Following the idea of Cooley & Sain (2010) and Reich & Shaby (2012), the spatial dependence is taken into account by modeling spatial variation in the GEV parameters mainly for two reasons: such a latent variable approach is very flexible; the local properties of extremal distributions (such as return levels) are well reproduced (Davison et al., 2012; Sebille et al., 2016). However such an approach can neither model nor predict an event occurring simultaneously at several grid points. Jalbert et al. A spatio-temporal model for extreme precipitation simulated by a climate model 2016/10/25 16 / 30

23 Spatial latent model Local estimates of the GEV location parameter. Local parameter estimates could definitely benefit from neighboring site values. Jalbert et al. A spatio-temporal model for extreme precipitation simulated by a climate model 2016/10/25 17 / 30

24 Spatial latent model Local estimates of the GEV scale parameter. Local parameter estimates could definitely benefit from neighboring site values. Jalbert et al. A spatio-temporal model for extreme precipitation simulated by a climate model 2016/10/25 17 / 30

25 Spatial latent model Local estimates of the GEV shape parameter. Local parameter estimates could definitely benefit from neighboring site values. Jalbert et al. A spatio-temporal model for extreme precipitation simulated by a climate model 2016/10/25 17 / 30

26 Spatial latent model Because the random variables lie on a regular lattice, Gaussian Markov random fields are well appropriate. Such a field inherits the Markov property. For the GEV location parameter, we have: µ i f [µi µ i =µ i ](µ i ) = f [µi µ δi =µ δi ](µ i ); where δ i is the set of neighbors of grid point i. The precision matrix Q of the joint distribution of µ is sparse because of the important following simplification: µ i µ j µ i, j q ij = 0; (5) where q ij is the element (i, j) of the precision matrix Q. Jalbert et al. A spatio-temporal model for extreme precipitation simulated by a climate model 2016/10/25 18 / 30

27 Spatial latent model Because the random variables lie on a regular lattice, Gaussian Markov random fields are well appropriate. Such a field inherits the Markov property. For the GEV location parameter, we have: µ i f [µi µ i =µ i ](µ i ) = f [µi µ δi =µ δi ](µ i ); where δ i is the set of neighbors of grid point i. The precision matrix Q of the joint distribution of µ is sparse because of the important following simplification: µ i µ j µ i, j q ij = 0; (5) where q ij is the element (i, j) of the precision matrix Q. Jalbert et al. A spatio-temporal model for extreme precipitation simulated by a climate model 2016/10/25 18 / 30

28 Intrinsic Gaussian Markov random fields A Gaussian Markov Random field is a multivariate normal vector µ = (µ i, i = 1,..., n) where the precision matrix Q fulfills the following property: q ij = 0 if µ i µ j µ i, j. The marginal pairwise correlation that can be modeled by Gaussian Markov random fields is limited to 0.8 (Besag & Kooperberg, 1995). An option is to use intrinsic Gaussian Markov random fields, where the precision matrix is not of full rank. The rank deficiency controls the smoothness of the field. First-order igmrfs better capture small-scale variations whereas second-order igmrfs better model large-scale ones. Jalbert et al. A spatio-temporal model for extreme precipitation simulated by a climate model 2016/10/25 19 / 30

29 Intrinsic Gaussian Markov random fields The most popular igmrfs are defined with a scaled precision matrix: Q = κw ; where 0 < κ < is a precision parameter that controls the smoothness of the field and W is a structure matrix known from the grid. Let k be the rank deficiency of the precision matrix Q. The improper joint distribution is proportional to { f µ (µ) κ n k 2 exp κ } 2 µ W µ. Under the Bayesian paradigm, igmrfs generally yield proper posterior distributions when used as prior. Jalbert et al. A spatio-temporal model for extreme precipitation simulated by a climate model 2016/10/25 20 / 30

30 First-order intrinsic Gaussian Markov random fields Let n i = Card(δ i ), be the number of neighbors of grid point i. 1 1 f [µi µ δi =µ δi ](µ i ) = N µ i µ j, ; n i κn i j δ i µ i where κ > 0 is the precision parameter. This model approximates a two-dimensional Brownian motion. Jalbert et al. A spatio-temporal model for extreme precipitation simulated by a climate model 2016/10/25 21 / 30

31 First-order intrinsic Gaussian Markov random fields Let n i = Card(δ i ), be the number of neighbors of grid point i. 1 1 f [µi µ δi =µ δi ](µ i ) = N µ i µ j, ; n i κn i j δ i µ i where κ > 0 is the precision parameter. This model approximates a two-dimensional Brownian motion. Jalbert et al. A spatio-temporal model for extreme precipitation simulated by a climate model 2016/10/25 21 / 30

32 Second-order intrinsic Gaussian Markov random fields E(X i X i = x i ) = Prec(X i X i = x i ) = 20κ. This model is an approximation to the thin plate spline, the two-dimensional extension of cubic splines. µ i Jalbert et al. A spatio-temporal model for extreme precipitation simulated by a climate model 2016/10/25 22 / 30

33 Second-order intrinsic Gaussian Markov random fields E(X i X i = x i ) = Prec(X i X i = x i ) = 20κ. -1/20 This model is an approximation to the thin plate spline, the two-dimensional extension of cubic splines. -2/20 8/20-2/20-1/20 8/20 µ i 8/20-1/20-2/20 8/20-2/20-1/20 Jalbert et al. A spatio-temporal model for extreme precipitation simulated by a climate model 2016/10/25 22 / 30

34 Complete spatial model The model is therefore: f [M ik (µi,φi,ξi )] (m ik ) L GEV {m ik µ i, exp (φ i ), ξ i } ; f (µ,φ,ξ) (µ, φ, ξ) { (κ µ κ φ κ ξ ) n k 2 exp κ µ 2 µ W µ κ φ 2 φ W φ κ } ξ 2 ξ W ξ ; Three independent intrinsic Gaussian Markov random fields for the GEV parameter prior. Vague gamma hyperpriors for the precision parameters. Also, igmrfs are semi-informative: marginally non-informative, for example E(µ i ) is undefined and Var(µ i ) = ; spatially informative. Jalbert et al. A spatio-temporal model for extreme precipitation simulated by a climate model 2016/10/25 23 / 30

35 Complete spatial model The model is therefore: f [M ik (µi,φi,ξi )] (m ik ) L GEV {m ik µ i, exp (φ i ), ξ i } ; f (µ,φ,ξ) (µ, φ, ξ) { (κ µ κ φ κ ξ ) n k 2 exp κ µ 2 µ W µ κ φ 2 φ W φ κ } ξ 2 ξ W ξ ; Three independent intrinsic Gaussian Markov random fields for the GEV parameter prior. Vague gamma hyperpriors for the precision parameters. Also, igmrfs are semi-informative: marginally non-informative, for example E(µ i ) is undefined and Var(µ i ) = ; spatially informative. Jalbert et al. A spatio-temporal model for extreme precipitation simulated by a climate model 2016/10/25 23 / 30

36 Results Jalbert et al. A spatio-temporal model for extreme precipitation simulated by a climate model 2016/10/25 24 / 30

37 Homogeneous regions Jalbert et al. A spatio-temporal model for extreme precipitation simulated by a climate model 2016/10/25 25 / 30

38 Chosen model Spatial estimates of the GEV location parameter. According to the deviance information criterion, the model with the second-order igmrf prior is better. Jalbert et al. A spatio-temporal model for extreme precipitation simulated by a climate model 2016/10/25 26 / 30

39 Chosen model Spatial estimates of the GEV scale parameter. According to the deviance information criterion, the model with the second-order igmrf prior is better. Jalbert et al. A spatio-temporal model for extreme precipitation simulated by a climate model 2016/10/25 26 / 30

40 Chosen model Spatial estimates of the GEV shape parameter. According to the deviance information criterion, the model with the second-order igmrf prior is better. Jalbert et al. A spatio-temporal model for extreme precipitation simulated by a climate model 2016/10/25 26 / 30

41 Model fit κ ξ κ σ κ µ Iteration Jalbert et al. A spatio-temporal model for extreme precipitation simulated by a climate model 2016/10/25 27 / 30

42 Application - Projected return level Estimated quantiles (mm) Observed annual precipitation maxima [1943, 1994] at Montreal Trudeau airport year return level (mm) Projected 20-year return level at Montreal Trudeau airport Spatial model Marginal model Empirical quantiles (mm) year Jalbert et al. A spatio-temporal model for extreme precipitation simulated by a climate model 2016/10/25 28 / 30

43 Conclusion Jalbert et al. A spatio-temporal model for extreme precipitation simulated by a climate model 2016/10/25 29 / 30

44 Conclusion The statistical model developed was well suited for climate model outputs, specifically for: transient time series; data that lie on a regular grid but could also be adapted to irregular locations (Lindgren et al., 2011, Paciorek, 2013). The model s simplicity, intuitive interpretation and uncertainty description along with its fast adjustment make it very appealing. Nevertheless, the model could be enhanced by integrating several climate simulations for a better description of future climate uncertainty; We are also investigating the application of max-stable hierarchical models (Shaby & Reich, 2012). Jalbert et al. A spatio-temporal model for extreme precipitation simulated by a climate model 2016/10/25 30 / 30

45 Conclusion The statistical model developed was well suited for climate model outputs, specifically for: transient time series; data that lie on a regular grid but could also be adapted to irregular locations (Lindgren et al., 2011, Paciorek, 2013). The model s simplicity, intuitive interpretation and uncertainty description along with its fast adjustment make it very appealing. Nevertheless, the model could be enhanced by integrating several climate simulations for a better description of future climate uncertainty; We are also investigating the application of max-stable hierarchical models (Shaby & Reich, 2012). Jalbert et al. A spatio-temporal model for extreme precipitation simulated by a climate model 2016/10/25 30 / 30

46 Appendix Appendix Jalbert et al. A spatio-temporal model for extreme precipitation simulated by a climate model 2016/10/25 31 / 30

47 Appendix Gaussian Markov random fields For a stationary field in space, the conditional distributions have to take the following form: f [µi µ δi =µ δi ](µ i ) = N µ i η i + ρ (µ j η j ), ζ 2 ; (6) j δ i where 0 ρ 1 and ζ 2 > 0. It can be shown that marginal bivariate correlation coefficients between neighbors are necessarily less than 0.8: (Besag & Kooperberg, 1995) Cor(µ i, µ j ) 0.8, for j δ i. (7) The spatial correlation that can be modeled is therefore limited. Jalbert et al. A spatio-temporal model for extreme precipitation simulated by a climate model 2016/10/25 32 / 30

48 Appendix Model fit A chain of length 6000 was generated where the first 1000 iterations were discarded as the burn-in period. It took less than 40 minutes of computation time on a 2.53 GHz processor. algorithms for sparse matrix; parallel MCMC. Jalbert et al. A spatio-temporal model for extreme precipitation simulated by a climate model 2016/10/25 33 / 30

49 Appendix Modeling the dependence between the GEV paremeters We could consider a multivariate intrinsic Gaussian Markov random field as follows: f (µ,φ,ξ) (µ, φ, ξ) Γ ( exp µ, φ, ξ ) Γ µ φ, ξ Under a separability assumption, Benerjee et al. (2004) proposed to model the precision matrix Γ as follows: κ µ γ µφ γ µξ Γ = γ µφ κ φ γ φξ W, γ µξ γ φξ κ ξ To ensure parameter identifiability, Cooley & Sain (2010) and Economou et al. (2014) fixed the precision of the Gaussian Markov fields modeling the spatial dependence between each GEV parameters. Jalbert et al. A spatio-temporal model for extreme precipitation simulated by a climate model 2016/10/25 34 / 30

50 Appendix Application - Postprocessing Postprocessing of the annual maxima series at the grid point containing Montreal Trudeau airport Simulated Postprocessed Annual maxima (mm) Year Jalbert et al. A spatio-temporal model for extreme precipitation simulated by a climate model 2016/10/25 35 / 30

Variability in Annual Temperature Profiles

Variability in Annual Temperature Profiles Variability in Annual Temperature Profiles A Multivariate Spatial Analysis of Regional Climate Model Output Tamara Greasby, Stephan Sain Institute for Mathematics Applied to Geosciences, National Center

More information

Extreme Value Theory in (Hourly) Precipitation

Extreme Value Theory in (Hourly) Precipitation Extreme Value Theory in (Hourly) Precipitation Uli Schneider Geophysical Statistics Project, NCAR GSP Miniseries at CSU November 17, 2003 Outline Project overview Extreme value theory 101 Applying extreme

More information

for Images A Bayesian Deformation Model

for Images A Bayesian Deformation Model Statistics in Imaging Workshop July 8, 2004 A Bayesian Deformation Model for Images Sining Chen Postdoctoral Fellow Biostatistics Division, Dept. of Oncology, School of Medicine Outline 1. Introducing

More information

Supplementary Figure 1. Decoding results broken down for different ROIs

Supplementary Figure 1. Decoding results broken down for different ROIs Supplementary Figure 1 Decoding results broken down for different ROIs Decoding results for areas V1, V2, V3, and V1 V3 combined. (a) Decoded and presented orientations are strongly correlated in areas

More information

Bayesian Spatiotemporal Modeling with Hierarchical Spatial Priors for fmri

Bayesian Spatiotemporal Modeling with Hierarchical Spatial Priors for fmri Bayesian Spatiotemporal Modeling with Hierarchical Spatial Priors for fmri Galin L. Jones 1 School of Statistics University of Minnesota March 2015 1 Joint with Martin Bezener and John Hughes Experiment

More information

Graphical Models, Bayesian Method, Sampling, and Variational Inference

Graphical Models, Bayesian Method, Sampling, and Variational Inference Graphical Models, Bayesian Method, Sampling, and Variational Inference With Application in Function MRI Analysis and Other Imaging Problems Wei Liu Scientific Computing and Imaging Institute University

More information

How to Price a House

How to Price a House How to Price a House An Interpretable Bayesian Approach Dustin Lennon dustin@inferentialist.com Inferentialist Consulting Seattle, WA April 9, 2014 Introduction Project to tie up loose ends / came out

More information

INLA: an introduction

INLA: an introduction INLA: an introduction Håvard Rue 1 Norwegian University of Science and Technology Trondheim, Norway May 2009 1 Joint work with S.Martino (Trondheim) and N.Chopin (Paris) Latent Gaussian models Background

More information

Statistical Matching using Fractional Imputation

Statistical Matching using Fractional Imputation Statistical Matching using Fractional Imputation Jae-Kwang Kim 1 Iowa State University 1 Joint work with Emily Berg and Taesung Park 1 Introduction 2 Classical Approaches 3 Proposed method 4 Application:

More information

Hierarchical Modelling for Large Spatial Datasets

Hierarchical Modelling for Large Spatial Datasets Hierarchical Modelling for Large Spatial Datasets Sudipto Banerjee 1 and Andrew O. Finley 2 1 Department of Forestry & Department of Geography, Michigan State University, Lansing Michigan, U.S.A. 2 Biostatistics,

More information

Univariate Extreme Value Analysis. 1 Block Maxima. Practice problems using the extremes ( 2.0 5) package. 1. Pearson Type III distribution

Univariate Extreme Value Analysis. 1 Block Maxima. Practice problems using the extremes ( 2.0 5) package. 1. Pearson Type III distribution Univariate Extreme Value Analysis Practice problems using the extremes ( 2.0 5) package. 1 Block Maxima 1. Pearson Type III distribution (a) Simulate 100 maxima from samples of size 1000 from the gamma

More information

Use of Extreme Value Statistics in Modeling Biometric Systems

Use of Extreme Value Statistics in Modeling Biometric Systems Use of Extreme Value Statistics in Modeling Biometric Systems Similarity Scores Two types of matching: Genuine sample Imposter sample Matching scores Enrolled sample 0.95 0.32 Probability Density Decision

More information

1 Methods for Posterior Simulation

1 Methods for Posterior Simulation 1 Methods for Posterior Simulation Let p(θ y) be the posterior. simulation. Koop presents four methods for (posterior) 1. Monte Carlo integration: draw from p(θ y). 2. Gibbs sampler: sequentially drawing

More information

MCMC Diagnostics. Yingbo Li MATH Clemson University. Yingbo Li (Clemson) MCMC Diagnostics MATH / 24

MCMC Diagnostics. Yingbo Li MATH Clemson University. Yingbo Li (Clemson) MCMC Diagnostics MATH / 24 MCMC Diagnostics Yingbo Li Clemson University MATH 9810 Yingbo Li (Clemson) MCMC Diagnostics MATH 9810 1 / 24 Convergence to Posterior Distribution Theory proves that if a Gibbs sampler iterates enough,

More information

Computer Vision Group Prof. Daniel Cremers. 4. Probabilistic Graphical Models Directed Models

Computer Vision Group Prof. Daniel Cremers. 4. Probabilistic Graphical Models Directed Models Prof. Daniel Cremers 4. Probabilistic Graphical Models Directed Models The Bayes Filter (Rep.) (Bayes) (Markov) (Tot. prob.) (Markov) (Markov) 2 Graphical Representation (Rep.) We can describe the overall

More information

INLA: Integrated Nested Laplace Approximations

INLA: Integrated Nested Laplace Approximations INLA: Integrated Nested Laplace Approximations John Paige Statistics Department University of Washington October 10, 2017 1 The problem Markov Chain Monte Carlo (MCMC) takes too long in many settings.

More information

Monte Carlo for Spatial Models

Monte Carlo for Spatial Models Monte Carlo for Spatial Models Murali Haran Department of Statistics Penn State University Penn State Computational Science Lectures April 2007 Spatial Models Lots of scientific questions involve analyzing

More information

08 An Introduction to Dense Continuous Robotic Mapping

08 An Introduction to Dense Continuous Robotic Mapping NAVARCH/EECS 568, ROB 530 - Winter 2018 08 An Introduction to Dense Continuous Robotic Mapping Maani Ghaffari March 14, 2018 Previously: Occupancy Grid Maps Pose SLAM graph and its associated dense occupancy

More information

Markov Chain Monte Carlo (part 1)

Markov Chain Monte Carlo (part 1) Markov Chain Monte Carlo (part 1) Edps 590BAY Carolyn J. Anderson Department of Educational Psychology c Board of Trustees, University of Illinois Spring 2018 Depending on the book that you select for

More information

CS281 Section 9: Graph Models and Practical MCMC

CS281 Section 9: Graph Models and Practical MCMC CS281 Section 9: Graph Models and Practical MCMC Scott Linderman November 11, 213 Now that we have a few MCMC inference algorithms in our toolbox, let s try them out on some random graph models. Graphs

More information

Slice sampler algorithm for generalized Pareto distribution

Slice sampler algorithm for generalized Pareto distribution Slice sampler algorithm for generalized Pareto distribution Mohammad Rostami, Mohd Bakri Adam Yahya, Mohamed Hisham Yahya, Noor Akma Ibrahim Abstract In this paper, we developed the slice sampler algorithm

More information

Quantitative Biology II!

Quantitative Biology II! Quantitative Biology II! Lecture 3: Markov Chain Monte Carlo! March 9, 2015! 2! Plan for Today!! Introduction to Sampling!! Introduction to MCMC!! Metropolis Algorithm!! Metropolis-Hastings Algorithm!!

More information

Modeling Criminal Careers as Departures From a Unimodal Population Age-Crime Curve: The Case of Marijuana Use

Modeling Criminal Careers as Departures From a Unimodal Population Age-Crime Curve: The Case of Marijuana Use Modeling Criminal Careers as Departures From a Unimodal Population Curve: The Case of Marijuana Use Donatello Telesca, Elena A. Erosheva, Derek A. Kreader, & Ross Matsueda April 15, 2014 extends Telesca

More information

Computer Vision Group Prof. Daniel Cremers. 4. Probabilistic Graphical Models Directed Models

Computer Vision Group Prof. Daniel Cremers. 4. Probabilistic Graphical Models Directed Models Prof. Daniel Cremers 4. Probabilistic Graphical Models Directed Models The Bayes Filter (Rep.) (Bayes) (Markov) (Tot. prob.) (Markov) (Markov) 2 Graphical Representation (Rep.) We can describe the overall

More information

Lecture 21 : A Hybrid: Deep Learning and Graphical Models

Lecture 21 : A Hybrid: Deep Learning and Graphical Models 10-708: Probabilistic Graphical Models, Spring 2018 Lecture 21 : A Hybrid: Deep Learning and Graphical Models Lecturer: Kayhan Batmanghelich Scribes: Paul Liang, Anirudha Rayasam 1 Introduction and Motivation

More information

10-701/15-781, Fall 2006, Final

10-701/15-781, Fall 2006, Final -7/-78, Fall 6, Final Dec, :pm-8:pm There are 9 questions in this exam ( pages including this cover sheet). If you need more room to work out your answer to a question, use the back of the page and clearly

More information

Estimation of Item Response Models

Estimation of Item Response Models Estimation of Item Response Models Lecture #5 ICPSR Item Response Theory Workshop Lecture #5: 1of 39 The Big Picture of Estimation ESTIMATOR = Maximum Likelihood; Mplus Any questions? answers Lecture #5:

More information

Calibration and emulation of TIE-GCM

Calibration and emulation of TIE-GCM Calibration and emulation of TIE-GCM Serge Guillas School of Mathematics Georgia Institute of Technology Jonathan Rougier University of Bristol Big Thanks to Crystal Linkletter (SFU-SAMSI summer school)

More information

Non-Bayesian Classifiers Part II: Linear Discriminants and Support Vector Machines

Non-Bayesian Classifiers Part II: Linear Discriminants and Support Vector Machines Non-Bayesian Classifiers Part II: Linear Discriminants and Support Vector Machines Selim Aksoy Department of Computer Engineering Bilkent University saksoy@cs.bilkent.edu.tr CS 551, Spring 2007 c 2007,

More information

GAMs, GAMMs and other penalized GLMs using mgcv in R. Simon Wood Mathematical Sciences, University of Bath, U.K.

GAMs, GAMMs and other penalized GLMs using mgcv in R. Simon Wood Mathematical Sciences, University of Bath, U.K. GAMs, GAMMs and other penalied GLMs using mgcv in R Simon Wood Mathematical Sciences, University of Bath, U.K. Simple eample Consider a very simple dataset relating the timber volume of cherry trees to

More information

Performance and cost effectiveness of caching in mobile access networks

Performance and cost effectiveness of caching in mobile access networks Performance and cost effectiveness of caching in mobile access networks Jim Roberts (IRT-SystemX) joint work with Salah Eddine Elayoubi (Orange Labs) ICN 2015 October 2015 The memory-bandwidth tradeoff

More information

An Efficient Model Selection for Gaussian Mixture Model in a Bayesian Framework

An Efficient Model Selection for Gaussian Mixture Model in a Bayesian Framework IEEE SIGNAL PROCESSING LETTERS, VOL. XX, NO. XX, XXX 23 An Efficient Model Selection for Gaussian Mixture Model in a Bayesian Framework Ji Won Yoon arxiv:37.99v [cs.lg] 3 Jul 23 Abstract In order to cluster

More information

A Fast and Exact Simulation Algorithm for General Gaussian Markov Random Fields

A Fast and Exact Simulation Algorithm for General Gaussian Markov Random Fields A Fast and Exact Simulation Algorithm for General Gaussian Markov Random Fields HÅVARD RUE DEPARTMENT OF MATHEMATICAL SCIENCES NTNU, NORWAY FIRST VERSION: FEBRUARY 23, 1999 REVISED: APRIL 23, 1999 SUMMARY

More information

Natural Hazards and Extreme Statistics Training R Exercises

Natural Hazards and Extreme Statistics Training R Exercises Natural Hazards and Extreme Statistics Training R Exercises Hugo Winter Introduction The aim of these exercises is to aide understanding of the theory introduced in the lectures by giving delegates a chance

More information

GAMs semi-parametric GLMs. Simon Wood Mathematical Sciences, University of Bath, U.K.

GAMs semi-parametric GLMs. Simon Wood Mathematical Sciences, University of Bath, U.K. GAMs semi-parametric GLMs Simon Wood Mathematical Sciences, University of Bath, U.K. Generalized linear models, GLM 1. A GLM models a univariate response, y i as g{e(y i )} = X i β where y i Exponential

More information

Segmentation of 3D Materials Image Data

Segmentation of 3D Materials Image Data Enhanced Image Modeling for EM/MPM Segmentation of 3D Materials Image Data Dae Woo Kim, Mary L. Comer School of Electrical and Computer Engineering Purdue University Presentation Outline - Motivation -

More information

Non Stationary Variograms Based on Continuously Varying Weights

Non Stationary Variograms Based on Continuously Varying Weights Non Stationary Variograms Based on Continuously Varying Weights David F. Machuca-Mory and Clayton V. Deutsch Centre for Computational Geostatistics Department of Civil & Environmental Engineering University

More information

Artificial Intelligence for Robotics: A Brief Summary

Artificial Intelligence for Robotics: A Brief Summary Artificial Intelligence for Robotics: A Brief Summary This document provides a summary of the course, Artificial Intelligence for Robotics, and highlights main concepts. Lesson 1: Localization (using Histogram

More information

Probabilistic multi-resolution scanning for cross-sample differences

Probabilistic multi-resolution scanning for cross-sample differences Probabilistic multi-resolution scanning for cross-sample differences Li Ma (joint work with Jacopo Soriano) Duke University 10th Conference on Bayesian Nonparametrics Li Ma (Duke) Multi-resolution scanning

More information

Liangjie Hong*, Dawei Yin*, Jian Guo, Brian D. Davison*

Liangjie Hong*, Dawei Yin*, Jian Guo, Brian D. Davison* Tracking Trends: Incorporating Term Volume into Temporal Topic Models Liangjie Hong*, Dawei Yin*, Jian Guo, Brian D. Davison* Dept. of Computer Science and Engineering, Lehigh University, Bethlehem, PA,

More information

Motion Tracking and Event Understanding in Video Sequences

Motion Tracking and Event Understanding in Video Sequences Motion Tracking and Event Understanding in Video Sequences Isaac Cohen Elaine Kang, Jinman Kang Institute for Robotics and Intelligent Systems University of Southern California Los Angeles, CA Objectives!

More information

Machine Learning (BSMC-GA 4439) Wenke Liu

Machine Learning (BSMC-GA 4439) Wenke Liu Machine Learning (BSMC-GA 4439) Wenke Liu 01-31-017 Outline Background Defining proximity Clustering methods Determining number of clusters Comparing two solutions Cluster analysis as unsupervised Learning

More information

Machine Learning A W 1sst KU. b) [1 P] Give an example for a probability distributions P (A, B, C) that disproves

Machine Learning A W 1sst KU. b) [1 P] Give an example for a probability distributions P (A, B, C) that disproves Machine Learning A 708.064 11W 1sst KU Exercises Problems marked with * are optional. 1 Conditional Independence I [2 P] a) [1 P] Give an example for a probability distribution P (A, B, C) that disproves

More information

Cluster Analysis. Angela Montanari and Laura Anderlucci

Cluster Analysis. Angela Montanari and Laura Anderlucci Cluster Analysis Angela Montanari and Laura Anderlucci 1 Introduction Clustering a set of n objects into k groups is usually moved by the aim of identifying internally homogenous groups according to a

More information

Local spatial-predictor selection

Local spatial-predictor selection University of Wollongong Research Online Centre for Statistical & Survey Methodology Working Paper Series Faculty of Engineering and Information Sciences 2013 Local spatial-predictor selection Jonathan

More information

The Proportional Effect: What it is and how do we model it?

The Proportional Effect: What it is and how do we model it? The Proportional Effect: What it is and how do we model it? John Manchuk Centre for Computational Geostatistics Department of Civil & Environmental Engineering University of Alberta One of the outstanding

More information

An Introduction to Markov Chain Monte Carlo

An Introduction to Markov Chain Monte Carlo An Introduction to Markov Chain Monte Carlo Markov Chain Monte Carlo (MCMC) refers to a suite of processes for simulating a posterior distribution based on a random (ie. monte carlo) process. In other

More information

ECE521: Week 11, Lecture March 2017: HMM learning/inference. With thanks to Russ Salakhutdinov

ECE521: Week 11, Lecture March 2017: HMM learning/inference. With thanks to Russ Salakhutdinov ECE521: Week 11, Lecture 20 27 March 2017: HMM learning/inference With thanks to Russ Salakhutdinov Examples of other perspectives Murphy 17.4 End of Russell & Norvig 15.2 (Artificial Intelligence: A Modern

More information

Semantic Segmentation. Zhongang Qi

Semantic Segmentation. Zhongang Qi Semantic Segmentation Zhongang Qi qiz@oregonstate.edu Semantic Segmentation "Two men riding on a bike in front of a building on the road. And there is a car." Idea: recognizing, understanding what's in

More information

Package spatialtaildep

Package spatialtaildep Package spatialtaildep Title Estimation of spatial tail dependence models February 20, 2015 Provides functions implementing the pairwise M-estimator for parametric models for stable tail dependence functions

More information

Note Set 4: Finite Mixture Models and the EM Algorithm

Note Set 4: Finite Mixture Models and the EM Algorithm Note Set 4: Finite Mixture Models and the EM Algorithm Padhraic Smyth, Department of Computer Science University of California, Irvine Finite Mixture Models A finite mixture model with K components, for

More information

Expectation-Maximization Methods in Population Analysis. Robert J. Bauer, Ph.D. ICON plc.

Expectation-Maximization Methods in Population Analysis. Robert J. Bauer, Ph.D. ICON plc. Expectation-Maximization Methods in Population Analysis Robert J. Bauer, Ph.D. ICON plc. 1 Objective The objective of this tutorial is to briefly describe the statistical basis of Expectation-Maximization

More information

Applications of the k-nearest neighbor method for regression and resampling

Applications of the k-nearest neighbor method for regression and resampling Applications of the k-nearest neighbor method for regression and resampling Objectives Provide a structured approach to exploring a regression data set. Introduce and demonstrate the k-nearest neighbor

More information

Edge and local feature detection - 2. Importance of edge detection in computer vision

Edge and local feature detection - 2. Importance of edge detection in computer vision Edge and local feature detection Gradient based edge detection Edge detection by function fitting Second derivative edge detectors Edge linking and the construction of the chain graph Edge and local feature

More information

Computer vision: models, learning and inference. Chapter 10 Graphical Models

Computer vision: models, learning and inference. Chapter 10 Graphical Models Computer vision: models, learning and inference Chapter 10 Graphical Models Independence Two variables x 1 and x 2 are independent if their joint probability distribution factorizes as Pr(x 1, x 2 )=Pr(x

More information

Online Pattern Recognition in Multivariate Data Streams using Unsupervised Learning

Online Pattern Recognition in Multivariate Data Streams using Unsupervised Learning Online Pattern Recognition in Multivariate Data Streams using Unsupervised Learning Devina Desai ddevina1@csee.umbc.edu Tim Oates oates@csee.umbc.edu Vishal Shanbhag vshan1@csee.umbc.edu Machine Learning

More information

Applying the Possibilistic C-Means Algorithm in Kernel-Induced Spaces

Applying the Possibilistic C-Means Algorithm in Kernel-Induced Spaces 1 Applying the Possibilistic C-Means Algorithm in Kernel-Induced Spaces Maurizio Filippone, Francesco Masulli, and Stefano Rovetta M. Filippone is with the Department of Computer Science of the University

More information

Short Survey on Static Hand Gesture Recognition

Short Survey on Static Hand Gesture Recognition Short Survey on Static Hand Gesture Recognition Huu-Hung Huynh University of Science and Technology The University of Danang, Vietnam Duc-Hoang Vo University of Science and Technology The University of

More information

Bayesian Analysis of Differential Gene Expression

Bayesian Analysis of Differential Gene Expression Bayesian Analysis of Differential Gene Expression Biostat Journal Club Chuan Zhou chuan.zhou@vanderbilt.edu Department of Biostatistics Vanderbilt University Bayesian Modeling p. 1/1 Lewin et al., 2006

More information

Spatial Outlier Detection

Spatial Outlier Detection Spatial Outlier Detection Chang-Tien Lu Department of Computer Science Northern Virginia Center Virginia Tech Joint work with Dechang Chen, Yufeng Kou, Jiang Zhao 1 Spatial Outlier A spatial data point

More information

Geostatistical Reservoir Characterization of McMurray Formation by 2-D Modeling

Geostatistical Reservoir Characterization of McMurray Formation by 2-D Modeling Geostatistical Reservoir Characterization of McMurray Formation by 2-D Modeling Weishan Ren, Oy Leuangthong and Clayton V. Deutsch Department of Civil & Environmental Engineering, University of Alberta

More information

BART STAT8810, Fall 2017

BART STAT8810, Fall 2017 BART STAT8810, Fall 2017 M.T. Pratola November 1, 2017 Today BART: Bayesian Additive Regression Trees BART: Bayesian Additive Regression Trees Additive model generalizes the single-tree regression model:

More information

Mixture Models and the EM Algorithm

Mixture Models and the EM Algorithm Mixture Models and the EM Algorithm Padhraic Smyth, Department of Computer Science University of California, Irvine c 2017 1 Finite Mixture Models Say we have a data set D = {x 1,..., x N } where x i is

More information

3 : Representation of Undirected GMs

3 : Representation of Undirected GMs 0-708: Probabilistic Graphical Models 0-708, Spring 202 3 : Representation of Undirected GMs Lecturer: Eric P. Xing Scribes: Nicole Rafidi, Kirstin Early Last Time In the last lecture, we discussed directed

More information

MCMC Methods for data modeling

MCMC Methods for data modeling MCMC Methods for data modeling Kenneth Scerri Department of Automatic Control and Systems Engineering Introduction 1. Symposium on Data Modelling 2. Outline: a. Definition and uses of MCMC b. MCMC algorithms

More information

Comparing different interpolation methods on two-dimensional test functions

Comparing different interpolation methods on two-dimensional test functions Comparing different interpolation methods on two-dimensional test functions Thomas Mühlenstädt, Sonja Kuhnt May 28, 2009 Keywords: Interpolation, computer experiment, Kriging, Kernel interpolation, Thin

More information

Parametric Response Surface Models for Analysis of Multi-Site fmri Data

Parametric Response Surface Models for Analysis of Multi-Site fmri Data Parametric Response Surface Models for Analysis of Multi-Site fmri Data Seyoung Kim 1, Padhraic Smyth 1, Hal Stern 1, Jessica Turner 2, and FIRST BIRN 1 Bren School of Information and Computer Sciences,

More information

Linear Modeling with Bayesian Statistics

Linear Modeling with Bayesian Statistics Linear Modeling with Bayesian Statistics Bayesian Approach I I I I I Estimate probability of a parameter State degree of believe in specific parameter values Evaluate probability of hypothesis given the

More information

Introduction to Pattern Recognition Part II. Selim Aksoy Bilkent University Department of Computer Engineering

Introduction to Pattern Recognition Part II. Selim Aksoy Bilkent University Department of Computer Engineering Introduction to Pattern Recognition Part II Selim Aksoy Bilkent University Department of Computer Engineering saksoy@cs.bilkent.edu.tr RETINA Pattern Recognition Tutorial, Summer 2005 Overview Statistical

More information

Machine Learning Techniques for Detecting Hierarchical Interactions in GLM s for Insurance Premiums

Machine Learning Techniques for Detecting Hierarchical Interactions in GLM s for Insurance Premiums Machine Learning Techniques for Detecting Hierarchical Interactions in GLM s for Insurance Premiums José Garrido Department of Mathematics and Statistics Concordia University, Montreal EAJ 2016 Lyon, September

More information

Sketchable Histograms of Oriented Gradients for Object Detection

Sketchable Histograms of Oriented Gradients for Object Detection Sketchable Histograms of Oriented Gradients for Object Detection No Author Given No Institute Given Abstract. In this paper we investigate a new representation approach for visual object recognition. The

More information

Collective classification in network data

Collective classification in network data 1 / 50 Collective classification in network data Seminar on graphs, UCSB 2009 Outline 2 / 50 1 Problem 2 Methods Local methods Global methods 3 Experiments Outline 3 / 50 1 Problem 2 Methods Local methods

More information

Random projection for non-gaussian mixture models

Random projection for non-gaussian mixture models Random projection for non-gaussian mixture models Győző Gidófalvi Department of Computer Science and Engineering University of California, San Diego La Jolla, CA 92037 gyozo@cs.ucsd.edu Abstract Recently,

More information

Missing Data Analysis for the Employee Dataset

Missing Data Analysis for the Employee Dataset Missing Data Analysis for the Employee Dataset 67% of the observations have missing values! Modeling Setup For our analysis goals we would like to do: Y X N (X, 2 I) and then interpret the coefficients

More information

Feature Selection. Department Biosysteme Karsten Borgwardt Data Mining Course Basel Fall Semester / 262

Feature Selection. Department Biosysteme Karsten Borgwardt Data Mining Course Basel Fall Semester / 262 Feature Selection Department Biosysteme Karsten Borgwardt Data Mining Course Basel Fall Semester 2016 239 / 262 What is Feature Selection? Department Biosysteme Karsten Borgwardt Data Mining Course Basel

More information

CSE152 Introduction to Computer Vision Assignment 3 (SP15) Instructor: Ben Ochoa Maximum Points : 85 Deadline : 11:59 p.m., Friday, 29-May-2015

CSE152 Introduction to Computer Vision Assignment 3 (SP15) Instructor: Ben Ochoa Maximum Points : 85 Deadline : 11:59 p.m., Friday, 29-May-2015 Instructions: CSE15 Introduction to Computer Vision Assignment 3 (SP15) Instructor: Ben Ochoa Maximum Points : 85 Deadline : 11:59 p.m., Friday, 9-May-015 This assignment should be solved, and written

More information

Spatial Regularization of Functional Connectivity Using High-Dimensional Markov Random Fields

Spatial Regularization of Functional Connectivity Using High-Dimensional Markov Random Fields Spatial Regularization of Functional Connectivity Using High-Dimensional Markov Random Fields Wei Liu 1, Peihong Zhu 1, Jeffrey S. Anderson 2, Deborah Yurgelun-Todd 3, and P. Thomas Fletcher 1 1 Scientific

More information

Machine Learning / Jan 27, 2010

Machine Learning / Jan 27, 2010 Revisiting Logistic Regression & Naïve Bayes Aarti Singh Machine Learning 10-701/15-781 Jan 27, 2010 Generative and Discriminative Classifiers Training classifiers involves learning a mapping f: X -> Y,

More information

Variational Methods for Discrete-Data Latent Gaussian Models

Variational Methods for Discrete-Data Latent Gaussian Models Variational Methods for Discrete-Data Latent Gaussian Models University of British Columbia Vancouver, Canada March 6, 2012 The Big Picture Joint density models for data with mixed data types Bayesian

More information

Diffusion Convolutional Recurrent Neural Network: Data-Driven Traffic Forecasting

Diffusion Convolutional Recurrent Neural Network: Data-Driven Traffic Forecasting Diffusion Convolutional Recurrent Neural Network: Data-Driven Traffic Forecasting Yaguang Li Joint work with Rose Yu, Cyrus Shahabi, Yan Liu Page 1 Introduction Traffic congesting is wasteful of time,

More information

Bayesian model selection and diagnostics

Bayesian model selection and diagnostics Bayesian model selection and diagnostics A typical Bayesian analysis compares a handful of models. Example 1: Consider the spline model for the motorcycle data, how many basis functions? Example 2: Consider

More information

Calibrate your model!

Calibrate your model! Calibrate your model! Jonathan Rougier Department of Mathematics University of Bristol mailto:j.c.rougier@bristol.ac.uk BRISK/Cabot/CREDIBLE Summer School: Uncertainty and risk in natural hazards 7-11

More information

Image features. Image Features

Image features. Image Features Image features Image features, such as edges and interest points, provide rich information on the image content. They correspond to local regions in the image and are fundamental in many applications in

More information

Network Traffic Measurements and Analysis

Network Traffic Measurements and Analysis DEIB - Politecnico di Milano Fall, 2017 Introduction Often, we have only a set of features x = x 1, x 2,, x n, but no associated response y. Therefore we are not interested in prediction nor classification,

More information

Belief propagation and MRF s

Belief propagation and MRF s Belief propagation and MRF s Bill Freeman 6.869 March 7, 2011 1 1 Undirected graphical models A set of nodes joined by undirected edges. The graph makes conditional independencies explicit: If two nodes

More information

Region-based Segmentation

Region-based Segmentation Region-based Segmentation Image Segmentation Group similar components (such as, pixels in an image, image frames in a video) to obtain a compact representation. Applications: Finding tumors, veins, etc.

More information

Level-set MCMC Curve Sampling and Geometric Conditional Simulation

Level-set MCMC Curve Sampling and Geometric Conditional Simulation Level-set MCMC Curve Sampling and Geometric Conditional Simulation Ayres Fan John W. Fisher III Alan S. Willsky February 16, 2007 Outline 1. Overview 2. Curve evolution 3. Markov chain Monte Carlo 4. Curve

More information

CS 664 Segmentation. Daniel Huttenlocher

CS 664 Segmentation. Daniel Huttenlocher CS 664 Segmentation Daniel Huttenlocher Grouping Perceptual Organization Structural relationships between tokens Parallelism, symmetry, alignment Similarity of token properties Often strong psychophysical

More information

Tree of Latent Mixtures for Bayesian Modelling and Classification of High Dimensional Data

Tree of Latent Mixtures for Bayesian Modelling and Classification of High Dimensional Data Technical Report No. 2005-06, Department of Computer Science and Engineering, University at Buffalo, SUNY Tree of Latent Mixtures for Bayesian Modelling and Classification of High Dimensional Data Hagai

More information

Digital Image Processing Laboratory: MAP Image Restoration

Digital Image Processing Laboratory: MAP Image Restoration Purdue University: Digital Image Processing Laboratories 1 Digital Image Processing Laboratory: MAP Image Restoration October, 015 1 Introduction This laboratory explores the use of maximum a posteriori

More information

Overview. Monte Carlo Methods. Statistics & Bayesian Inference Lecture 3. Situation At End Of Last Week

Overview. Monte Carlo Methods. Statistics & Bayesian Inference Lecture 3. Situation At End Of Last Week Statistics & Bayesian Inference Lecture 3 Joe Zuntz Overview Overview & Motivation Metropolis Hastings Monte Carlo Methods Importance sampling Direct sampling Gibbs sampling Monte-Carlo Markov Chains Emcee

More information

Warped Mixture Models

Warped Mixture Models Warped Mixture Models Tomoharu Iwata, David Duvenaud, Zoubin Ghahramani Cambridge University Computational and Biological Learning Lab March 11, 2013 OUTLINE Motivation Gaussian Process Latent Variable

More information

Clustering. Robert M. Haralick. Computer Science, Graduate Center City University of New York

Clustering. Robert M. Haralick. Computer Science, Graduate Center City University of New York Clustering Robert M. Haralick Computer Science, Graduate Center City University of New York Outline K-means 1 K-means 2 3 4 5 Clustering K-means The purpose of clustering is to determine the similarity

More information

Bayesian Spherical Wavelet Shrinkage: Applications to Shape Analysis

Bayesian Spherical Wavelet Shrinkage: Applications to Shape Analysis Bayesian Spherical Wavelet Shrinkage: Applications to Shape Analysis Xavier Le Faucheur a, Brani Vidakovic b and Allen Tannenbaum a a School of Electrical and Computer Engineering, b Department of Biomedical

More information

Diffusion Wavelets for Natural Image Analysis

Diffusion Wavelets for Natural Image Analysis Diffusion Wavelets for Natural Image Analysis Tyrus Berry December 16, 2011 Contents 1 Project Description 2 2 Introduction to Diffusion Wavelets 2 2.1 Diffusion Multiresolution............................

More information

Ludwig Fahrmeir Gerhard Tute. Statistical odelling Based on Generalized Linear Model. íecond Edition. . Springer

Ludwig Fahrmeir Gerhard Tute. Statistical odelling Based on Generalized Linear Model. íecond Edition. . Springer Ludwig Fahrmeir Gerhard Tute Statistical odelling Based on Generalized Linear Model íecond Edition. Springer Preface to the Second Edition Preface to the First Edition List of Examples List of Figures

More information

Missing Data Analysis for the Employee Dataset

Missing Data Analysis for the Employee Dataset Missing Data Analysis for the Employee Dataset 67% of the observations have missing values! Modeling Setup Random Variables: Y i =(Y i1,...,y ip ) 0 =(Y i,obs, Y i,miss ) 0 R i =(R i1,...,r ip ) 0 ( 1

More information

Multiple Model Estimation : The EM Algorithm & Applications

Multiple Model Estimation : The EM Algorithm & Applications Multiple Model Estimation : The EM Algorithm & Applications Princeton University COS 429 Lecture Dec. 4, 2008 Harpreet S. Sawhney hsawhney@sarnoff.com Plan IBR / Rendering applications of motion / pose

More information

Markov Network Structure Learning

Markov Network Structure Learning Markov Network Structure Learning Sargur Srihari srihari@cedar.buffalo.edu 1 Topics Structure Learning as model selection Structure Learning using Independence Tests Score based Learning: Hypothesis Spaces

More information

Generation of virtual lithium-ion battery electrode microstructures based on spatial stochastic modeling

Generation of virtual lithium-ion battery electrode microstructures based on spatial stochastic modeling Generation of virtual lithium-ion battery electrode microstructures based on spatial stochastic modeling Daniel Westhoff a,, Ingo Manke b, Volker Schmidt a a Ulm University, Institute of Stochastics, Helmholtzstr.

More information