A spatio-temporal model for extreme precipitation simulated by a climate model.
|
|
- Isabel Lyons
- 5 years ago
- Views:
Transcription
1 A spatio-temporal model for extreme precipitation simulated by a climate model. Jonathan Jalbert Joint work with Anne-Catherine Favre, Claude Bélisle and Jean-François Angers STATMOS Workshop: Climate and Weather Extremes October 25 th, 2016 Pennsylvania State University, USA.
2 Introduction Jalbert et al. A spatio-temporal model for extreme precipitation simulated by a climate model 2016/10/25 2 / 30
3 Goal With climate, in situ experimentations are impossible. Climate models are therefore the only tools for providing quantitative predictions of the coming climate. The goal of the talk is to present a spatio-temporal statistical model especially suited for extreme precipitation simulated by a climate model. More specifically, the statistical model takes into account non-stationarity in transient time series; large spatial simulation domain; spatial dependence among grid points. Jalbert et al. A spatio-temporal model for extreme precipitation simulated by a climate model 2016/10/25 3 / 30
4 Data The dataset consists in the daily precipitation outputs from a run of the Canadian Regional Climate Model (CRCM). The data were simulated and provided by 12,570 land grid points; Daily precipitation series for the period [1961, 2100] at every grid point. Let Y ikl be the precipitation depth (mm) of day l of year k at grid point i, where 1 i 12, 570; 1 k 140; 1 l 365. Simulation domain Jalbert et al. A spatio-temporal model for extreme precipitation simulated by a climate model 2016/10/25 4 / 30
5 Non-Stationarity Jalbert et al. A spatio-temporal model for extreme precipitation simulated by a climate model 2016/10/25 5 / 30
6 Non-stationarity in the maxima series Let M ik be the annual maximum of year k at grid point i: M ik = max 1 l 365 Y ikl. Let M i be the annual maxima series at grid point i: M i = (M ik : 1 k 140). For 2/3 of the grid points, the series of maxima M i exhibits temporal non-stationarity (the grid points in red in the following figure). Jalbert et al. A spatio-temporal model for extreme precipitation simulated by a climate model 2016/10/25 6 / 30
7 Non-stationarity in the maxima series Let M ik be the annual maximum of year k at grid point i: M ik = max 1 l 365 Y ikl. Let M i be the annual maxima series at grid point i: M i = (M ik : 1 k 140). For 2/3 of the grid points, the series of maxima M i exhibits temporal non-stationarity (the grid points in red in the following figure). Pointwise Mann-Kendall stationarity test (α = 5%) Jalbert et al. A spatio-temporal model for extreme precipitation simulated by a climate model 2016/10/25 6 / 30
8 Maxima series - Montreal Maximum (mm) Year Jalbert et al. A spatio-temporal model for extreme precipitation simulated by a climate model 2016/10/25 7 / 30
9 Introduction Non-Stationarity Spatial modeling Results Conclusion Daily series - Montreal 100 Precipitation (mm) Year Jalbert et al. A spatio-temporal model for extreme precipitation simulated by a climate model 2016/10/25 8 / 30
10 Introduction Non-Stationarity Spatial modeling Results Conclusion Exceedances - Montreal 100 Precipitation (mm) Year Jalbert et al. A spatio-temporal model for extreme precipitation simulated by a climate model 2016/10/25 9 / 30
11 Preprocessing approach Suppose that there exist sequences of constants ν ik and τ ik such that ( M ik = M ) ik ν ik : 1 k 140 ; (1) τ ik can be assumed identically distributed along index k for each grid point i. Therefore, the distribution of a given transformed maximum can be approximated by M ik L GEV (µ i, σ i, ξ i ). (2) The trend in the tail should be isolated from the trend in the bulk of the distribution. Jalbert et al. A spatio-temporal model for extreme precipitation simulated by a climate model 2016/10/25 10 / 30
12 Preprocessing approach Suppose that there exist sequences of constants ν ik and τ ik such that ( M ik = M ) ik ν ik : 1 k 140 ; (1) τ ik can be assumed identically distributed along index k for each grid point i. Therefore, the distribution of a given transformed maximum can be approximated by M ik L GEV (µ i, σ i, ξ i ). (2) The trend in the tail should be isolated from the trend in the bulk of the distribution. Jalbert et al. A spatio-temporal model for extreme precipitation simulated by a climate model 2016/10/25 10 / 30
13 Introduction Non-Stationarity Spatial modeling Results Conclusion Preprocessing approach Let Zik be the vector of precipitation exceedences over the threshold ui of year k at grid point i: 100 and let Precipitation (mm) 80 Zik = (Yikl : Yikl > ui, 1 l 140) ; νik = E(Zik ) and τik2 = Var (Zik ) Year The threshold has to be chosen in order that the transformation: Mik0 = Mik νik ; τik (3) removes the trend in the maxima series Mi0. Its definition does not rely on asymptotic convergence requirements as in the Peaks-Over-Threshold model. Jalbert et al. A spatio-temporal model for extreme precipitation simulated by a climate model 2016/10/25 11 / 30
14 Introduction Non-Stationarity Spatial modeling Results Conclusion Preprocessing approach Let Zik be the vector of precipitation exceedences over the threshold ui of year k at grid point i: 100 and let Precipitation (mm) 80 Zik = (Yikl : Yikl > ui, 1 l 140) ; νik = E(Zik ) and τik2 = Var (Zik ) Year The threshold has to be chosen in order that the transformation: Mik0 = Mik νik ; τik (3) removes the trend in the maxima series Mi0. Its definition does not rely on asymptotic convergence requirements as in the Peaks-Over-Threshold model. Jalbert et al. A spatio-temporal model for extreme precipitation simulated by a climate model 2016/10/25 11 / 30
15 Preprocessed maxima series - Montreal Maximum (mm) p < Standardized Maximum Year Jalbert et al. A spatio-temporal model for extreme precipitation simulated by a climate model 2016/10/25 12 / 30
16 Preprocessed maxima series - Montreal Maximum (mm) Standardized Maximum Year Jalbert et al. A spatio-temporal model for extreme precipitation simulated by a climate model 2016/10/25 12 / 30
17 Preprocessed maxima series - Montreal 1 20 p =0.22 Maximum (mm) Standardized Maximum Year Jalbert et al. A spatio-temporal model for extreme precipitation simulated by a climate model 2016/10/25 12 / 30
18 Threshold choice We chose the 80th empirical quantiles at each grid point as the thresholds. Then, the stationarity hypothesis of the preprocessed maxima series was rejected for only 1.5% of the grid points (the grid points in red in the following figure). Pointwise Mann-Kendall stationarity test (α = 5%) for the preprocessed maxima series Jalbert et al. A spatio-temporal model for extreme precipitation simulated by a climate model 2016/10/25 13 / 30
19 Preprocessing approach Benefits of the proposed preprocessing approach are: if there exist constants a ik > 0 and b ik such that M ik b ik a ik L GEV (0, 1, ξi ); then there exists constants a ik > 0 and b ik such that M ik b ik a ik L GEV (0, 1, ξ i ). The model for the untransformed maxima is tractable: M ik L GEV (τik µ i + ν ik, τ ik σ i, ξ i ). (4) Jalbert et al. A spatio-temporal model for extreme precipitation simulated by a climate model 2016/10/25 14 / 30
20 Preprocessing approach Benefits of the proposed preprocessing approach are: if there exist constants a ik > 0 and b ik such that M ik b ik a ik L GEV (0, 1, ξi ); then there exists constants a ik > 0 and b ik such that M ik b ik a ik L GEV (0, 1, ξ i ). The model for the untransformed maxima is tractable: M ik L GEV (τik µ i + ν ik, τ ik σ i, ξ i ). (4) Jalbert et al. A spatio-temporal model for extreme precipitation simulated by a climate model 2016/10/25 14 / 30
21 Spatial modeling Jalbert et al. A spatio-temporal model for extreme precipitation simulated by a climate model 2016/10/25 15 / 30
22 Spatial dependence structure Following the idea of Cooley & Sain (2010) and Reich & Shaby (2012), the spatial dependence is taken into account by modeling spatial variation in the GEV parameters mainly for two reasons: such a latent variable approach is very flexible; the local properties of extremal distributions (such as return levels) are well reproduced (Davison et al., 2012; Sebille et al., 2016). However such an approach can neither model nor predict an event occurring simultaneously at several grid points. Jalbert et al. A spatio-temporal model for extreme precipitation simulated by a climate model 2016/10/25 16 / 30
23 Spatial latent model Local estimates of the GEV location parameter. Local parameter estimates could definitely benefit from neighboring site values. Jalbert et al. A spatio-temporal model for extreme precipitation simulated by a climate model 2016/10/25 17 / 30
24 Spatial latent model Local estimates of the GEV scale parameter. Local parameter estimates could definitely benefit from neighboring site values. Jalbert et al. A spatio-temporal model for extreme precipitation simulated by a climate model 2016/10/25 17 / 30
25 Spatial latent model Local estimates of the GEV shape parameter. Local parameter estimates could definitely benefit from neighboring site values. Jalbert et al. A spatio-temporal model for extreme precipitation simulated by a climate model 2016/10/25 17 / 30
26 Spatial latent model Because the random variables lie on a regular lattice, Gaussian Markov random fields are well appropriate. Such a field inherits the Markov property. For the GEV location parameter, we have: µ i f [µi µ i =µ i ](µ i ) = f [µi µ δi =µ δi ](µ i ); where δ i is the set of neighbors of grid point i. The precision matrix Q of the joint distribution of µ is sparse because of the important following simplification: µ i µ j µ i, j q ij = 0; (5) where q ij is the element (i, j) of the precision matrix Q. Jalbert et al. A spatio-temporal model for extreme precipitation simulated by a climate model 2016/10/25 18 / 30
27 Spatial latent model Because the random variables lie on a regular lattice, Gaussian Markov random fields are well appropriate. Such a field inherits the Markov property. For the GEV location parameter, we have: µ i f [µi µ i =µ i ](µ i ) = f [µi µ δi =µ δi ](µ i ); where δ i is the set of neighbors of grid point i. The precision matrix Q of the joint distribution of µ is sparse because of the important following simplification: µ i µ j µ i, j q ij = 0; (5) where q ij is the element (i, j) of the precision matrix Q. Jalbert et al. A spatio-temporal model for extreme precipitation simulated by a climate model 2016/10/25 18 / 30
28 Intrinsic Gaussian Markov random fields A Gaussian Markov Random field is a multivariate normal vector µ = (µ i, i = 1,..., n) where the precision matrix Q fulfills the following property: q ij = 0 if µ i µ j µ i, j. The marginal pairwise correlation that can be modeled by Gaussian Markov random fields is limited to 0.8 (Besag & Kooperberg, 1995). An option is to use intrinsic Gaussian Markov random fields, where the precision matrix is not of full rank. The rank deficiency controls the smoothness of the field. First-order igmrfs better capture small-scale variations whereas second-order igmrfs better model large-scale ones. Jalbert et al. A spatio-temporal model for extreme precipitation simulated by a climate model 2016/10/25 19 / 30
29 Intrinsic Gaussian Markov random fields The most popular igmrfs are defined with a scaled precision matrix: Q = κw ; where 0 < κ < is a precision parameter that controls the smoothness of the field and W is a structure matrix known from the grid. Let k be the rank deficiency of the precision matrix Q. The improper joint distribution is proportional to { f µ (µ) κ n k 2 exp κ } 2 µ W µ. Under the Bayesian paradigm, igmrfs generally yield proper posterior distributions when used as prior. Jalbert et al. A spatio-temporal model for extreme precipitation simulated by a climate model 2016/10/25 20 / 30
30 First-order intrinsic Gaussian Markov random fields Let n i = Card(δ i ), be the number of neighbors of grid point i. 1 1 f [µi µ δi =µ δi ](µ i ) = N µ i µ j, ; n i κn i j δ i µ i where κ > 0 is the precision parameter. This model approximates a two-dimensional Brownian motion. Jalbert et al. A spatio-temporal model for extreme precipitation simulated by a climate model 2016/10/25 21 / 30
31 First-order intrinsic Gaussian Markov random fields Let n i = Card(δ i ), be the number of neighbors of grid point i. 1 1 f [µi µ δi =µ δi ](µ i ) = N µ i µ j, ; n i κn i j δ i µ i where κ > 0 is the precision parameter. This model approximates a two-dimensional Brownian motion. Jalbert et al. A spatio-temporal model for extreme precipitation simulated by a climate model 2016/10/25 21 / 30
32 Second-order intrinsic Gaussian Markov random fields E(X i X i = x i ) = Prec(X i X i = x i ) = 20κ. This model is an approximation to the thin plate spline, the two-dimensional extension of cubic splines. µ i Jalbert et al. A spatio-temporal model for extreme precipitation simulated by a climate model 2016/10/25 22 / 30
33 Second-order intrinsic Gaussian Markov random fields E(X i X i = x i ) = Prec(X i X i = x i ) = 20κ. -1/20 This model is an approximation to the thin plate spline, the two-dimensional extension of cubic splines. -2/20 8/20-2/20-1/20 8/20 µ i 8/20-1/20-2/20 8/20-2/20-1/20 Jalbert et al. A spatio-temporal model for extreme precipitation simulated by a climate model 2016/10/25 22 / 30
34 Complete spatial model The model is therefore: f [M ik (µi,φi,ξi )] (m ik ) L GEV {m ik µ i, exp (φ i ), ξ i } ; f (µ,φ,ξ) (µ, φ, ξ) { (κ µ κ φ κ ξ ) n k 2 exp κ µ 2 µ W µ κ φ 2 φ W φ κ } ξ 2 ξ W ξ ; Three independent intrinsic Gaussian Markov random fields for the GEV parameter prior. Vague gamma hyperpriors for the precision parameters. Also, igmrfs are semi-informative: marginally non-informative, for example E(µ i ) is undefined and Var(µ i ) = ; spatially informative. Jalbert et al. A spatio-temporal model for extreme precipitation simulated by a climate model 2016/10/25 23 / 30
35 Complete spatial model The model is therefore: f [M ik (µi,φi,ξi )] (m ik ) L GEV {m ik µ i, exp (φ i ), ξ i } ; f (µ,φ,ξ) (µ, φ, ξ) { (κ µ κ φ κ ξ ) n k 2 exp κ µ 2 µ W µ κ φ 2 φ W φ κ } ξ 2 ξ W ξ ; Three independent intrinsic Gaussian Markov random fields for the GEV parameter prior. Vague gamma hyperpriors for the precision parameters. Also, igmrfs are semi-informative: marginally non-informative, for example E(µ i ) is undefined and Var(µ i ) = ; spatially informative. Jalbert et al. A spatio-temporal model for extreme precipitation simulated by a climate model 2016/10/25 23 / 30
36 Results Jalbert et al. A spatio-temporal model for extreme precipitation simulated by a climate model 2016/10/25 24 / 30
37 Homogeneous regions Jalbert et al. A spatio-temporal model for extreme precipitation simulated by a climate model 2016/10/25 25 / 30
38 Chosen model Spatial estimates of the GEV location parameter. According to the deviance information criterion, the model with the second-order igmrf prior is better. Jalbert et al. A spatio-temporal model for extreme precipitation simulated by a climate model 2016/10/25 26 / 30
39 Chosen model Spatial estimates of the GEV scale parameter. According to the deviance information criterion, the model with the second-order igmrf prior is better. Jalbert et al. A spatio-temporal model for extreme precipitation simulated by a climate model 2016/10/25 26 / 30
40 Chosen model Spatial estimates of the GEV shape parameter. According to the deviance information criterion, the model with the second-order igmrf prior is better. Jalbert et al. A spatio-temporal model for extreme precipitation simulated by a climate model 2016/10/25 26 / 30
41 Model fit κ ξ κ σ κ µ Iteration Jalbert et al. A spatio-temporal model for extreme precipitation simulated by a climate model 2016/10/25 27 / 30
42 Application - Projected return level Estimated quantiles (mm) Observed annual precipitation maxima [1943, 1994] at Montreal Trudeau airport year return level (mm) Projected 20-year return level at Montreal Trudeau airport Spatial model Marginal model Empirical quantiles (mm) year Jalbert et al. A spatio-temporal model for extreme precipitation simulated by a climate model 2016/10/25 28 / 30
43 Conclusion Jalbert et al. A spatio-temporal model for extreme precipitation simulated by a climate model 2016/10/25 29 / 30
44 Conclusion The statistical model developed was well suited for climate model outputs, specifically for: transient time series; data that lie on a regular grid but could also be adapted to irregular locations (Lindgren et al., 2011, Paciorek, 2013). The model s simplicity, intuitive interpretation and uncertainty description along with its fast adjustment make it very appealing. Nevertheless, the model could be enhanced by integrating several climate simulations for a better description of future climate uncertainty; We are also investigating the application of max-stable hierarchical models (Shaby & Reich, 2012). Jalbert et al. A spatio-temporal model for extreme precipitation simulated by a climate model 2016/10/25 30 / 30
45 Conclusion The statistical model developed was well suited for climate model outputs, specifically for: transient time series; data that lie on a regular grid but could also be adapted to irregular locations (Lindgren et al., 2011, Paciorek, 2013). The model s simplicity, intuitive interpretation and uncertainty description along with its fast adjustment make it very appealing. Nevertheless, the model could be enhanced by integrating several climate simulations for a better description of future climate uncertainty; We are also investigating the application of max-stable hierarchical models (Shaby & Reich, 2012). Jalbert et al. A spatio-temporal model for extreme precipitation simulated by a climate model 2016/10/25 30 / 30
46 Appendix Appendix Jalbert et al. A spatio-temporal model for extreme precipitation simulated by a climate model 2016/10/25 31 / 30
47 Appendix Gaussian Markov random fields For a stationary field in space, the conditional distributions have to take the following form: f [µi µ δi =µ δi ](µ i ) = N µ i η i + ρ (µ j η j ), ζ 2 ; (6) j δ i where 0 ρ 1 and ζ 2 > 0. It can be shown that marginal bivariate correlation coefficients between neighbors are necessarily less than 0.8: (Besag & Kooperberg, 1995) Cor(µ i, µ j ) 0.8, for j δ i. (7) The spatial correlation that can be modeled is therefore limited. Jalbert et al. A spatio-temporal model for extreme precipitation simulated by a climate model 2016/10/25 32 / 30
48 Appendix Model fit A chain of length 6000 was generated where the first 1000 iterations were discarded as the burn-in period. It took less than 40 minutes of computation time on a 2.53 GHz processor. algorithms for sparse matrix; parallel MCMC. Jalbert et al. A spatio-temporal model for extreme precipitation simulated by a climate model 2016/10/25 33 / 30
49 Appendix Modeling the dependence between the GEV paremeters We could consider a multivariate intrinsic Gaussian Markov random field as follows: f (µ,φ,ξ) (µ, φ, ξ) Γ ( exp µ, φ, ξ ) Γ µ φ, ξ Under a separability assumption, Benerjee et al. (2004) proposed to model the precision matrix Γ as follows: κ µ γ µφ γ µξ Γ = γ µφ κ φ γ φξ W, γ µξ γ φξ κ ξ To ensure parameter identifiability, Cooley & Sain (2010) and Economou et al. (2014) fixed the precision of the Gaussian Markov fields modeling the spatial dependence between each GEV parameters. Jalbert et al. A spatio-temporal model for extreme precipitation simulated by a climate model 2016/10/25 34 / 30
50 Appendix Application - Postprocessing Postprocessing of the annual maxima series at the grid point containing Montreal Trudeau airport Simulated Postprocessed Annual maxima (mm) Year Jalbert et al. A spatio-temporal model for extreme precipitation simulated by a climate model 2016/10/25 35 / 30
Variability in Annual Temperature Profiles
Variability in Annual Temperature Profiles A Multivariate Spatial Analysis of Regional Climate Model Output Tamara Greasby, Stephan Sain Institute for Mathematics Applied to Geosciences, National Center
More informationExtreme Value Theory in (Hourly) Precipitation
Extreme Value Theory in (Hourly) Precipitation Uli Schneider Geophysical Statistics Project, NCAR GSP Miniseries at CSU November 17, 2003 Outline Project overview Extreme value theory 101 Applying extreme
More informationfor Images A Bayesian Deformation Model
Statistics in Imaging Workshop July 8, 2004 A Bayesian Deformation Model for Images Sining Chen Postdoctoral Fellow Biostatistics Division, Dept. of Oncology, School of Medicine Outline 1. Introducing
More informationSupplementary Figure 1. Decoding results broken down for different ROIs
Supplementary Figure 1 Decoding results broken down for different ROIs Decoding results for areas V1, V2, V3, and V1 V3 combined. (a) Decoded and presented orientations are strongly correlated in areas
More informationBayesian Spatiotemporal Modeling with Hierarchical Spatial Priors for fmri
Bayesian Spatiotemporal Modeling with Hierarchical Spatial Priors for fmri Galin L. Jones 1 School of Statistics University of Minnesota March 2015 1 Joint with Martin Bezener and John Hughes Experiment
More informationGraphical Models, Bayesian Method, Sampling, and Variational Inference
Graphical Models, Bayesian Method, Sampling, and Variational Inference With Application in Function MRI Analysis and Other Imaging Problems Wei Liu Scientific Computing and Imaging Institute University
More informationHow to Price a House
How to Price a House An Interpretable Bayesian Approach Dustin Lennon dustin@inferentialist.com Inferentialist Consulting Seattle, WA April 9, 2014 Introduction Project to tie up loose ends / came out
More informationINLA: an introduction
INLA: an introduction Håvard Rue 1 Norwegian University of Science and Technology Trondheim, Norway May 2009 1 Joint work with S.Martino (Trondheim) and N.Chopin (Paris) Latent Gaussian models Background
More informationStatistical Matching using Fractional Imputation
Statistical Matching using Fractional Imputation Jae-Kwang Kim 1 Iowa State University 1 Joint work with Emily Berg and Taesung Park 1 Introduction 2 Classical Approaches 3 Proposed method 4 Application:
More informationHierarchical Modelling for Large Spatial Datasets
Hierarchical Modelling for Large Spatial Datasets Sudipto Banerjee 1 and Andrew O. Finley 2 1 Department of Forestry & Department of Geography, Michigan State University, Lansing Michigan, U.S.A. 2 Biostatistics,
More informationUnivariate Extreme Value Analysis. 1 Block Maxima. Practice problems using the extremes ( 2.0 5) package. 1. Pearson Type III distribution
Univariate Extreme Value Analysis Practice problems using the extremes ( 2.0 5) package. 1 Block Maxima 1. Pearson Type III distribution (a) Simulate 100 maxima from samples of size 1000 from the gamma
More informationUse of Extreme Value Statistics in Modeling Biometric Systems
Use of Extreme Value Statistics in Modeling Biometric Systems Similarity Scores Two types of matching: Genuine sample Imposter sample Matching scores Enrolled sample 0.95 0.32 Probability Density Decision
More information1 Methods for Posterior Simulation
1 Methods for Posterior Simulation Let p(θ y) be the posterior. simulation. Koop presents four methods for (posterior) 1. Monte Carlo integration: draw from p(θ y). 2. Gibbs sampler: sequentially drawing
More informationMCMC Diagnostics. Yingbo Li MATH Clemson University. Yingbo Li (Clemson) MCMC Diagnostics MATH / 24
MCMC Diagnostics Yingbo Li Clemson University MATH 9810 Yingbo Li (Clemson) MCMC Diagnostics MATH 9810 1 / 24 Convergence to Posterior Distribution Theory proves that if a Gibbs sampler iterates enough,
More informationComputer Vision Group Prof. Daniel Cremers. 4. Probabilistic Graphical Models Directed Models
Prof. Daniel Cremers 4. Probabilistic Graphical Models Directed Models The Bayes Filter (Rep.) (Bayes) (Markov) (Tot. prob.) (Markov) (Markov) 2 Graphical Representation (Rep.) We can describe the overall
More informationINLA: Integrated Nested Laplace Approximations
INLA: Integrated Nested Laplace Approximations John Paige Statistics Department University of Washington October 10, 2017 1 The problem Markov Chain Monte Carlo (MCMC) takes too long in many settings.
More informationMonte Carlo for Spatial Models
Monte Carlo for Spatial Models Murali Haran Department of Statistics Penn State University Penn State Computational Science Lectures April 2007 Spatial Models Lots of scientific questions involve analyzing
More information08 An Introduction to Dense Continuous Robotic Mapping
NAVARCH/EECS 568, ROB 530 - Winter 2018 08 An Introduction to Dense Continuous Robotic Mapping Maani Ghaffari March 14, 2018 Previously: Occupancy Grid Maps Pose SLAM graph and its associated dense occupancy
More informationMarkov Chain Monte Carlo (part 1)
Markov Chain Monte Carlo (part 1) Edps 590BAY Carolyn J. Anderson Department of Educational Psychology c Board of Trustees, University of Illinois Spring 2018 Depending on the book that you select for
More informationCS281 Section 9: Graph Models and Practical MCMC
CS281 Section 9: Graph Models and Practical MCMC Scott Linderman November 11, 213 Now that we have a few MCMC inference algorithms in our toolbox, let s try them out on some random graph models. Graphs
More informationSlice sampler algorithm for generalized Pareto distribution
Slice sampler algorithm for generalized Pareto distribution Mohammad Rostami, Mohd Bakri Adam Yahya, Mohamed Hisham Yahya, Noor Akma Ibrahim Abstract In this paper, we developed the slice sampler algorithm
More informationQuantitative Biology II!
Quantitative Biology II! Lecture 3: Markov Chain Monte Carlo! March 9, 2015! 2! Plan for Today!! Introduction to Sampling!! Introduction to MCMC!! Metropolis Algorithm!! Metropolis-Hastings Algorithm!!
More informationModeling Criminal Careers as Departures From a Unimodal Population Age-Crime Curve: The Case of Marijuana Use
Modeling Criminal Careers as Departures From a Unimodal Population Curve: The Case of Marijuana Use Donatello Telesca, Elena A. Erosheva, Derek A. Kreader, & Ross Matsueda April 15, 2014 extends Telesca
More informationComputer Vision Group Prof. Daniel Cremers. 4. Probabilistic Graphical Models Directed Models
Prof. Daniel Cremers 4. Probabilistic Graphical Models Directed Models The Bayes Filter (Rep.) (Bayes) (Markov) (Tot. prob.) (Markov) (Markov) 2 Graphical Representation (Rep.) We can describe the overall
More informationLecture 21 : A Hybrid: Deep Learning and Graphical Models
10-708: Probabilistic Graphical Models, Spring 2018 Lecture 21 : A Hybrid: Deep Learning and Graphical Models Lecturer: Kayhan Batmanghelich Scribes: Paul Liang, Anirudha Rayasam 1 Introduction and Motivation
More information10-701/15-781, Fall 2006, Final
-7/-78, Fall 6, Final Dec, :pm-8:pm There are 9 questions in this exam ( pages including this cover sheet). If you need more room to work out your answer to a question, use the back of the page and clearly
More informationEstimation of Item Response Models
Estimation of Item Response Models Lecture #5 ICPSR Item Response Theory Workshop Lecture #5: 1of 39 The Big Picture of Estimation ESTIMATOR = Maximum Likelihood; Mplus Any questions? answers Lecture #5:
More informationCalibration and emulation of TIE-GCM
Calibration and emulation of TIE-GCM Serge Guillas School of Mathematics Georgia Institute of Technology Jonathan Rougier University of Bristol Big Thanks to Crystal Linkletter (SFU-SAMSI summer school)
More informationNon-Bayesian Classifiers Part II: Linear Discriminants and Support Vector Machines
Non-Bayesian Classifiers Part II: Linear Discriminants and Support Vector Machines Selim Aksoy Department of Computer Engineering Bilkent University saksoy@cs.bilkent.edu.tr CS 551, Spring 2007 c 2007,
More informationGAMs, GAMMs and other penalized GLMs using mgcv in R. Simon Wood Mathematical Sciences, University of Bath, U.K.
GAMs, GAMMs and other penalied GLMs using mgcv in R Simon Wood Mathematical Sciences, University of Bath, U.K. Simple eample Consider a very simple dataset relating the timber volume of cherry trees to
More informationPerformance and cost effectiveness of caching in mobile access networks
Performance and cost effectiveness of caching in mobile access networks Jim Roberts (IRT-SystemX) joint work with Salah Eddine Elayoubi (Orange Labs) ICN 2015 October 2015 The memory-bandwidth tradeoff
More informationAn Efficient Model Selection for Gaussian Mixture Model in a Bayesian Framework
IEEE SIGNAL PROCESSING LETTERS, VOL. XX, NO. XX, XXX 23 An Efficient Model Selection for Gaussian Mixture Model in a Bayesian Framework Ji Won Yoon arxiv:37.99v [cs.lg] 3 Jul 23 Abstract In order to cluster
More informationA Fast and Exact Simulation Algorithm for General Gaussian Markov Random Fields
A Fast and Exact Simulation Algorithm for General Gaussian Markov Random Fields HÅVARD RUE DEPARTMENT OF MATHEMATICAL SCIENCES NTNU, NORWAY FIRST VERSION: FEBRUARY 23, 1999 REVISED: APRIL 23, 1999 SUMMARY
More informationNatural Hazards and Extreme Statistics Training R Exercises
Natural Hazards and Extreme Statistics Training R Exercises Hugo Winter Introduction The aim of these exercises is to aide understanding of the theory introduced in the lectures by giving delegates a chance
More informationGAMs semi-parametric GLMs. Simon Wood Mathematical Sciences, University of Bath, U.K.
GAMs semi-parametric GLMs Simon Wood Mathematical Sciences, University of Bath, U.K. Generalized linear models, GLM 1. A GLM models a univariate response, y i as g{e(y i )} = X i β where y i Exponential
More informationSegmentation of 3D Materials Image Data
Enhanced Image Modeling for EM/MPM Segmentation of 3D Materials Image Data Dae Woo Kim, Mary L. Comer School of Electrical and Computer Engineering Purdue University Presentation Outline - Motivation -
More informationNon Stationary Variograms Based on Continuously Varying Weights
Non Stationary Variograms Based on Continuously Varying Weights David F. Machuca-Mory and Clayton V. Deutsch Centre for Computational Geostatistics Department of Civil & Environmental Engineering University
More informationArtificial Intelligence for Robotics: A Brief Summary
Artificial Intelligence for Robotics: A Brief Summary This document provides a summary of the course, Artificial Intelligence for Robotics, and highlights main concepts. Lesson 1: Localization (using Histogram
More informationProbabilistic multi-resolution scanning for cross-sample differences
Probabilistic multi-resolution scanning for cross-sample differences Li Ma (joint work with Jacopo Soriano) Duke University 10th Conference on Bayesian Nonparametrics Li Ma (Duke) Multi-resolution scanning
More informationLiangjie Hong*, Dawei Yin*, Jian Guo, Brian D. Davison*
Tracking Trends: Incorporating Term Volume into Temporal Topic Models Liangjie Hong*, Dawei Yin*, Jian Guo, Brian D. Davison* Dept. of Computer Science and Engineering, Lehigh University, Bethlehem, PA,
More informationMotion Tracking and Event Understanding in Video Sequences
Motion Tracking and Event Understanding in Video Sequences Isaac Cohen Elaine Kang, Jinman Kang Institute for Robotics and Intelligent Systems University of Southern California Los Angeles, CA Objectives!
More informationMachine Learning (BSMC-GA 4439) Wenke Liu
Machine Learning (BSMC-GA 4439) Wenke Liu 01-31-017 Outline Background Defining proximity Clustering methods Determining number of clusters Comparing two solutions Cluster analysis as unsupervised Learning
More informationMachine Learning A W 1sst KU. b) [1 P] Give an example for a probability distributions P (A, B, C) that disproves
Machine Learning A 708.064 11W 1sst KU Exercises Problems marked with * are optional. 1 Conditional Independence I [2 P] a) [1 P] Give an example for a probability distribution P (A, B, C) that disproves
More informationCluster Analysis. Angela Montanari and Laura Anderlucci
Cluster Analysis Angela Montanari and Laura Anderlucci 1 Introduction Clustering a set of n objects into k groups is usually moved by the aim of identifying internally homogenous groups according to a
More informationLocal spatial-predictor selection
University of Wollongong Research Online Centre for Statistical & Survey Methodology Working Paper Series Faculty of Engineering and Information Sciences 2013 Local spatial-predictor selection Jonathan
More informationThe Proportional Effect: What it is and how do we model it?
The Proportional Effect: What it is and how do we model it? John Manchuk Centre for Computational Geostatistics Department of Civil & Environmental Engineering University of Alberta One of the outstanding
More informationAn Introduction to Markov Chain Monte Carlo
An Introduction to Markov Chain Monte Carlo Markov Chain Monte Carlo (MCMC) refers to a suite of processes for simulating a posterior distribution based on a random (ie. monte carlo) process. In other
More informationECE521: Week 11, Lecture March 2017: HMM learning/inference. With thanks to Russ Salakhutdinov
ECE521: Week 11, Lecture 20 27 March 2017: HMM learning/inference With thanks to Russ Salakhutdinov Examples of other perspectives Murphy 17.4 End of Russell & Norvig 15.2 (Artificial Intelligence: A Modern
More informationSemantic Segmentation. Zhongang Qi
Semantic Segmentation Zhongang Qi qiz@oregonstate.edu Semantic Segmentation "Two men riding on a bike in front of a building on the road. And there is a car." Idea: recognizing, understanding what's in
More informationPackage spatialtaildep
Package spatialtaildep Title Estimation of spatial tail dependence models February 20, 2015 Provides functions implementing the pairwise M-estimator for parametric models for stable tail dependence functions
More informationNote Set 4: Finite Mixture Models and the EM Algorithm
Note Set 4: Finite Mixture Models and the EM Algorithm Padhraic Smyth, Department of Computer Science University of California, Irvine Finite Mixture Models A finite mixture model with K components, for
More informationExpectation-Maximization Methods in Population Analysis. Robert J. Bauer, Ph.D. ICON plc.
Expectation-Maximization Methods in Population Analysis Robert J. Bauer, Ph.D. ICON plc. 1 Objective The objective of this tutorial is to briefly describe the statistical basis of Expectation-Maximization
More informationApplications of the k-nearest neighbor method for regression and resampling
Applications of the k-nearest neighbor method for regression and resampling Objectives Provide a structured approach to exploring a regression data set. Introduce and demonstrate the k-nearest neighbor
More informationEdge and local feature detection - 2. Importance of edge detection in computer vision
Edge and local feature detection Gradient based edge detection Edge detection by function fitting Second derivative edge detectors Edge linking and the construction of the chain graph Edge and local feature
More informationComputer vision: models, learning and inference. Chapter 10 Graphical Models
Computer vision: models, learning and inference Chapter 10 Graphical Models Independence Two variables x 1 and x 2 are independent if their joint probability distribution factorizes as Pr(x 1, x 2 )=Pr(x
More informationOnline Pattern Recognition in Multivariate Data Streams using Unsupervised Learning
Online Pattern Recognition in Multivariate Data Streams using Unsupervised Learning Devina Desai ddevina1@csee.umbc.edu Tim Oates oates@csee.umbc.edu Vishal Shanbhag vshan1@csee.umbc.edu Machine Learning
More informationApplying the Possibilistic C-Means Algorithm in Kernel-Induced Spaces
1 Applying the Possibilistic C-Means Algorithm in Kernel-Induced Spaces Maurizio Filippone, Francesco Masulli, and Stefano Rovetta M. Filippone is with the Department of Computer Science of the University
More informationShort Survey on Static Hand Gesture Recognition
Short Survey on Static Hand Gesture Recognition Huu-Hung Huynh University of Science and Technology The University of Danang, Vietnam Duc-Hoang Vo University of Science and Technology The University of
More informationBayesian Analysis of Differential Gene Expression
Bayesian Analysis of Differential Gene Expression Biostat Journal Club Chuan Zhou chuan.zhou@vanderbilt.edu Department of Biostatistics Vanderbilt University Bayesian Modeling p. 1/1 Lewin et al., 2006
More informationSpatial Outlier Detection
Spatial Outlier Detection Chang-Tien Lu Department of Computer Science Northern Virginia Center Virginia Tech Joint work with Dechang Chen, Yufeng Kou, Jiang Zhao 1 Spatial Outlier A spatial data point
More informationGeostatistical Reservoir Characterization of McMurray Formation by 2-D Modeling
Geostatistical Reservoir Characterization of McMurray Formation by 2-D Modeling Weishan Ren, Oy Leuangthong and Clayton V. Deutsch Department of Civil & Environmental Engineering, University of Alberta
More informationBART STAT8810, Fall 2017
BART STAT8810, Fall 2017 M.T. Pratola November 1, 2017 Today BART: Bayesian Additive Regression Trees BART: Bayesian Additive Regression Trees Additive model generalizes the single-tree regression model:
More informationMixture Models and the EM Algorithm
Mixture Models and the EM Algorithm Padhraic Smyth, Department of Computer Science University of California, Irvine c 2017 1 Finite Mixture Models Say we have a data set D = {x 1,..., x N } where x i is
More information3 : Representation of Undirected GMs
0-708: Probabilistic Graphical Models 0-708, Spring 202 3 : Representation of Undirected GMs Lecturer: Eric P. Xing Scribes: Nicole Rafidi, Kirstin Early Last Time In the last lecture, we discussed directed
More informationMCMC Methods for data modeling
MCMC Methods for data modeling Kenneth Scerri Department of Automatic Control and Systems Engineering Introduction 1. Symposium on Data Modelling 2. Outline: a. Definition and uses of MCMC b. MCMC algorithms
More informationComparing different interpolation methods on two-dimensional test functions
Comparing different interpolation methods on two-dimensional test functions Thomas Mühlenstädt, Sonja Kuhnt May 28, 2009 Keywords: Interpolation, computer experiment, Kriging, Kernel interpolation, Thin
More informationParametric Response Surface Models for Analysis of Multi-Site fmri Data
Parametric Response Surface Models for Analysis of Multi-Site fmri Data Seyoung Kim 1, Padhraic Smyth 1, Hal Stern 1, Jessica Turner 2, and FIRST BIRN 1 Bren School of Information and Computer Sciences,
More informationLinear Modeling with Bayesian Statistics
Linear Modeling with Bayesian Statistics Bayesian Approach I I I I I Estimate probability of a parameter State degree of believe in specific parameter values Evaluate probability of hypothesis given the
More informationIntroduction to Pattern Recognition Part II. Selim Aksoy Bilkent University Department of Computer Engineering
Introduction to Pattern Recognition Part II Selim Aksoy Bilkent University Department of Computer Engineering saksoy@cs.bilkent.edu.tr RETINA Pattern Recognition Tutorial, Summer 2005 Overview Statistical
More informationMachine Learning Techniques for Detecting Hierarchical Interactions in GLM s for Insurance Premiums
Machine Learning Techniques for Detecting Hierarchical Interactions in GLM s for Insurance Premiums José Garrido Department of Mathematics and Statistics Concordia University, Montreal EAJ 2016 Lyon, September
More informationSketchable Histograms of Oriented Gradients for Object Detection
Sketchable Histograms of Oriented Gradients for Object Detection No Author Given No Institute Given Abstract. In this paper we investigate a new representation approach for visual object recognition. The
More informationCollective classification in network data
1 / 50 Collective classification in network data Seminar on graphs, UCSB 2009 Outline 2 / 50 1 Problem 2 Methods Local methods Global methods 3 Experiments Outline 3 / 50 1 Problem 2 Methods Local methods
More informationRandom projection for non-gaussian mixture models
Random projection for non-gaussian mixture models Győző Gidófalvi Department of Computer Science and Engineering University of California, San Diego La Jolla, CA 92037 gyozo@cs.ucsd.edu Abstract Recently,
More informationMissing Data Analysis for the Employee Dataset
Missing Data Analysis for the Employee Dataset 67% of the observations have missing values! Modeling Setup For our analysis goals we would like to do: Y X N (X, 2 I) and then interpret the coefficients
More informationFeature Selection. Department Biosysteme Karsten Borgwardt Data Mining Course Basel Fall Semester / 262
Feature Selection Department Biosysteme Karsten Borgwardt Data Mining Course Basel Fall Semester 2016 239 / 262 What is Feature Selection? Department Biosysteme Karsten Borgwardt Data Mining Course Basel
More informationCSE152 Introduction to Computer Vision Assignment 3 (SP15) Instructor: Ben Ochoa Maximum Points : 85 Deadline : 11:59 p.m., Friday, 29-May-2015
Instructions: CSE15 Introduction to Computer Vision Assignment 3 (SP15) Instructor: Ben Ochoa Maximum Points : 85 Deadline : 11:59 p.m., Friday, 9-May-015 This assignment should be solved, and written
More informationSpatial Regularization of Functional Connectivity Using High-Dimensional Markov Random Fields
Spatial Regularization of Functional Connectivity Using High-Dimensional Markov Random Fields Wei Liu 1, Peihong Zhu 1, Jeffrey S. Anderson 2, Deborah Yurgelun-Todd 3, and P. Thomas Fletcher 1 1 Scientific
More informationMachine Learning / Jan 27, 2010
Revisiting Logistic Regression & Naïve Bayes Aarti Singh Machine Learning 10-701/15-781 Jan 27, 2010 Generative and Discriminative Classifiers Training classifiers involves learning a mapping f: X -> Y,
More informationVariational Methods for Discrete-Data Latent Gaussian Models
Variational Methods for Discrete-Data Latent Gaussian Models University of British Columbia Vancouver, Canada March 6, 2012 The Big Picture Joint density models for data with mixed data types Bayesian
More informationDiffusion Convolutional Recurrent Neural Network: Data-Driven Traffic Forecasting
Diffusion Convolutional Recurrent Neural Network: Data-Driven Traffic Forecasting Yaguang Li Joint work with Rose Yu, Cyrus Shahabi, Yan Liu Page 1 Introduction Traffic congesting is wasteful of time,
More informationBayesian model selection and diagnostics
Bayesian model selection and diagnostics A typical Bayesian analysis compares a handful of models. Example 1: Consider the spline model for the motorcycle data, how many basis functions? Example 2: Consider
More informationCalibrate your model!
Calibrate your model! Jonathan Rougier Department of Mathematics University of Bristol mailto:j.c.rougier@bristol.ac.uk BRISK/Cabot/CREDIBLE Summer School: Uncertainty and risk in natural hazards 7-11
More informationImage features. Image Features
Image features Image features, such as edges and interest points, provide rich information on the image content. They correspond to local regions in the image and are fundamental in many applications in
More informationNetwork Traffic Measurements and Analysis
DEIB - Politecnico di Milano Fall, 2017 Introduction Often, we have only a set of features x = x 1, x 2,, x n, but no associated response y. Therefore we are not interested in prediction nor classification,
More informationBelief propagation and MRF s
Belief propagation and MRF s Bill Freeman 6.869 March 7, 2011 1 1 Undirected graphical models A set of nodes joined by undirected edges. The graph makes conditional independencies explicit: If two nodes
More informationRegion-based Segmentation
Region-based Segmentation Image Segmentation Group similar components (such as, pixels in an image, image frames in a video) to obtain a compact representation. Applications: Finding tumors, veins, etc.
More informationLevel-set MCMC Curve Sampling and Geometric Conditional Simulation
Level-set MCMC Curve Sampling and Geometric Conditional Simulation Ayres Fan John W. Fisher III Alan S. Willsky February 16, 2007 Outline 1. Overview 2. Curve evolution 3. Markov chain Monte Carlo 4. Curve
More informationCS 664 Segmentation. Daniel Huttenlocher
CS 664 Segmentation Daniel Huttenlocher Grouping Perceptual Organization Structural relationships between tokens Parallelism, symmetry, alignment Similarity of token properties Often strong psychophysical
More informationTree of Latent Mixtures for Bayesian Modelling and Classification of High Dimensional Data
Technical Report No. 2005-06, Department of Computer Science and Engineering, University at Buffalo, SUNY Tree of Latent Mixtures for Bayesian Modelling and Classification of High Dimensional Data Hagai
More informationDigital Image Processing Laboratory: MAP Image Restoration
Purdue University: Digital Image Processing Laboratories 1 Digital Image Processing Laboratory: MAP Image Restoration October, 015 1 Introduction This laboratory explores the use of maximum a posteriori
More informationOverview. Monte Carlo Methods. Statistics & Bayesian Inference Lecture 3. Situation At End Of Last Week
Statistics & Bayesian Inference Lecture 3 Joe Zuntz Overview Overview & Motivation Metropolis Hastings Monte Carlo Methods Importance sampling Direct sampling Gibbs sampling Monte-Carlo Markov Chains Emcee
More informationWarped Mixture Models
Warped Mixture Models Tomoharu Iwata, David Duvenaud, Zoubin Ghahramani Cambridge University Computational and Biological Learning Lab March 11, 2013 OUTLINE Motivation Gaussian Process Latent Variable
More informationClustering. Robert M. Haralick. Computer Science, Graduate Center City University of New York
Clustering Robert M. Haralick Computer Science, Graduate Center City University of New York Outline K-means 1 K-means 2 3 4 5 Clustering K-means The purpose of clustering is to determine the similarity
More informationBayesian Spherical Wavelet Shrinkage: Applications to Shape Analysis
Bayesian Spherical Wavelet Shrinkage: Applications to Shape Analysis Xavier Le Faucheur a, Brani Vidakovic b and Allen Tannenbaum a a School of Electrical and Computer Engineering, b Department of Biomedical
More informationDiffusion Wavelets for Natural Image Analysis
Diffusion Wavelets for Natural Image Analysis Tyrus Berry December 16, 2011 Contents 1 Project Description 2 2 Introduction to Diffusion Wavelets 2 2.1 Diffusion Multiresolution............................
More informationLudwig Fahrmeir Gerhard Tute. Statistical odelling Based on Generalized Linear Model. íecond Edition. . Springer
Ludwig Fahrmeir Gerhard Tute Statistical odelling Based on Generalized Linear Model íecond Edition. Springer Preface to the Second Edition Preface to the First Edition List of Examples List of Figures
More informationMissing Data Analysis for the Employee Dataset
Missing Data Analysis for the Employee Dataset 67% of the observations have missing values! Modeling Setup Random Variables: Y i =(Y i1,...,y ip ) 0 =(Y i,obs, Y i,miss ) 0 R i =(R i1,...,r ip ) 0 ( 1
More informationMultiple Model Estimation : The EM Algorithm & Applications
Multiple Model Estimation : The EM Algorithm & Applications Princeton University COS 429 Lecture Dec. 4, 2008 Harpreet S. Sawhney hsawhney@sarnoff.com Plan IBR / Rendering applications of motion / pose
More informationMarkov Network Structure Learning
Markov Network Structure Learning Sargur Srihari srihari@cedar.buffalo.edu 1 Topics Structure Learning as model selection Structure Learning using Independence Tests Score based Learning: Hypothesis Spaces
More informationGeneration of virtual lithium-ion battery electrode microstructures based on spatial stochastic modeling
Generation of virtual lithium-ion battery electrode microstructures based on spatial stochastic modeling Daniel Westhoff a,, Ingo Manke b, Volker Schmidt a a Ulm University, Institute of Stochastics, Helmholtzstr.
More information