Modeling Local Uncertainty accounting for Uncertainty in the Data

Similar documents
An Improved Isogeometric Analysis Using the Lagrange Multiplier Method

Evaluation of spatial heterogeneity of watershed through HRU concept using SWAT. Xuesong Zhang

y and the total sum of

Boundary layer and mesh refinement effects on aerodynamic performances of horizontal axis wind turbine (HAWT)

Numerical Solution of Deformation Equations. in Homotopy Analysis Method

A General Algorithm for Computing Distance Transforms in Linear Time

A simple piecewise cubic spline method for approximation of highly nonlinear data

THE THEORY OF REGIONALIZED VARIABLES

Feature Reduction and Selection

GSA Training Notes Raft and Piled-raft Analysis

Hybrid Method of Biomedical Image Segmentation

Some Advanced SPC Tools 1. Cumulative Sum Control (Cusum) Chart For the data shown in Table 9-1, the x chart can be generated.

S1 Note. Basis functions.

Simulation: Solving Dynamic Models ABE 5646 Week 11 Chapter 2, Spring 2010

SUPPLEMENTARY INFORMATION

A large-alphabet oriented scheme for Chinese and English text compression

Using BESO method to optimize the shape and reinforcement of the underground openings

OBJECT TRACKING BY ADAPTIVE MEAN SHIFT WITH KERNEL BASED CENTROID METHOD

Scheduling with Integer Time Budgeting for Low-Power Optimization

J1.8 APPLICATION OF CFD SIMULATIONS FOR SHORT-RANGE ATMOSPHERIC DISPERSION OVER OPEN FIELDS AND WITHIN ARRAYS OF BUILDINGS

Restaurants Review Star Prediction for Yelp Dataset

Synthesizer 1.0. User s Guide. A Varying Coefficient Meta. nalytic Tool. Z. Krizan Employing Microsoft Excel 2007

A combined test for randomness of spatial distribution of composite microstructures

X- Chart Using ANOM Approach

R s s f. m y s. SPH3UW Unit 7.3 Spherical Concave Mirrors Page 1 of 12. Notes

A. General Type- Fzzy Clsterng There are two knds of type- fzzy sets whch are often sed n clsterng algorthms: 1) nterval and ) general. In nterval typ

Lecture 5: Probability Distributions. Random Variables

Fusion Performance Model for Distributed Tracking and Classification

7/12/2016. GROUP ANALYSIS Martin M. Monti UCLA Psychology AGGREGATING MULTIPLE SUBJECTS VARIANCE AT THE GROUP LEVEL

On Covariance Estimation when Nonrespondents are Subsampled

Fusion of Static and Dynamic Body Biometrics for Gait Recognition

Steps for Computing the Dissimilarity, Entropy, Herfindahl-Hirschman and. Accessibility (Gravity with Competition) Indices

Performance Modeling of Web-based Software Systems with Subspace Identification

Econometrics 2. Panel Data Methods. Advanced Panel Data Methods I

Lecture 08 Multiple View Geometry 2

Parallelism for Nested Loops with Non-uniform and Flow Dependences

Constrained Robust Model Predictive Control Based on Polyhedral Invariant Sets by Off-line Optimization

Smoothing Spline ANOVA for variable screening

2x x l. Module 3: Element Properties Lecture 4: Lagrange and Serendipity Elements

Parameter estimation for incomplete bivariate longitudinal data in clinical trials

Analog amplifier card Type VT-VSPA2-1-2X/V0/T1 Type VT-VSPA2-1-2X/V0/T5

6.854 Advanced Algorithms Petar Maymounkov Problem Set 11 (November 23, 2005) With: Benjamin Rossman, Oren Weimann, and Pouya Kheradpour

Life Tables (Times) Summary. Sample StatFolio: lifetable times.sgp

Approximating MAP using Local Search

CS 534: Computer Vision Model Fitting

ACTIVE SPECKLE PHOTOGRAPHY METHOD USING FOURIER TRANSFORM FOR MEASURING THE THICKNESS OF A TRANSPARENT PLATE

Adaptive Transfer Learning

C I R E D 18 th International Conference on Electricity Distribution Turin, 6-9 June 2005 ABSTRACT

Direct Analysis of Pre-Adjusted Loss Cost, Frequency or Severity in Tweedie Models

Intra-Parametric Analysis of a Fuzzy MOLP

Hermite Splines in Lie Groups as Products of Geodesics

A New MPS Simulation Algorithm Based on Gibbs Sampling

3D vector computer graphics

Wishing you all a Total Quality New Year!

Chapter 9. Model Calibration. John Hourdakis Center for Transportation Studies, U of Mn

PID_REG3. 1) The C interface version. Type: Target Independent, Application Dependent. C Version File Names: pid_reg3.c, pid_reg3.

ELEC 377 Operating Systems. Week 6 Class 3

Empirical Distributions of Parameter Estimates. in Binary Logistic Regression Using Bootstrap

Parametric Study on Pile-Soil Interaction Analyses By Overlaying Mesh Method

FEATURE EXTRACTION. Dr. K.Vijayarekha. Associate Dean School of Electrical and Electronics Engineering SASTRA University, Thanjavur

TN348: Openlab Module - Colocalization

Lecture #15 Lecture Notes

Dynamic wetting property investigation of AFM tips in micro/nanoscale

Electrical analysis of light-weight, triangular weave reflector antennas

Spatial Extreme Value Using Bayesian Hierarchical Model For Precipitation Return Levels Prediction

Performance Evaluation of Information Retrieval Systems

Compiler Design. Spring Register Allocation. Sample Exercises and Solutions. Prof. Pedro C. Diniz

NAG Fortran Library Chapter Introduction. G10 Smoothing in Statistics

Cluster Analysis of Electrical Behavior

C2 Training: June 8 9, Combining effect sizes across studies. Create a set of independent effect sizes. Introduction to meta-analysis

Network Coding as a Dynamical System

Improvement of Spatial Resolution Using BlockMatching Based Motion Estimation and Frame. Integration

Computer Animation and Visualisation. Lecture 4. Rigging / Skinning

For instance, ; the five basic number-sets are increasingly more n A B & B A A = B (1)

Solutions to Programming Assignment Five Interpolation and Numerical Differentiation

A Generalized Methodology for Data Analysis

APPLICATION OF A COMPUTATIONALLY EFFICIENT GEOSTATISTICAL APPROACH TO CHARACTERIZING VARIABLY SPACED WATER-TABLE DATA

Why visualisation? IRDS: Visualization. Univariate data. Visualisations that we won t be interested in. Graphics provide little additional information

Fuzzy Filtering Algorithms for Image Processing: Performance Evaluation of Various Approaches

Kent State University CS 4/ Design and Analysis of Algorithms. Dept. of Math & Computer Science LECT-16. Dynamic Programming

MECHANICAL ANALYSIS OF 2D-BRAZED JOINT USING A NEW HYBRID MAX- FEM MODEL

Risk Assessment on Railway Signal System Based on Fuzzy-FMECA Method

A Semi-parametric Regression Model to Estimate Variability of NO 2

NUMERICAL SOLVING OPTIMAL CONTROL PROBLEMS BY THE METHOD OF VARIATIONS

MODELING USER INTERESTS USING TOPIC MODEL

A New Token Allocation Algorithm for TCP Traffic in Diffserv Network

SLAM Summer School 2006 Practical 2: SLAM using Monocular Vision

Dynamic Camera Assignment and Handoff

The calculation of real-time PCR ratios by means of Monte Carlo Simulation or high-order Taylor expansion

The Grouping Methods and Rank Estimator, Based on Ranked Set sampling, for the linear Error in Variable Models

Research Article Quasi-Bézier Curves with Shape Parameters

An Indian Journal FULL PAPER ABSTRACT KEYWORDS. Trade Science Inc.

Page 0 of 0 SPATIAL INTERPOLATION METHODS

An Optimal Algorithm to Find a Minimum 2-neighbourhood Covering Set on Cactus Graphs

Multilevel Iterative Methods

Report #1 Example. Semester

Monte Carlo Integration

A Comparative Study of Constraint-Handling Techniques in Evolutionary Constrained Multiobjective Optimization

Anonymisation of Public Use Data Sets

Design for Reliability: Case Studies in Manufacturing Process Synthesis

Transcription:

Modelng Local Uncertanty accontng for Uncertanty n the Data Olena Babak and Clayton V Detsch Consder the problem of estmaton at an nsampled locaton sng srrondng samples The standard approach to ths problem s krgng Krgng ses the spatal correlatons provded by the varogram to calclate the weghts of the sample vales srrondng an nsampled locaton The weghts obtaned from the krgng eqatons mnmze the estmaton varance and accont for the spatal correlaton between the srrondng samples and the estmaton locaton (that s, closeness to the estmaton locaton) and between sample themselves (that s, data redndancy) Krgng reslts n optmal estmaton (n the case of a known varogram model) and provdes a model for local condtonal dstrbtons; n the Gassan framework, the krgng estmate and krgng estmaton varance are exactly the mean and varance of the local condtonal Gassan dstrbtons Oftentmes, however, the exact sample data are not known de to measrement errors In ths case smple krgng can not be drectly appled to nfer the local condtonal dstrbtons A theoretcal framework for ncorporatng data ncertanty nto calclaton of the local ncertanty dstrbtons s reqred Smple Krgng The smple krgng estmator predcts the vale of the varable of nterest at the estmaton locaton as a lnear combnaton of nearby observatons ), =,, n (, (Jornel and Hbregts, 978): ) z * ( ) ( ) = λ + λ m, () = = T where m denotes the statonary mean, λ = ( λ,, λn ) denotes the vector of the smple krgng weghts calclated from the normal system of eqatons = λ Cov( ), )) = Cov(, )), =,,, () where Cov( ), )),, =,,, denotes the data-to-data covarance vales and Cov(, )), =,,, s the data-to-estmaton pont covarance vales The covarance fncton s calclated nder statonarty throgh the semvarogram model γ (h) Smple krgng s the best lnear nbased estmator, that s, t provdes estmates wth mnmm error varance n the least sqare sense gven by = C(0) λ Cov(, )), () where C (0) s the statonary varance = In the Gassan framework the local condtonal dstrbtons are derved by smple krgng as follows Uncertanty at the estmaton locaton s z *, ) () Accontng for the Uncertanty n Data Let s assme that each of the observatons ), =,, n (, avalable for analyss was measred wth some measrement error Frther assme that the measrement errors are dstrbted accordng to 7-

Gassan (normal) dstrbton; ths, ncertanty n each observaton (random varable) ), =,, n ( can be expressed as follows: ), ), =,, n (, (5) where and denote the mean and varance of the ncertanty dstrbton n -th data For now let s assme that the observatons ), =,, n (, represent ndependent random varables, eg, each data locaton was measred sng dfferent measrement tool When the observatons are no longer assmed to be known, the mean of the local condtonal dstrbtons s a random varable The varance of the local condtonal dstrbtons gven n () s not a random varable becase the smple krgng varance s homoscedastc (see ) Becase the mean of the local condtonal dstrbton s a random varable, the ncertanty at the nsampled locaton s descrbed the followng herarchcal model, ), ], ]), (6) where ) ( ) ( ) = λ + λ m (7) = = Note that dstrbton of s Gassan becase t s a lnear combnaton of Gassan random varables Frthermore, de to (7), the mean and varance of the dstrbton for can be calclated as follows: ] E λ = + λ m = = (8) λ )] λ m λ = + = + λ m = ; = = = = + ] = Var λ ) λ m = = (9) = Var λ ) = λ )] = λ = = = = Ths, t follows that the local condtonal dstrbtons n the case of data ncertanty can be expressed sng the followng herarchcal model:, ), and ), ), (0) where are gven n (8)-(9) Moreover, note that the mean and the varance of local condtonal dstrbtons are gven by: E ] = ]] = ] = ; () [ ] = ]] + = ] + ] = + Z The shape of the local ncertanty n Z ( s Gassan * ]] () 7-

It worth notng that when the observatons ), =,, n (, do not represent ndependent random varables, bt are correlated wth a prescrbed correlaton strctre, the mean and varance of the local condtonal dstrbtons can be calclated followng the same steps as before expect varance of needs to be calclated as ] = Var = λ + = λ m = Var λ ) = λ λ Cov[ ), )] = = = = Moreover note that the above dervatons heavly rely on the assmpton that the varogram model for the stdy doman s known; ncertanty n the data does not mpact the assmpton of the statonary varogram model Small Examples Example : Consder the data confgraton shown n Fgre In total, there are condtonng data avalable for nference of the local condtonal dstrbton at the nsampled locaton All condtonng data are known sbect to measrement errors; the dstrbtons of the condtonng data are Gassan wth dfferent means and varances, =,,, () see Table below Stdy doman of sze 0 by 0 nts s assmed to be statonary; statonary mean and varance are 0 and, respectvely The varogram of the data s a sngle strctred sphercal wth ngget effect of 0 and range of correlaton of 0 nts Table : Data locatons and vales Data Data Data Data Unsampled Locaton X poston 5 9 5 Y poston 7 8 5 Vale N (, ) N (, ) N (, ) N (, )? We wll vary the means and varances of the condtonal data dstrbtons to assess the mpact of data ncertanty on the resltng local ncertanty dstrbton nferred from smple krgng Frst, let s fx s as follows = 08; = 0; = 0; = 0; and examne the effect of s Table show reslts for fve dfferent scenaros for s Note that Table shows only reslts for the varance of the local dstrbton of ncertanty accontng for data ncertanty, that s, Var [ ] ; ths s becase the mean of the local condtonal dstrbton s ndependent of s and eqal to 0088 Table : Effect of s on the local ncertanty dstrbton Case Case Case Case Case 5 0 0 0 05 08 0 0 0 06 09 0 0 0 0 06 0 0 0 0 07 Var [ ] 009 ( ) 0507 0587 0657 0795 7-

It can be clearly noted from Table that wth an ncrease n the data ncertanty (that s, ncrease n the varance of the condtonal data dstrbtons), the varance of the local condtonal dstrbton at the nsampled locaton ncreases Moreover, when there s no ncertanty n the condtonng data; the varance of the local condtonal dstrbton at the nsampled locaton s eqal to smple krgng varance On the other hand, f we fx s as: = 08; = 0; = 0; = 0; we can observe that wth ncrease n the mean of the condtonal data dstrbtons, the mean of the local condtonal dstrbton at the nsampled locaton ncreases, see Table Table : Effect of s on the local ncertanty dstrbton Case Case Case Case -08-0 0-0 0 0-0 0 0-0 0 0 E [ ] -09 065 0765 09780 Note that Table shows only reslts for the mean of the local dstrbton of ncertanty accontng for data ncertanty, that s, E [ ] ; ths s becase the mean of the local condtonal dstrbton s ndependent of s and eqal to0576 It s worth notng that the reslts shown n Tables - were theoretcally calclated from Eqatons ()- () There s, however, another mch more comptatonally ntensve approach based on Monte Carlo smlaton to obtan the same reslt Specfcally, n order to calclate the mean and varance of the local ncertanty dstrbton accontng for parameter ncertanty va Monte Carlo smlaton approach the followng steps need to be ndertaken: At each of the condtonng data locatons draw a vale from the condtonng data dstrbton sng Monte Carlo smlaton approach; Apply smple krgng to calclate the mean and varance of the local condtonal dstrbton sng the condtonal data generated n ; Draw a vale from the local condtonal dstrbton obtaned n Add to the database; Repeat steps - many tmes, say 0000 To show the eqvalence of the theoretcally derved local condtonal dstrbtons of ncertanty and the ones obtaned sng Monte Carlo smlaton, let s repeat analyss of Table Reslts are shown n Tables Table : Theoretcally-derved approach vs Monte-Carlo smlaton: Varance of the local ncertanty dstrbton Var [ ] Case Case Case Case Case 5 Theory 009 0507 0587 0657 0795 Smlaton 007 05078 0588 0655 0797 The reslts of theoretcally-derved approach vs Monte-Carlo smlaton approach match perfectly; the dfference between reslts of both approaches cold have been even smaller f nstead of 0000 drawngs n Monte-Carlo approach 00000 or more were sed Example : To frther nderstand the nflence of the data ncertanty on the local condtonal dstrbtons at the nsampled locatons, let s asses the change n the varance of the local condtonal dstrbtons 7-

(accontng for data ncertanty) over the stdy doman Let s consder the same data confgraton as before; set the means of the condtonng data dstrbtons at: = 8; = 0; = 0; = 0; 0 and consder three dfferent cases, that s, case, case and case 5, for s, see Table In present stdy let s also consder two dfferent varogram models, both sngle strctred sphercal wth ngget effect of 0, bt one wth range of correlaton eqal to 0 nts and the other one wth a range of 5 nts and let s compare reslts Fgre shows reslts obtaned n each case It can be clearly noted from Fgre that wth ncrease n the range of contnty, the varance of the local condtonal dstrbtons decreases The varance of the local condtonal dstrbtons s sally les n the nterval from 0 to However, t can be also hgher than, see Table 5 Table 5: Maxmm varance f the local condtonal dstrbtons over the stdy doman Maxmm Var [ ] Case Case Case 5 Range 5 00 Range 0 09967 0999 06 Conclsons In ths paper a new nterestng framework for ncorporaton of the data ncertanty nto geostatstcal estmaton s presented The theory behnd the methodology was developed n detal; theoretcal reslts were compared wth practcal reslts obtaned va drect Monte Carlo smlaton Two small examples llstratng the change n the local ncertanty when ncorporatng data ncertanty were presented Fgre : Data confgraton for Examples 7-5

Fgre : Varance of the local condtonal dstrbtons accontng for the ncertanty n the data obtaned based on a sngle strctred sphercal varogram wth ngget effect of 0 and range of contnty 5 (left) and 0 (rght) : case (top), case (mddle) and case 5 (bottom) 7-6