Doubly Cyclic Smoothing Splines and Analysis of Seasonal Daily Pattern of CO2 Concentration in Antarctica
|
|
- Barnaby Bennett
- 6 years ago
- Views:
Transcription
1 Boston-Keio Workshop Doubly Cyclic Smoothing Splines and Analysis of Seasonal Daily Pattern of CO2 Concentration in Antarctica... Mihoko Minami Keio University, Japan August 15, 2016 Joint work with Ryo Kiguchi CO2 Data were provided by National Institute of Polar Research 1 / 37
2 Hourly observations of CO2 concentration at Syowa station in Antarctica (1984/ 2/ /12/31) 25+ years (ppm) 1year 5days 2 / 37
3 Hourly observations of CO2 concentration at Syowa station in Antarctica The data clearly show strong temporal trend strong seasonal variation We are also interested to know if there is a daily pattern? If so, does it vary seasonally? an effect due to wind speed? If so, does it vary seasonally? an effect due to wind direction? In this talk, we introduce the method to analyze a seasonal daily pattern, doubly cyclic smoothing splines, and show the results of analysis that give answers to the above questions. 3 / 37
4 Outline...1 Cyclic cubic smoothing splines A cyclic cubic spline function Cyclic cubic smoothing splines Smoothing mechanism of cyclic cubic smoothing splines...2 A tensor product method: an extenstion to a multivariate smoothing method Roughness penalty for the tensor product method...3 Doubly cyclic cubic smoothing splines What do doubly cyclic cubic smoothing splines do? Wiggly components are shrunk more...4 Analysis of CO2 concentration at Syowa station in Antarctica Seasonal variation of daily Pattern Confidence interval curves for daily pattern Model selection Seasonal change of wind speed effect...5 Conclusions 4 / 37
5 1. Cyclic cubic smoothing splines 5 / 37
6 Cyclic cubic smoothing splines The cyclic cubic smoothing spline is a smoothing method to estimate periodic variation such as daily or annual pattern of time series observations. Day 1 Day2 Day 3 Day 4 It fits a cyclic cubic spline function which is a periodic piece-wise cubic function with continuity up to the second derivative. 6 / 37
7 A cyclic cubic spline function A cyclic cubic spline function g(t) is periodic When the period is T, g(t + kt ) = g(t) for k = 0, ±1, ±2, piece-wise cubic polynomial Given knots t (0) < t (1) < < t (K 1) < t (K) with t (K) t (0) = T, g(t) = f j (t) for t [t (j 1), t (j) ), j = 1, 2,, K where f j (t)s are cubic polynomial functions. That is, for t [t (0), t (K) ], it can be expressed as g(t) = K I [t (j 1),t (j) ) f j(t) j=1 7 / 37
8 A cyclic cubic spline function A cyclic cubic spline function K g(t) = I [t (j 1),t (j) ) f j(t) j=1 is also continuous up to the second derivative For j = 1, 2,, K 1, f j (t (j) ) = f j+1 (t (j) ), f j(t (j) ) = f j+1(t (j) ), f j (t (j) ) = f j+1(t (j) ) The values at the both endpoints t (0) and t (K) are equal up to the second derivative. f 1 (t (0) ) = f K (t (K) ), f 1 (t(0) ) = f K (t(k) ), f 1 (t(0) ) = f K (t(k) ) 8 / 37
9 Cyclic cubic smoothing splines A cyclic cubic spline function is flexible. To avoid overfitting, we impose a roughness penalty. In a most simplified case, the model and object function are defined as: Model y i = g(t i ) + ϵ i, ϵ i N(0, σ 2 ), i = 1,, n, i.i.d. where g(t) is a cyclic cubic spline function Penalized squared errors n t (K) Ω λ (g) = {y i g(t i )} 2 + λ g (t) 2 dt, λ > 0 (1) i=1 t (0) λ is called a smoothing parameter. 9 / 37
10 Example: Daily pattern of PM2.5 1/3 Hourly observations of PM2.5 1/3 in air for 28 days at Fukuoka In the left plot, lambda/m = 8 lambda/m= black dots with solid lines depict hourly averages of PM2.5 1/3 the red dashed curve is the fitted cyclic cubic spline function with λ = 8 28 the green dotted curve is the fitted cyclic cubic spline function with λ = / 37
11 Smoothing mechanism of cyclic cubic smoothing splines In the following, we assume knots are evenly spaced with Function value parameterization t (j) t (j 1) = h for j = 1, 2,, K We employ the function value parameterization to express cyclic cubic functions. For j = 1, 2,, K, let β j be the function value of g(t) at t (j), that is, β j = g(t (j) ), b j (t) be the corresponding cyclic cubic spline basis function with b j (t (i) ) = δ ij for i = 1, 2,, K, so that a cyclic cubic spline function g(t) can be expressed as g(t) = and K β j b j (t) (2) j=1 11 / 37
12 Penalty term with function value parameterization The penalty term can be expressed as t (K) g (t) 2 dx = β T D T B 1 Dβ (3) t (0) where β = (β 1, β 2,, β K ) T B and D are cyclic band matrices, B = h 6 G(4, 1) and D = 1 G( 2, 1) h where G(a, b) denotes a cyclic band matrix a b b b a b G(a, b) = b a b b b a 12 / 37
13 Least penalized squared error estimate ˆβ Suppose now that all observations were made at knots at each knot, m observations were obtained. Let y denote the sample average vector at the knots. Then, we have n {y i g(t i )} 2 = y 1 m y 2 + m y β 2 i=1 so that the minimization of penalized squared errors is equivalent to the minimization of S(β) = m y β 2 + λβ T D T B 1 Dβ (4) Least penalized squared error estimate ˆβ = Hy where H = ( I K + λ ) 1 m DT B 1 D 13 / 37
14 Eigenvalues and eigenvectors of G(a, b) For the even number of knots (K = 2q), eigenvalues of a cyclic band matrix G(a, b) with b > 0 are in descending order l 1 = a + 2b, l 2j = l 2j+1 = a + 2b cos 2πj (j = 1,, q 1) and the corresponding eigenvectors are u 2j = cos ( ) 2πj 1 k 2. k cos ( ) 2πj i k. cos (2πj) k, u 1 = 1 k (1, 1,, 1, 1) T,, u 2j+1 = 2 k sin ( ) 2πj 1 k. sin ( ) 2πj i k. sin (2πj) u 2q = 1 k (1, 1,, 1, 1) T. l 2q = a 2b, j = 1, 2,, q 1 14 / 37
15 Eigenvalues and eigenvectors of influence matrix H Recall that the estimate ˆβ of the function values at knots is given by ˆβ = Hy where ( I K + λ ) 1 m DT B 1 D Matrices D, B and I K share the same eigenvectors, so does H. The eigenvalues of the influence matrix H are given in descending order by ( γ 1 = 1, γ 2j = γ 2j+1 = 1 + λ m 12 1 cos 2πj ) 2 h 3 k ( 2 + cos 2πj ) k and γ 2q = ( 1 + λ m 48 ) 1 h 3 1 j = 1,, q 1, 15 / 37
16 Eigenvalues and eigenvectors of influence matrix H Eigen Values Eigen Values of Influence Matrix i= i= i= j lambda/m = 8 lambda/m = γ j i= i= i= ˆβ = = ( I k + λ m DT B 1 D) 1 y k γ j (u j, y) u j j=1 where γ j s are eigenvalues and u j are eigenvectors of H. u j The black solid curves are cyclic cubic spline basis functions corresponding to u j. The red dashed curves are cyclic cubic spline basis functions multiplied by γ j (=γ j u j ). 16 / 37
17 Smoothing mechanism of cyclic cubic smoothing splines lambda/m = 8 lambda/m= ˆβ = = y = k γ j u j u T j y j=1 k γ j (u j, y) u j j=1 k (u j, y) u j j=1 The smoothing mechanism can be understood as follows It decomposes the average observation vector y into the constant component (overall mean), and sin and cos components with frequencies 1 to q(= m/2). sin and cos components are shrunk. The higher the frequency is, the more the component is shrunk. The overall mean and shrunk components are summed up to produce ˆβ 17 / 37
18 2. A tensor product method: an extenstion to a multivariate smoothing method 18 / 37
19 A tensor product method : an extenstion to a bivariate smoothing method Suppose we have basis functions for a function space Ω 1 a 1 (s), a 2 (s),, a K1 (s) basis functions for a function space Ω 2 b 1 (t), b 2 (t),, b K2 (t). A tensor product method uses products of basis functions on Ω 1 Ω 2 a i (s)b j (t), i = 1, 2,, K 1, j = 1, 2,, K 2 as its basis functions. Thus, a bivariate function for the tensor product method can be expressed as K 1 K 2 f st (s, t) = β ij a i (s)b j (t) (5) i=1 j=1 19 / 37
20 Roughness penalty for the tensor product method Roughness penality for a tensor product smoothing function is defined as J(f st ) = Ω s Ω t λ s ( 2 f st s 2 ) 2 ( 2 ) 2 f st + λ t t 2 ds dt. When knots are evenly spaced, the penalty term can be approximated as Penalty term for a tensor product smoothing function J(f st ) λ s β T (S s I Kt )β + λ t β T (I Ks S t )β (6) where β is a vector of appropriately rearranged function values at grids. (Wood, 2006) 20 / 37
21 3. Doubly cyclic cubic smoothing splines 21 / 37
22 Doubly cyclic cubic smoothing splines Doubly cyclic cubic smoothing splines are generated using a tensor product method with: - basis functions for a function space with a yearly period f a 1, f a 2,, f a K a - basis functions for a function space with a daily period f d 1, f d 2,, f d K d. We start with a univariate function of time t, defined on a coil, that winds around a torus: K d K a f(t) = β ij fi a (t)fj d (t) i=1 j=1 Then, to have a function that is smooth in two directions, we re-express this as: K d K a f(s, t) = β ij fi a (s)fj d (t) i=1 j=1 and consider penalty to this function. 22 / 37
23 What does doubly cyclic cubic smoothing spline do? When knots are evenly spaced, and the numbers of observations are equal for all knots, then, original basis functions can be linearly transformed into Oorthogonal basis functions fij cos : cyclic cubic spline function whose values at knots are equal to cos (2πt(ih a + jh d )) for i = 0, qa, j = 0, ±1, ± qd fij sin : cyclic cubic spline function whose values at knots are equal to sin (2πt(ih a + jh d )) for i = 0, qa, j = 0, ±1, ± qd where q d K d/2 1, q a K a /2 1 and for h a = 1/K a, h d = 1/K d, These are the eigenvectors of the influence matrix for doubly cyclic cubic smoothing splines. 23 / 37
24 What do doubly cyclic cubic smoothing splines do? Estimated function ˆf(t) = q a i=0 j= qd qd (1 cos 2πih a ) (1 2 (1 cos 2πjh d ) 2 + λ a + λ d 2 + cos 2πih a 2 + cos 2πjh d ( < u cos ij, y > ) u cos f cos ij 2 ij + < usin ij, y > u sin f sin ij 2 ij where qd K d/2 1, qa K a /2 1 and for h a = 1/K a, h d = 1/K d, ) 1 u cos ij : vectors of values of cos (2πt(ih a + jh d )) at knots u sin ij : vectors of values of sin (2πt(ih a + jh d )) at knots fij cos : cyclic cubic spline function with cos (2πt(ih a + jh d )) as values at knots fij sin : cyclic cubic spline function with sin (2πt(ih a + jh d )) as values at knots y : vector of the averages at knots 24 / 37
25 Wiggly components are shrunk more The doubly cyclic cubic smoothing spline shrinks the components of basis function with values at knots cos (2πt(ih a ± jh d )), and basis function with values at knots sin (2πt(ih a ± jh d )) by multiplying them by the shrinkage rate (1 cos 2πih a ) (1 2 (1 cos 2πjh d ) 2 ) 1 + λ a + λ d 2 + cos 2πih a 2 + cos 2πjh d Shrinkage rate and sum them up i(annual) j(daily) The larger i or j is, the more wiggly the basis function is in either direction. The more wiggly the basis function is in either direction, the more its coefficient is shrunk. 25 / 37
26 4. Analysis of CO2 concentration at Syowa station in Antarctica 26 / 37
27 A model with temporal trend and seasonal daily pattern We start with a linear additive model for CO2 concentration with temporal trend and seasonal daily pattern as explanatory terms. where Model 1: Y = f tr (t) + f day,year (t) + ϵ Y f tr (t) f day,year (t) : CO2 concentration : a cubic spline function of time t for temporal trend : a doubly cyclic cubic spline function of time t with daily and annual cycles ϵ : random error with variance σ 2 We used R package mgcv by Simon Wood for analysis. 27 / 37
28 Temporal trend and annual variation Temporal trend is almost linear CO2 concentration has increased 40ppm in 25 years The range of annual variation is 1.1ppm CO2 concentration is low in summer and high in winter 28 / 37
29 Seasonal variation of daily Pattern in CO2 concentration Daily pattern of CO2 concentration has a seasonal variation It has the largest daily variation (0.017ppm) in summer (January 4th) 29 / 37
30 Confidence interval curves for daily pattern 95% confidence interval curves for January 4th and July 4th. CO2 concentration January 4 July Hourly variation is significant in summer (January 4th), but not significant in winter (July 4th). Time 30 / 37
31 Effects of wind speed and direction Wind speed might have an effect on CO2 concentration. The effect of wind speed might depend on the wind direction. where Model 2: y = f tr (t) + f day,year (t) + f ws,wd (s, d) + ϵ Y f tr (t) f day,year (t) : Co2 concentration : a cubic spline function of time t for temporal trend : a doubly cyclic cubic spline function of time t with daily and annual cycles f ws,wd (s, d) : tensor product of a cubic spline function of wind speed s and a cyclic spline function of wind direction d ϵ : random error with variance σ 2 31 / 37
32 Seasonal effect of wind speed The effect of wind speed might differ by season. where Model 3: y = f tr (t) + f day,year (t) + f ws,year (s, t) + ϵ Y f tr (t) f day,year (t) : Co2 concentration : a cubic spline function of time t for temporal trend : a doubly cyclic cubic spline function of time t with daily and annual cycles f ws,year (s, t) : tensor product of a cubic spline function of wind speed s and a cyclic cubic spline function with annual cycle of t ϵ : random error with variance σ 2 32 / 37
33 Model selection for CO2 concentration We fitted the following three models and compared AIC where model formula AIC model 1 y = f tr (t) + f day,year (t) + ϵ model 2 y = f tr (t) + f day,year (t) + f ws,wd (s, d) + ϵ model 3 y = f tr (t) + f day,year (t) + f ws,year (s, t) + ϵ f tr (t) f day,year (t) : a cubic spline function of time t : a doubly cyclic cubic spline function of time t with daily and annual cycles f ws,wd (s, d) : tensor product of a cubic spline function of wind speed s and a cyclic spline function of wind direction d f ws,year (s, t) : tensor product of a cubic spline function of wind speed s and a cyclic cubic spline function with annual cycle of t 33 / 37
34 Seasonal change of wind speed effect January - March CO2 concentration January Wind Speed CO2 concentration February Wind Speed CO2 concentration March Wind Speed April 4 May 4 June 4 April - June CO2 concentration Wind Speed CO2 concentration Wind Speed CO2 concentration Wind Speed July 4 August 4 September 4 July - September CO2 concentration CO2 concentration CO2 concentration Wind Speed Wind Speed Wind Speed October 4 November 4 December 4 October - December CO2 concentration CO2 concentration CO2 concentration Wind Speed Wind Speed Wind Speed 34 / 37
35 Conclusions We proposed the doubly cyclic cubic smoothing spline method. For a simple model, the eigenvalues and eigenvectors of the influence matrix can be explicitly expressed with the values of trigonometric functions with different frequencies. This expression shows that the more wiggly the basis function is, the more its coefficient is shrunk. We analyzed CO2 concentration at Syowa station in Antarctica using this method. CO2 concentration has a strong temporal trend and annual variation. Daily pattern of CO2 concentration has a seasonal variation. Hourly variation is significant in summer (January), but not significant in winter (July). The effect of wind speed also has annual variation. Flexible regression models using nonparametric smoothing methods enable us to analyze the data of interest more precisely. 35 / 37
36 Reference..1 Green, P.J. and Silverman, B.W. (1993) Nonparametric Regression and Generalized Linear Models: A roughness penalty approach, Chapman&Hall/CRC...2 Wood, S.N. (2003) Thin plate regression splines. J. R. Statist. Soc. B 65, Wood, S.N. (2006a) Low-Rank Scale-Invariant Tensor Product Smooths for Generalized Additive Mixed Models. Biometrics 62(4): Wood, S.N. (2006b) Generalized Additive Models: An Introduction with R, Chapman Hall/CRC...5 Kiguchi, R. and Minami, M. (2012) Cyclic Cubic Regression Spline Smoothing and Analysis of CO2 Data at Showa Station in Antarctica, Proceedings of International Biometric Conference Kiguchi, R. (2014) Doubly Cyclic Smoothing Splines and Analysis of CO2 Data at Syowa Station in Antarctica, Master s thesis, Keio University. 36 / 37
37 Thank you for your attention! 37 / 37
Generalized Additive Models
:p Texts in Statistical Science Generalized Additive Models An Introduction with R Simon N. Wood Contents Preface XV 1 Linear Models 1 1.1 A simple linear model 2 Simple least squares estimation 3 1.1.1
More informationGAMs, GAMMs and other penalized GLMs using mgcv in R. Simon Wood Mathematical Sciences, University of Bath, U.K.
GAMs, GAMMs and other penalied GLMs using mgcv in R Simon Wood Mathematical Sciences, University of Bath, U.K. Simple eample Consider a very simple dataset relating the timber volume of cherry trees to
More informationCurve fitting using linear models
Curve fitting using linear models Rasmus Waagepetersen Department of Mathematics Aalborg University Denmark September 28, 2012 1 / 12 Outline for today linear models and basis functions polynomial regression
More informationP-spline ANOVA-type interaction models for spatio-temporal smoothing
P-spline ANOVA-type interaction models for spatio-temporal smoothing Dae-Jin Lee and María Durbán Universidad Carlos III de Madrid Department of Statistics IWSM Utrecht 2008 D.-J. Lee and M. Durban (UC3M)
More informationGAMs semi-parametric GLMs. Simon Wood Mathematical Sciences, University of Bath, U.K.
GAMs semi-parametric GLMs Simon Wood Mathematical Sciences, University of Bath, U.K. Generalized linear models, GLM 1. A GLM models a univariate response, y i as g{e(y i )} = X i β where y i Exponential
More information1D Regression. i.i.d. with mean 0. Univariate Linear Regression: fit by least squares. Minimize: to get. The set of all possible functions is...
1D Regression i.i.d. with mean 0. Univariate Linear Regression: fit by least squares. Minimize: to get. The set of all possible functions is... 1 Non-linear problems What if the underlying function is
More informationLecture 16: High-dimensional regression, non-linear regression
Lecture 16: High-dimensional regression, non-linear regression Reading: Sections 6.4, 7.1 STATS 202: Data mining and analysis November 3, 2017 1 / 17 High-dimensional regression Most of the methods we
More informationA toolbox of smooths. Simon Wood Mathematical Sciences, University of Bath, U.K.
A toolbo of smooths Simon Wood Mathematical Sciences, University of Bath, U.K. Smooths for semi-parametric GLMs To build adequate semi-parametric GLMs requires that we use functions with appropriate properties.
More informationLecture 13: Model selection and regularization
Lecture 13: Model selection and regularization Reading: Sections 6.1-6.2.1 STATS 202: Data mining and analysis October 23, 2017 1 / 17 What do we know so far In linear regression, adding predictors always
More informationIncorporating Geospatial Data in House Price Indexes: A Hedonic Imputation Approach with Splines. Robert J. Hill and Michael Scholz
Incorporating Geospatial Data in House Price Indexes: A Hedonic Imputation Approach with Splines Robert J. Hill and Michael Scholz Department of Economics University of Graz, Austria OeNB Workshop Vienna,
More informationSplines and penalized regression
Splines and penalized regression November 23 Introduction We are discussing ways to estimate the regression function f, where E(y x) = f(x) One approach is of course to assume that f has a certain shape,
More informationSmoothing Dissimilarities for Cluster Analysis: Binary Data and Functional Data
Smoothing Dissimilarities for Cluster Analysis: Binary Data and unctional Data David B. University of South Carolina Department of Statistics Joint work with Zhimin Chen University of South Carolina Current
More informationA review of spline function selection procedures in R
Matthias Schmid Department of Medical Biometry, Informatics and Epidemiology University of Bonn joint work with Aris Perperoglou on behalf of TG2 of the STRATOS Initiative September 1, 2016 Introduction
More informationSpline Models. Introduction to CS and NCS. Regression splines. Smoothing splines
Spline Models Introduction to CS and NCS Regression splines Smoothing splines 3 Cubic Splines a knots: a< 1 < 2 < < m
More informationLecture 17: Smoothing splines, Local Regression, and GAMs
Lecture 17: Smoothing splines, Local Regression, and GAMs Reading: Sections 7.5-7 STATS 202: Data mining and analysis November 6, 2017 1 / 24 Cubic splines Define a set of knots ξ 1 < ξ 2 < < ξ K. We want
More informationNonparametric regression using kernel and spline methods
Nonparametric regression using kernel and spline methods Jean D. Opsomer F. Jay Breidt March 3, 016 1 The statistical model When applying nonparametric regression methods, the researcher is interested
More informationSplines. Patrick Breheny. November 20. Introduction Regression splines (parametric) Smoothing splines (nonparametric)
Splines Patrick Breheny November 20 Patrick Breheny STA 621: Nonparametric Statistics 1/46 Introduction Introduction Problems with polynomial bases We are discussing ways to estimate the regression function
More informationModeling Criminal Careers as Departures From a Unimodal Population Age-Crime Curve: The Case of Marijuana Use
Modeling Criminal Careers as Departures From a Unimodal Population Curve: The Case of Marijuana Use Donatello Telesca, Elena A. Erosheva, Derek A. Kreader, & Ross Matsueda April 15, 2014 extends Telesca
More informationDesign considerations
Curves Design considerations local control of shape design each segment independently smoothness and continuity ability to evaluate derivatives stability small change in input leads to small change in
More informationSTAT 705 Introduction to generalized additive models
STAT 705 Introduction to generalized additive models Timothy Hanson Department of Statistics, University of South Carolina Stat 705: Data Analysis II 1 / 22 Generalized additive models Consider a linear
More informationKnowledge Discovery and Data Mining
Knowledge Discovery and Data Mining Basis Functions Tom Kelsey School of Computer Science University of St Andrews http://www.cs.st-andrews.ac.uk/~tom/ tom@cs.st-andrews.ac.uk Tom Kelsey ID5059-02-BF 2015-02-04
More informationContents 10. Graphs of Trigonometric Functions
Contents 10. Graphs of Trigonometric Functions 2 10.2 Sine and Cosine Curves: Horizontal and Vertical Displacement...... 2 Example 10.15............................... 2 10.3 Composite Sine and Cosine
More informationMultiresponse Sparse Regression with Application to Multidimensional Scaling
Multiresponse Sparse Regression with Application to Multidimensional Scaling Timo Similä and Jarkko Tikka Helsinki University of Technology, Laboratory of Computer and Information Science P.O. Box 54,
More informationFurther Maths Notes. Common Mistakes. Read the bold words in the exam! Always check data entry. Write equations in terms of variables
Further Maths Notes Common Mistakes Read the bold words in the exam! Always check data entry Remember to interpret data with the multipliers specified (e.g. in thousands) Write equations in terms of variables
More informationChapter 5: Basis Expansion and Regularization
Chapter 5: Basis Expansion and Regularization DD3364 April 1, 2012 Introduction Main idea Moving beyond linearity Augment the vector of inputs X with additional variables. These are transformations of
More informationNormals of subdivision surfaces and their control polyhedra
Computer Aided Geometric Design 24 (27 112 116 www.elsevier.com/locate/cagd Normals of subdivision surfaces and their control polyhedra I. Ginkel a,j.peters b,,g.umlauf a a University of Kaiserslautern,
More informationNonparametric Mixed-Effects Models for Longitudinal Data
Nonparametric Mixed-Effects Models for Longitudinal Data Zhang Jin-Ting Dept of Stat & Appl Prob National University of Sinagpore University of Seoul, South Korea, 7 p.1/26 OUTLINE The Motivating Data
More informationMar. 20 Math 2335 sec 001 Spring 2014
Mar. 20 Math 2335 sec 001 Spring 2014 Chebyshev Polynomials Definition: For an integer n 0 define the function ( ) T n (x) = cos n cos 1 (x), 1 x 1. It can be shown that T n is a polynomial of degree n.
More informationKnot-Placement to Avoid Over Fitting in B-Spline Scedastic Smoothing. Hirokazu Yanagihara* and Megu Ohtaki**
Knot-Placement to Avoid Over Fitting in B-Spline Scedastic Smoothing Hirokazu Yanagihara* and Megu Ohtaki** * Department of Mathematics, Faculty of Science, Hiroshima University, Higashi-Hiroshima, 739-8529,
More informationA Note on Bivariate Smoothing for Two-Dimensional Functional Data
International Journal of Statistics and Probability; Vol. 2, No. 2; 2013 ISSN 1927-7032 E-ISSN 1927-7040 Published by Canadian Center of Science and Education A Note on Bivariate Smoothing for Two-Dimensional
More informationAssessing the Quality of the Natural Cubic Spline Approximation
Assessing the Quality of the Natural Cubic Spline Approximation AHMET SEZER ANADOLU UNIVERSITY Department of Statisticss Yunus Emre Kampusu Eskisehir TURKEY ahsst12@yahoo.com Abstract: In large samples,
More informationMoving Beyond Linearity
Moving Beyond Linearity The truth is never linear! 1/23 Moving Beyond Linearity The truth is never linear! r almost never! 1/23 Moving Beyond Linearity The truth is never linear! r almost never! But often
More informationGeneralized Additive Model
Generalized Additive Model by Huimin Liu Department of Mathematics and Statistics University of Minnesota Duluth, Duluth, MN 55812 December 2008 Table of Contents Abstract... 2 Chapter 1 Introduction 1.1
More informationNonparametric Regression
Nonparametric Regression John Fox Department of Sociology McMaster University 1280 Main Street West Hamilton, Ontario Canada L8S 4M4 jfox@mcmaster.ca February 2004 Abstract Nonparametric regression analysis
More informationNonparametric Risk Attribution for Factor Models of Portfolios. October 3, 2017 Kellie Ottoboni
Nonparametric Risk Attribution for Factor Models of Portfolios October 3, 2017 Kellie Ottoboni Outline The problem Page 3 Additive model of returns Page 7 Euler s formula for risk decomposition Page 11
More informationThis is called a linear basis expansion, and h m is the mth basis function For example if X is one-dimensional: f (X) = β 0 + β 1 X + β 2 X 2, or
STA 450/4000 S: February 2 2005 Flexible modelling using basis expansions (Chapter 5) Linear regression: y = Xβ + ɛ, ɛ (0, σ 2 ) Smooth regression: y = f (X) + ɛ: f (X) = E(Y X) to be specified Flexible
More informationLinear Methods for Regression and Shrinkage Methods
Linear Methods for Regression and Shrinkage Methods Reference: The Elements of Statistical Learning, by T. Hastie, R. Tibshirani, J. Friedman, Springer 1 Linear Regression Models Least Squares Input vectors
More informationA comparison of spline methods in R for building explanatory models
A comparison of spline methods in R for building explanatory models Aris Perperoglou on behalf of TG2 STRATOS Initiative, University of Essex ISCB2017 Aris Perperoglou Spline Methods in R ISCB2017 1 /
More informationImproved smoothing spline regression by combining estimates of dierent smoothness
Available online at www.sciencedirect.com Statistics & Probability Letters 67 (2004) 133 140 Improved smoothing spline regression by combining estimates of dierent smoothness Thomas C.M. Lee Department
More informationNo more questions will be added
CSC 2545, Spring 2017 Kernel Methods and Support Vector Machines Assignment 2 Due at the start of class, at 2:10pm, Thurs March 23. No late assignments will be accepted. The material you hand in should
More informationStraightforward intermediate rank tensor product smoothing in mixed models
Straightforward intermediate rank tensor product smoothing in mixed models Simon N. Wood, Fabian Scheipl, Julian J. Faraway January 6, 2012 Abstract Tensor product smooths provide the natural way of representing
More informationA C 2 Four-Point Subdivision Scheme with Fourth Order Accuracy and its Extensions
A C 2 Four-Point Subdivision Scheme with Fourth Order Accuracy and its Extensions Nira Dyn School of Mathematical Sciences Tel Aviv University Michael S. Floater Department of Informatics University of
More informationParameterization of triangular meshes
Parameterization of triangular meshes Michael S. Floater November 10, 2009 Triangular meshes are often used to represent surfaces, at least initially, one reason being that meshes are relatively easy to
More information(Spline, Bezier, B-Spline)
(Spline, Bezier, B-Spline) Spline Drafting terminology Spline is a flexible strip that is easily flexed to pass through a series of design points (control points) to produce a smooth curve. Spline curve
More informationLast time... Bias-Variance decomposition. This week
Machine learning, pattern recognition and statistical data modelling Lecture 4. Going nonlinear: basis expansions and splines Last time... Coryn Bailer-Jones linear regression methods for high dimensional
More informationLinear Penalized Spline Model Estimation Using Ranked Set Sampling Technique
Linear Penalized Spline Model Estimation Using Ranked Set Sampling Technique Al Kadiri M. A. Abstract Benefits of using Ranked Set Sampling (RSS) rather than Simple Random Sampling (SRS) are indeed significant
More informationNonparametric Approaches to Regression
Nonparametric Approaches to Regression In traditional nonparametric regression, we assume very little about the functional form of the mean response function. In particular, we assume the model where m(xi)
More informationAPPM/MATH Problem Set 4 Solutions
APPM/MATH 465 Problem Set 4 Solutions This assignment is due by 4pm on Wednesday, October 16th. You may either turn it in to me in class on Monday or in the box outside my office door (ECOT 35). Minimal
More informationEstimating Curves and Derivatives with Parametric Penalized Spline Smoothing
Estimating Curves and Derivatives with Parametric Penalized Spline Smoothing Jiguo Cao, Jing Cai Department of Statistics & Actuarial Science, Simon Fraser University, Burnaby, BC, Canada V5A 1S6 Liangliang
More informationSpline Curves. Spline Curves. Prof. Dr. Hans Hagen Algorithmic Geometry WS 2013/2014 1
Spline Curves Prof. Dr. Hans Hagen Algorithmic Geometry WS 2013/2014 1 Problem: In the previous chapter, we have seen that interpolating polynomials, especially those of high degree, tend to produce strong
More informationPackage gamm4. July 25, Index 10
Version 0.2-5 Author Simon Wood, Fabian Scheipl Package gamm4 July 25, 2017 Maintainer Simon Wood Title Generalized Additive Mixed Models using 'mgcv' and 'lme4' Description
More informationGENREG DID THAT? Clay Barker Research Statistician Developer JMP Division, SAS Institute
GENREG DID THAT? Clay Barker Research Statistician Developer JMP Division, SAS Institute GENREG WHAT IS IT? The Generalized Regression platform was introduced in JMP Pro 11 and got much better in version
More informationParametric Surfaces. Michael Kazhdan ( /657) HB , FvDFH 11.2
Parametric Surfaces Michael Kazhdan (601.457/657) HB 10.6 -- 10.9, 10.1 FvDFH 11.2 Announcement OpenGL review session: When: Wednesday (10/1) @ 7:00-9:00 PM Where: Olin 05 Cubic Splines Given a collection
More informationLecture 24: Generalized Additive Models Stat 704: Data Analysis I, Fall 2010
Lecture 24: Generalized Additive Models Stat 704: Data Analysis I, Fall 2010 Tim Hanson, Ph.D. University of South Carolina T. Hanson (USC) Stat 704: Data Analysis I, Fall 2010 1 / 26 Additive predictors
More informationSee the course website for important information about collaboration and late policies, as well as where and when to turn in assignments.
COS Homework # Due Tuesday, February rd See the course website for important information about collaboration and late policies, as well as where and when to turn in assignments. Data files The questions
More informationNonparametric Regression (and Classification)
Nonparametric Regression (and Classification) Statistical Machine Learning, Spring 217 Ryan Tibshirani (with Larry Wasserman) 1 Introduction, and k-nearest-neighbors 1.1 Basic setup Given a random pair
More informationSYS 6021 Linear Statistical Models
SYS 6021 Linear Statistical Models Project 2 Spam Filters Jinghe Zhang Summary The spambase data and time indexed counts of spams and hams are studied to develop accurate spam filters. Static models are
More informationCPSC 340: Machine Learning and Data Mining. Regularization Fall 2016
CPSC 340: Machine Learning and Data Mining Regularization Fall 2016 Assignment 2: Admin 2 late days to hand it in Friday, 3 for Monday. Assignment 3 is out. Due next Wednesday (so we can release solutions
More information3D Modeling Parametric Curves & Surfaces
3D Modeling Parametric Curves & Surfaces Shandong University Spring 2012 3D Object Representations Raw data Point cloud Range image Polygon soup Solids Voxels BSP tree CSG Sweep Surfaces Mesh Subdivision
More informationInterpolation by Spline Functions
Interpolation by Spline Functions Com S 477/577 Sep 0 007 High-degree polynomials tend to have large oscillations which are not the characteristics of the original data. To yield smooth interpolating curves
More informationRobust line segmentation for handwritten documents
Robust line segmentation for handwritten documents Kamal Kuzhinjedathu, Harish Srinivasan and Sargur Srihari Center of Excellence for Document Analysis and Recognition (CEDAR) University at Buffalo, State
More informationNormals of subdivision surfaces and their control polyhedra
Normals of subdivision surfaces and their control polyhedra I. Ginkel, a, J. Peters b, and G. Umlauf a, a University of Kaiserslautern, Germany b University of Florida, Gainesville, FL, USA Abstract For
More informationarxiv: v2 [stat.ap] 14 Nov 2016
The Cave of Shadows Addressing the human factor with generalized additive mixed models Harald Baayen a Shravan Vasishth b Reinhold Kliegl b Douglas Bates c arxiv:1511.03120v2 [stat.ap] 14 Nov 2016 a University
More informationAn introduction to interpolation and splines
An introduction to interpolation and splines Kenneth H. Carpenter, EECE KSU November 22, 1999 revised November 20, 2001, April 24, 2002, April 14, 2004 1 Introduction Suppose one wishes to draw a curve
More informationSmoothing and Forecasting Mortality Rates with P-splines. Iain Currie. Data and problem. Plan of talk
Smoothing and Forecasting Mortality Rates with P-splines Iain Currie Heriot Watt University Data and problem Data: CMI assured lives : 20 to 90 : 1947 to 2002 Problem: forecast table to 2046 London, June
More informationHierarchical generalized additive models: an introduction with mgcv
Hierarchical generalized additive models: an introduction with mgcv Eric J Pedersen Corresp., 1, 2, David L. Miller 3, 4, Gavin L. Simpson 5, Noam Ross 6 1 Northwest Atlantic Fisheries Center, Fisheries
More informationRational Bezier Curves
Rational Bezier Curves Use of homogeneous coordinates Rational spline curve: define a curve in one higher dimension space, project it down on the homogenizing variable Mathematical formulation: n P(u)
More information3D Modeling Parametric Curves & Surfaces. Shandong University Spring 2013
3D Modeling Parametric Curves & Surfaces Shandong University Spring 2013 3D Object Representations Raw data Point cloud Range image Polygon soup Surfaces Mesh Subdivision Parametric Implicit Solids Voxels
More informationCubic Spline Questions
Cubic Spline Questions. Find natural cubic splines which interpolate the following dataset of, points:.0,.,.,.0, 7.0,.,.0,0.; estimate the value for. Solution: Step : Use the n- cubic spline equations
More informationLinear Model Selection and Regularization. especially usefull in high dimensions p>>100.
Linear Model Selection and Regularization especially usefull in high dimensions p>>100. 1 Why Linear Model Regularization? Linear models are simple, BUT consider p>>n, we have more features than data records
More informationBASIC LOESS, PBSPLINE & SPLINE
CURVES AND SPLINES DATA INTERPOLATION SGPLOT provides various methods for fitting smooth trends to scatterplot data LOESS An extension of LOWESS (Locally Weighted Scatterplot Smoothing), uses locally weighted
More informationLecture 3 Box-partitions and dimension of spline spaces over Box-partition
Lecture 3 Box-partitions and dimension of spline spaces over Box-partition Definition of LR B-splines some geometric properties Tor Dokken CIME-EMS Summer School June 8 - June, 0 Cetraro, Italy Box-partitions
More informationConsider functions such that then satisfies these properties: So is represented by the cubic polynomials on on and on.
1 of 9 3/1/2006 2:28 PM ne previo Next: Trigonometric Interpolation Up: Spline Interpolation Previous: Piecewise Linear Case Cubic Splines A piece-wise technique which is very popular. Recall the philosophy
More informationSinusoidal Data Worksheet
Sinusoidal Data Worksheet West Coast Tidal Analysis: Fill in the following chart for the low tide and high tides per day for the researched two-day period (so four low tides and high tides all inter-distributed)
More informationModelling a Road Using Spline Interpolation
Modelling a Road Using Spline Interpolation Kendall Atkinson Dept of Computer Science Dept of Mathematics The University of Iowa Iowa City, Iowa 54 February 6, Abstract We study the use of cubic spline
More informationFebruary 2017 (1/20) 2 Piecewise Polynomial Interpolation 2.2 (Natural) Cubic Splines. MA378/531 Numerical Analysis II ( NA2 )
f f f f f (/2).9.8.7.6.5.4.3.2. S Knots.7.6.5.4.3.2. 5 5.2.8.6.4.2 S Knots.2 5 5.9.8.7.6.5.4.3.2..9.8.7.6.5.4.3.2. S Knots 5 5 S Knots 5 5 5 5.35.3.25.2.5..5 5 5.6.5.4.3.2. 5 5 4 x 3 3.5 3 2.5 2.5.5 5
More informationDeposited on: 07 September 2010
Lee, D. and Shaddick, G. (2007) Time-varying coefficient models for the analysis of air pollution and health outcome data. Biometrics, 63 (4). pp. 1253-1261. ISSN 0006-341X http://eprints.gla.ac.uk/36767
More informationA C 2 Four-Point Subdivision Scheme with Fourth Order Accuracy and its Extensions
A C 2 Four-Point Subdivision Scheme with Fourth Order Accuracy and its Extensions Nira Dyn Michael S. Floater Kai Hormann Abstract. We present a new four-point subdivision scheme that generates C 2 curves.
More informationEstimating survival from Gray s flexible model. Outline. I. Introduction. I. Introduction. I. Introduction
Estimating survival from s flexible model Zdenek Valenta Department of Medical Informatics Institute of Computer Science Academy of Sciences of the Czech Republic I. Introduction Outline II. Semi parametric
More informationGoals of the Lecture. SOC6078 Advanced Statistics: 9. Generalized Additive Models. Limitations of the Multiple Nonparametric Models (2)
SOC6078 Advanced Statistics: 9. Generalized Additive Models Robert Andersen Department of Sociology University of Toronto Goals of the Lecture Introduce Additive Models Explain how they extend from simple
More informationLecture 22 The Generalized Lasso
Lecture 22 The Generalized Lasso 07 December 2015 Taylor B. Arnold Yale Statistics STAT 312/612 Class Notes Midterm II - Due today Problem Set 7 - Available now, please hand in by the 16th Motivation Today
More informationFall CSCI 420: Computer Graphics. 4.2 Splines. Hao Li.
Fall 2014 CSCI 420: Computer Graphics 4.2 Splines Hao Li http://cs420.hao-li.com 1 Roller coaster Next programming assignment involves creating a 3D roller coaster animation We must model the 3D curve
More informationCS130 : Computer Graphics Curves. Tamar Shinar Computer Science & Engineering UC Riverside
CS130 : Computer Graphics Curves Tamar Shinar Computer Science & Engineering UC Riverside Design considerations local control of shape design each segment independently smoothness and continuity ability
More informationCHAPTER 6 Parametric Spline Curves
CHAPTER 6 Parametric Spline Curves When we introduced splines in Chapter 1 we focused on spline curves, or more precisely, vector valued spline functions. In Chapters 2 and 4 we then established the basic
More informationCOMPUTER TRAINING CENTER
Excel 2007 Introduction to Spreadsheets COMPUTER TRAINING CENTER 1515 SW 10 th Avenue Topeka KS 66604-1374 785.580.4606 class@tscpl.org www.tscpl.org Excel 2007 Introduction 1 Office button Quick Access
More informationSung-Eui Yoon ( 윤성의 )
CS480: Computer Graphics Curves and Surfaces Sung-Eui Yoon ( 윤성의 ) Course URL: http://jupiter.kaist.ac.kr/~sungeui/cg Today s Topics Surface representations Smooth curves Subdivision 2 Smooth Curves and
More informationGeneralized barycentric coordinates
Generalized barycentric coordinates Michael S. Floater August 20, 2012 In this lecture, we review the definitions and properties of barycentric coordinates on triangles, and study generalizations to convex,
More informationSemiparametric Tools: Generalized Additive Models
Semiparametric Tools: Generalized Additive Models Jamie Monogan Washington University November 8, 2010 Jamie Monogan (WUStL) Generalized Additive Models November 8, 2010 1 / 33 Regression Splines Choose
More informationTECHNICAL REPORT NO December 11, 2001
DEPARTMENT OF STATISTICS University of Wisconsin 2 West Dayton St. Madison, WI 5376 TECHNICAL REPORT NO. 48 December, 2 Penalized Log Likelihood Density Estimation, via Smoothing-Spline ANOVA and rangacv
More informationNONPARAMETRIC REGRESSION SPLINES FOR GENERALIZED LINEAR MODELS IN THE PRESENCE OF MEASUREMENT ERROR
NONPARAMETRIC REGRESSION SPLINES FOR GENERALIZED LINEAR MODELS IN THE PRESENCE OF MEASUREMENT ERROR J. D. Maca July 1, 1997 Abstract The purpose of this manual is to demonstrate the usage of software for
More informationPartial Calibration and Mirror Shape Recovery for Non-Central Catadioptric Systems
Partial Calibration and Mirror Shape Recovery for Non-Central Catadioptric Systems Abstract In this paper we present a method for mirror shape recovery and partial calibration for non-central catadioptric
More informationPosition Error Reduction of Kinematic Mechanisms Using Tolerance Analysis and Cost Function
Position Error Reduction of Kinematic Mechanisms Using Tolerance Analysis and Cost Function B.Moetakef-Imani, M.Pour Department of Mechanical Engineering, Faculty of Engineering, Ferdowsi University of
More informationAdaptive Estimation of Distributions using Exponential Sub-Families Alan Gous Stanford University December 1996 Abstract: An algorithm is presented wh
Adaptive Estimation of Distributions using Exponential Sub-Families Alan Gous Stanford University December 1996 Abstract: An algorithm is presented which, for a large-dimensional exponential family G,
More informationCurve and Surface Fitting with Splines. PAUL DIERCKX Professor, Computer Science Department, Katholieke Universiteit Leuven, Belgium
Curve and Surface Fitting with Splines PAUL DIERCKX Professor, Computer Science Department, Katholieke Universiteit Leuven, Belgium CLARENDON PRESS OXFORD 1995 - Preface List of Figures List of Tables
More informationDS Machine Learning and Data Mining I. Alina Oprea Associate Professor, CCIS Northeastern University
DS 4400 Machine Learning and Data Mining I Alina Oprea Associate Professor, CCIS Northeastern University January 24 2019 Logistics HW 1 is due on Friday 01/25 Project proposal: due Feb 21 1 page description
More informationContents 10. Graphs of Trigonometric Functions
Contents 10. Graphs of Trigonometric Functions 2 10.2 Sine and Cosine Curves: Horizontal and Vertical Displacement...... 2 Example 10.15............................... 2 10.3 Composite Sine and Cosine
More informationOrganizing and Summarizing Data
1 Organizing and Summarizing Data Key Definitions Frequency Distribution: This lists each category of data and how often they occur. : The percent of observations within the one of the categories. This
More informationDiffusion Wavelets for Natural Image Analysis
Diffusion Wavelets for Natural Image Analysis Tyrus Berry December 16, 2011 Contents 1 Project Description 2 2 Introduction to Diffusion Wavelets 2 2.1 Diffusion Multiresolution............................
More informationCS-184: Computer Graphics. Today
CS-84: Computer Graphics Lecture #5: Curves and Surfaces Prof. James O Brien University of California, Berkeley V25F-5-. Today General curve and surface representations Splines and other polynomial bases
More informationBernstein-Bezier Splines on the Unit Sphere. Victoria Baramidze. Department of Mathematics. Western Illinois University
Bernstein-Bezier Splines on the Unit Sphere Victoria Baramidze Department of Mathematics Western Illinois University ABSTRACT I will introduce scattered data fitting problems on the sphere and discuss
More information