Inequality Constrained Spline Interpolation
|
|
- Albert Charles
- 5 years ago
- Views:
Transcription
1 Inequality Constrained Spline Interpolation Scott Kersey Workshop on Spline Approximation and Applications on Carl de Boor s 80th Birthday Institute for Mathematical Sciences National University of Singapore December Dec 4 6, 2017 December 5, 2017 (IMS Spline Workshop) Spline Interpolation December 5, / 58
2 Abstract Abstract The variational problem of best inequality constrained spline interpolation offers a generalization of spline interpolation that smooths rough data while keeping precise control on tolerances (error) at data points. While first studied in the 1960s, this problem has received just modest attention compared to it s contemporaries best spline interpolation, the smoothing spline, least squares splines, splines in tension and quasi-interpolation resulting in just a handful of papers and specialized implementations. While no commercial implementations seem readily available (such as IMSL), the problem is justifiably nonlinear and easily handled by methods of optimization. However, we think that by exploiting specific structure of splines one may produce a simpler and/or more efficient implementation. It is the aim of this work to attempt this. In this talk we describe an implementation based on the active set method in optimization combined with solutions to the problem of best spline interpolation. We also show how inequality constrained splines can be used to produce good or optimal knots, and we describe applications to parametric curves and surfaces in CAGD. (IMS Spline Workshop) Spline Interpolation December 5, / 58
3 (IMS Spline Workshop) Spline Interpolation December 5, / 58
4 Distinguished Lecturer Series (IMS Spline Workshop) Spline Interpolation December 5, / 58
5 What is a Spline? (IMS Spline Workshop) Spline Interpolation December 5, / 58
6 (IMS Spline Workshop) Spline Interpolation December 5, / 58
7 Overview of Talk (IMS Spline Workshop) Spline Interpolation December 5, / 58
8 Overview of Talk 1 Some Variational Spline Problems (IMS Spline Workshop) Spline Interpolation December 5, / 58
9 Overview of Talk 1 Some Variational Spline Problems 2 Quadratic Programming (IMS Spline Workshop) Spline Interpolation December 5, / 58
10 Overview of Talk 1 Some Variational Spline Problems 2 Quadratic Programming 3 Minimal Properties and Optimality for Inequality Splines (IMS Spline Workshop) Spline Interpolation December 5, / 58
11 Overview of Talk 1 Some Variational Spline Problems 2 Quadratic Programming 3 Minimal Properties and Optimality for Inequality Splines 4 Ranking Knots choosing good ones (IMS Spline Workshop) Spline Interpolation December 5, / 58
12 Overview of Talk 1 Some Variational Spline Problems 2 Quadratic Programming 3 Minimal Properties and Optimality for Inequality Splines 4 Ranking Knots choosing good ones 5 Applications to Parametric Curves (IMS Spline Workshop) Spline Interpolation December 5, / 58
13 Part I: Some Classical (Variational) Spline Problems Best linearized spline interpolation (Schoenberg,Holloday,de Boor) Smoothing splines (Schoenberg, Reinch, Wahba) Least squares splines (de Boor and Rice) Splines in tension (Schweikart, Nielson) Quasi-interpolation (de Boor and Fix) Best inequality constrained spline interpolation 1 Titanium Heat data from: Carl de Boor and John Rice, Least Squares Cubic Spline Approximation I Fixed Knots (IMS Spline Workshop) Spline Interpolation December 5, / 58
14 Remark All these problems were developed by the 1960 s or early 70 s. (IMS Spline Workshop) Spline Interpolation December 5, / 58
15 Remark All these problems were developed by the 1960 s or early 70 s. The first 5 problems have gotten much more attention (more literature) than the inequality problem. (IMS Spline Workshop) Spline Interpolation December 5, / 58
16 Remark All these problems were developed by the 1960 s or early 70 s. The first 5 problems have gotten much more attention (more literature) than the inequality problem. I can t think of any standard software package that solves the inequality problem. (IMS Spline Workshop) Spline Interpolation December 5, / 58
17 Remark All these problems were developed by the 1960 s or early 70 s. The first 5 problems have gotten much more attention (more literature) than the inequality problem. I can t think of any standard software package that solves the inequality problem. Maybe the reason is that the inequality problem is difficult due to non-lineararities. (IMS Spline Workshop) Spline Interpolation December 5, / 58
18 Remark All these problems were developed by the 1960 s or early 70 s. The first 5 problems have gotten much more attention (more literature) than the inequality problem. I can t think of any standard software package that solves the inequality problem. Maybe the reason is that the inequality problem is difficult due to non-lineararities. Or, perhaps the thought is optimization software will solve it. (IMS Spline Workshop) Spline Interpolation December 5, / 58
19 Remark All these problems were developed by the 1960 s or early 70 s. The first 5 problems have gotten much more attention (more literature) than the inequality problem. I can t think of any standard software package that solves the inequality problem. Maybe the reason is that the inequality problem is difficult due to non-lineararities. Or, perhaps the thought is optimization software will solve it. Goal The goal of this study is to develop an efficient program to solve the inequality problem by combining spline and optimization methods. (IMS Spline Workshop) Spline Interpolation December 5, / 58
20 Remark All these problems were developed by the 1960 s or early 70 s. The first 5 problems have gotten much more attention (more literature) than the inequality problem. I can t think of any standard software package that solves the inequality problem. Maybe the reason is that the inequality problem is difficult due to non-lineararities. Or, perhaps the thought is optimization software will solve it. Goal The goal of this study is to develop an efficient program to solve the inequality problem by combining spline and optimization methods. In doing so, we also want to generate an optimal set of knots, and generalize to parametric curves and surfaces. (IMS Spline Workshop) Spline Interpolation December 5, / 58
21 Best Inequality Constrained Spline Interpolation Linearized bending energy: E(f ) := b a D m f (t) 2 dt. (IMS Spline Workshop) Spline Interpolation December 5, / 58
22 Best Inequality Constrained Spline Interpolation Linearized bending energy: E(f ) := b a D m f (t) 2 dt. Data: (a i, b i ) : i = 0,..., n. (IMS Spline Workshop) Spline Interpolation December 5, / 58
23 Best Inequality Constrained Spline Interpolation Linearized bending energy: E(f ) := b a D m f (t) 2 dt. Data: (a i, b i ) : i = 0,..., n. Goal: minimize{e(f ) : a i f (t i ) b i } (IMS Spline Workshop) Spline Interpolation December 5, / 58
24 Best Inequality Constrained Spline Interpolation Linearized bending energy: E(f ) := b a D m f (t) 2 dt. Data: (a i, b i ) : i = 0,..., n. Goal: minimize{e(f ) : a i f (t i ) b i } Note that we can express the data as tolerances y i ± ε i. Hence, the terminology near-interpolation. (IMS Spline Workshop) Spline Interpolation December 5, / 58
25 Best Inequality Constrained Spline Interpolation Linearized bending energy: E(f ) := b a D m f (t) 2 dt. Data: (a i, b i ) : i = 0,..., n. Goal: minimize{e(f ) : a i f (t i ) b i } Note that we can express the data as tolerances y i ± ε i. Hence, the terminology near-interpolation. Carl suggested to call these gates. Thus, we can say best interpolation to gates. (IMS Spline Workshop) Spline Interpolation December 5, / 58
26 Best Inequality Constrained Spline Interpolation Linearized bending energy: E(f ) := b a D m f (t) 2 dt. Data: (a i, b i ) : i = 0,..., n. Goal: minimize{e(f ) : a i f (t i ) b i } Note that we can express the data as tolerances y i ± ε i. Hence, the terminology near-interpolation. Carl suggested to call these gates. Thus, we can say best interpolation to gates. Perhaps we can say set-valued interpolation, borrowing terminology from Nira Dyn. (IMS Spline Workshop) Spline Interpolation December 5, / 58
27 Literature on Inequality Constrained Splines Inequality Splines (Atteia 67) Splines on Convex Sets (Atteia 67) Splines on Convex Sets (Laurent 69) Spline via Optimal Control (Mangasarian and Schumaker 69) Construction of Smoothing Splines by Quadratic Programming (Budkina 2000) Near Interpolation for Parametric Curves (Kersey 2000, 03a, 03b) Multivariate Smoothing Splines with Obstacles (Leetma and Oja 2009) (IMS Spline Workshop) Spline Interpolation December 5, / 58
28 Immediate Benefits of the Inequality-Constrained Spline (IMS Spline Workshop) Spline Interpolation December 5, / 58
29 Immediate Benefits of the Inequality-Constrained Spline Benefits: The inequality spline can smooth rough data (like a smoothing spline and least squares spline). (IMS Spline Workshop) Spline Interpolation December 5, / 58
30 Immediate Benefits of the Inequality-Constrained Spline Benefits: The inequality spline can smooth rough data (like a smoothing spline and least squares spline). The error is precisely controlled at the data sites (unlike smoothing and least squares splines). This may be useful when designing parts with given tolerances, or when data is inaccurate. (IMS Spline Workshop) Spline Interpolation December 5, / 58
31 Immediate Benefits of the Inequality-Constrained Spline Benefits: The inequality spline can smooth rough data (like a smoothing spline and least squares spline). The error is precisely controlled at the data sites (unlike smoothing and least squares splines). This may be useful when designing parts with given tolerances, or when data is inaccurate. The spline is determined by the active knots. Other knots fall away naturally, leaving a sparser set of optimal knots. (IMS Spline Workshop) Spline Interpolation December 5, / 58
32 Immediate Benefits of the Inequality-Constrained Spline Benefits: The inequality spline can smooth rough data (like a smoothing spline and least squares spline). The error is precisely controlled at the data sites (unlike smoothing and least squares splines). This may be useful when designing parts with given tolerances, or when data is inaccurate. The spline is determined by the active knots. Other knots fall away naturally, leaving a sparser set of optimal knots. Disadvantage: How to choose the a i, b i (or tolerances ε i ). (IMS Spline Workshop) Spline Interpolation December 5, / 58
33 Good Set of Knots Original data sites: 49. Interior knots: 13. (IMS Spline Workshop) Spline Interpolation December 5, / 58
34 Optimal Set of Knots (IMS Spline Workshop) Spline Interpolation December 5, / 58
35 Application: Data with Error Interpolation Near-Interpolation (IMS Spline Workshop) Spline Interpolation December 5, / 58
36 Part II: Quadratic Programming (IMS Spline Workshop) Spline Interpolation December 5, / 58
37 Part II: Quadratic Programming Spline: f = Nα. (IMS Spline Workshop) Spline Interpolation December 5, / 58
38 Part II: Quadratic Programming Spline: f = Nα. Linearized bending energy: E(f ) := b for H symmetric positive semidefinite. a D k f (t) 2 dt = α T Hα. (IMS Spline Workshop) Spline Interpolation December 5, / 58
39 Part II: Quadratic Programming Spline: f = Nα. Linearized bending energy: E(f ) := b a D k f (t) 2 dt = α T Hα. for H symmetric positive semidefinite. a i f (t i ) b i = Aα B. (IMS Spline Workshop) Spline Interpolation December 5, / 58
40 Part II: Quadratic Programming Spline: f = Nα. Linearized bending energy: E(f ) := b a D k f (t) 2 dt = α T Hα. for H symmetric positive semidefinite. a i f (t i ) b i = Aα B. Quadratic Programming Problem: minimize{α T Hα : Aα B} (IMS Spline Workshop) Spline Interpolation December 5, / 58
41 First Order Optimality Conditions of Karush-Kuhn Tucker (KKT): 2Hα + A T µ = 0 Aα = B µ 2 (B Aα) = 0 µ 0 (IMS Spline Workshop) Spline Interpolation December 5, / 58
42 Solving Quadratic Programming Problems by the Active Set Method (IMS Spline Workshop) Spline Interpolation December 5, / 58
43 Solving Quadratic Programming Problems by the Active Set Method Start with an initial feasible point α 0. For j = 0, 1,... 1 Get the active set (set where inequality constraints are equality). 2 Solve a constrained least squares program on the active set. 3 Compute Lagrange multipliers µ. 4 Add or remove just one active constraint. 5 Set up new active set and go back to step 2. 6 Terminate when µ 0 for all inequality constraints. (IMS Spline Workshop) Spline Interpolation December 5, / 58
44 Solving Quadratic Programming Problems by the Active Set Method Start with an initial feasible point α 0. For j = 0, 1,... 1 Get the active set (set where inequality constraints are equality). 2 Solve a constrained least squares program on the active set. 3 Compute Lagrange multipliers µ. 4 Add or remove just one active constraint. 5 Set up new active set and go back to step 2. 6 Terminate when µ 0 for all inequality constraints. Remark The active set converges in finite steps (under certain conditions). (IMS Spline Workshop) Spline Interpolation December 5, / 58
45 Solving Quadratic Programming Problems by the Active Set Method Start with an initial feasible point α 0. For j = 0, 1,... 1 Get the active set (set where inequality constraints are equality). 2 Solve a constrained least squares program on the active set. 3 Compute Lagrange multipliers µ. 4 Add or remove just one active constraint. 5 Set up new active set and go back to step 2. 6 Terminate when µ 0 for all inequality constraints. Remark The active set converges in finite steps (under certain conditions). The constrained least squares problem is best spline interpolation. (IMS Spline Workshop) Spline Interpolation December 5, / 58
46 Solving Quadratic Programming Problems by the Active Set Method Start with an initial feasible point α 0. For j = 0, 1,... 1 Get the active set (set where inequality constraints are equality). 2 Solve a constrained least squares program on the active set. 3 Compute Lagrange multipliers µ. 4 Add or remove just one active constraint. 5 Set up new active set and go back to step 2. 6 Terminate when µ 0 for all inequality constraints. Remark The active set converges in finite steps (under certain conditions). The constrained least squares problem is best spline interpolation. What is the meaning of the Lagrange mutipliers µ i? (IMS Spline Workshop) Spline Interpolation December 5, / 58
47 Part III: Minimimal Properties and Optimality Best Interpolation: Linearized bending energy: E(f ) := b a D k f (t) 2 dt. (IMS Spline Workshop) Spline Interpolation December 5, / 58
48 Part III: Minimimal Properties and Optimality Best Interpolation: Linearized bending energy: E(f ) := b a D k f (t) 2 dt. Data: (x 0, y 0),..., (x n, y n). (IMS Spline Workshop) Spline Interpolation December 5, / 58
49 Part III: Minimimal Properties and Optimality Best Interpolation: Linearized bending energy: E(f ) := b a D k f (t) 2 dt. Data: (x 0, y 0),..., (x n, y n). Problem: minimize{e(f ) : f (t i ) = y i, f W k,2 (a, b)}. (IMS Spline Workshop) Spline Interpolation December 5, / 58
50 Part III: Minimimal Properties and Optimality Best Interpolation: Linearized bending energy: E(f ) := b a D k f (t) 2 dt. Data: (x 0, y 0),..., (x n, y n). Problem: minimize{e(f ) : f (t i ) = y i, f W k,2 (a, b)}. Solution: f is a natural spline of order 2k and smoothness k. (IMS Spline Workshop) Spline Interpolation December 5, / 58
51 Literature on Best Interpolation: Demonstrates for k = 2, Best Linearized Cubic Spline Interpolation (Schoenberg 1946) First Minimum Property for k = 2 (Holladay 1957) Minimum Properties and Best Approximation for general k (de Boor 1963) Abstract Splines and Projections (de Boor and Lynch 1965) (IMS Spline Workshop) Spline Interpolation December 5, / 58
52 Spline Interpolation using Lagrange Multipler theory (IMS Spline Workshop) Spline Interpolation December 5, / 58
53 Spline Interpolation using Lagrange Multipler theory Best interpolation minimize{e(f ) : f (t i ) = y i }. (IMS Spline Workshop) Spline Interpolation December 5, / 58
54 Spline Interpolation using Lagrange Multipler theory Best interpolation minimize{e(f ) : f (t i ) = y i }. Lagrangian: L(f, µ) = b a D k f (t) 2 dt + i = Tf, Tf L2 + µ, Λf y l2. µ i (f (t i ) y i ) (IMS Spline Workshop) Spline Interpolation December 5, / 58
55 Spline Interpolation using Lagrange Multipler theory Best interpolation minimize{e(f ) : f (t i ) = y i }. Lagrangian: L(f, µ) = b a D k f (t) 2 dt + i = Tf, Tf L2 + µ, Λf y l2. µ i (f (t i ) y i ) Theorem The best spline satisfies: 2T Tf + Λ µ = 0. (IMS Spline Workshop) Spline Interpolation December 5, / 58
56 Proof of Theorem Proof. Let g be a variation. d L(f + αg, µ) = d T (f + αg), T (f + αg) dα α=0 dα L2 + µ, Λ(f + αg) y l2 α=0 = 2 Tf, Tg L2 + µ, Λg l2 = 2 T Tf, g L2 + Λ µ, g L2 = 2T Tf + Λ µ, g L2. Since true for all variations, we have the result. (IMS Spline Workshop) Spline Interpolation December 5, / 58
57 Optimality and Lagrange Multipliers for Spline Interpolation Theorem The Lagrange Multipliers are µ i = 2 jmp i D 2k 1 f. The best spline function satisfies: Λ (2 JmpD 2k 1 f + µ) = 0. (IMS Spline Workshop) Spline Interpolation December 5, / 58
58 Inequality Spline Interpolation using Lagrange Multipler theory (IMS Spline Workshop) Spline Interpolation December 5, / 58
59 Inequality Spline Interpolation using Lagrange Multipler theory Best near-interpolation minimize{e(f ) : a i f (t i ) b i }. (IMS Spline Workshop) Spline Interpolation December 5, / 58
60 Inequality Spline Interpolation using Lagrange Multipler theory Best near-interpolation minimize{e(f ) : a i f (t i ) b i }. Lagrangian: L(f, µ) = b a D k f (t) 2 dt + i µ + i (f (t i ) a i ) i µ i (f (t i ) b i ). (IMS Spline Workshop) Spline Interpolation December 5, / 58
61 Inequality Spline Interpolation using Lagrange Multipler theory Best near-interpolation minimize{e(f ) : a i f (t i ) b i }. Lagrangian: L(f, µ) = b a D k f (t) 2 dt + i µ + i (f (t i ) a i ) i µ i (f (t i ) b i ). Theorem The Lagrange Multipliers are µ i = 2 jmp i D 2k 1 f with µ i := µ + i µ i. The best spline function satisfies: Λ (2 JmpD 2k 1 f + µ) = 0. with at most one of µ ± i nonzero for each i. (IMS Spline Workshop) Spline Interpolation December 5, / 58
62 Solving Best Inequality Spline Problem by csapni() (IMS Spline Workshop) Spline Interpolation December 5, / 58
63 Solving Best Inequality Spline Problem by csapni() Start with an initial feasible point α 0. For j = 0, 1,... 1 Get the active set (set where inequality constraints are equality). 2 Solve the problem of Best Interpolation using csape(). 3 Compute Lagrange multipliers µ = Jmpf 2k 1. 4 Add or remove just one active constraint. 5 Set up new active set and go back to step 2. 6 Terminate when µ 0 for all inequality constraints. (IMS Spline Workshop) Spline Interpolation December 5, / 58
64 Remarks about csapni() Remark (IMS Spline Workshop) Spline Interpolation December 5, / 58
65 Remarks about csapni() Remark The Matlab function csapne() is very fast with linear growth. It can handle 100, 000 interpolation points without a problem. (IMS Spline Workshop) Spline Interpolation December 5, / 58
66 Remarks about csapni() Remark The Matlab function csapne() is very fast with linear growth. It can handle 100, 000 interpolation points without a problem. The function csapni() is faster than a standard active set method, even after doing tricks with the factorizations. However, the growth rate is still greater than linear. (IMS Spline Workshop) Spline Interpolation December 5, / 58
67 Remarks about csapni() Remark The Matlab function csapne() is very fast with linear growth. It can handle 100, 000 interpolation points without a problem. The function csapni() is faster than a standard active set method, even after doing tricks with the factorizations. However, the growth rate is still greater than linear. Since there are approximately n/2 active constraints, there are going to be that many iterations on the outside loop. Since csape() has linear growth, we expect csapni() to be order n 2. (IMS Spline Workshop) Spline Interpolation December 5, / 58
68 Remarks about csapni() Remark Claim The Matlab function csapne() is very fast with linear growth. It can handle 100, 000 interpolation points without a problem. The function csapni() is faster than a standard active set method, even after doing tricks with the factorizations. However, the growth rate is still greater than linear. Since there are approximately n/2 active constraints, there are going to be that many iterations on the outside loop. Since csape() has linear growth, we expect csapni() to be order n 2. This problem can be solved in O(n) time. Our only hope to decrease the growth rate is to handle the the interpolation problem with constant time. As we remove or add a single knot (constraint), we can interpolate on a fixed window (say of 100 points) rather than all n points. Due to the exponential decay in spline interpolation, we expect that we can achieve this without loss of precision, giving us an order n implementation. (IMS Spline Workshop) Spline Interpolation December 5, / 58
69 Part IV: Good knots Ranking knots Remark Tpyically we have more knots than we want in interpolation or near-interpolation. Hence, we want to remove those less important. The questions is, how do we decide this? What we do is choose the m most influential knots, and remove the rest. How do we decide who survives? Based on experience with near-interpolation and the smoothing spline, we guess that the points with larger lagrange multipliers (i.e., larger jumps in jmp ti D 2k 1 f ) should be more valuable, so we eliminate those with smaller multipliers. Indeed, zero multipliers can be eliminated automatically without effect on the spline. (IMS Spline Workshop) Spline Interpolation December 5, / 58
70 Remark (Ranking knots) Keeping knots corresponding to large lagrange multipliers leads to a high concentration of knots in areas where just a couple would suffice. Hence, we need to consider a better rank function. (IMS Spline Workshop) Spline Interpolation December 5, / 58
71 Theorem (Balanced Rank Function) The rank function r i = rank(t i ) := (t i+1 t i 1 ) 3 λ i balances the polynomial error across the knot partition T. (IMS Spline Workshop) Spline Interpolation December 5, / 58
72 Literature on Balanced Intervals References (Primary Spline Approximation References Used) [db73] Good approximation by splines with variable knots, C. de Boor, in Spline Functions and Approximation (1973). [PGS78] Practical Guide to Splines, C. deboor (1978). (The program newknt()). [Y93] An algorithm for data reduction using splines with free knots, Y. Hu, IMA J. Num. Anal. 13 (1993) [CA93] Constructive Approximation, R. DeVore and G. Lorentz (1993) [NA98] Nonlinear Approximation, R. DeVore, Acta Numerica (1998) [R69] The Approximation of Functions II, J. Rice (1969) [PP87] Rational approximation of real functions, P. Petrushev and V. Popov, Encylopedia of Math and it s applications (28) (1987) (IMS Spline Workshop) Spline Interpolation December 5, / 58
73 Definition (Fixed Knot Spline Space) Let S r (T ) be the space of piecewise polynomials of order r (degree r 1) that break at the knots T = [0 = t 0 < t 1 t 2 t n = 1]. No smoothness is imposed on this space. This is a linear space. (IMS Spline Workshop) Spline Interpolation December 5, / 58
74 Example (Piecewise Constants: The Simplist Splines) s(t) = with α i = ( 1) i, 5 α i χ [ti 1,t i ) i=1 T = [0,.2,.4,.6,.8, 1] and χ [ti 1,t i ) = { 1 t [t i 1, t i ) 0 otherwise. (IMS Spline Workshop) Spline Interpolation December 5, / 58
75 Definition (Approximation Error) Approximation Error to a Function f (x) (in the inf norm on [0, 1]) s f := sup{ s(t) f (t) : t [0, 1]} Distance to Spline Space (in the inf norm) σ T,r (f ) := dist(f, S r (T )) = inf{ s f : s S r (T )}. s is a best approximation to f from S r (T ) if s f = σ T,r (f ). (IMS Spline Workshop) Spline Interpolation December 5, / 58
76 Example (Approximation to f (x) = x by Piecewise Constants) Let 4 s := α i χ [ti 1,t i ) i=1 with α = [.25,.5,.75, 1] and T = [0,.25,.5,.75, 1]. What is f s? Is s a b.a. from S 1(T )? If not, how could s(t) be improved? (IMS Spline Workshop) Spline Interpolation December 5, / 58
77 Theorem (Kahane61, Best Approximation by Piecewise Constants) Let f C([0, 1]). Then σ n,1(f ) M 2n for n = 1, 2, 3,... iff f BV [0, 1], with M := Var [0,1] (f ), with T var [a,b] := sup{ f (t i+1 ) f (t i ) : partitions T }. i=1 Proof of one direction of Kahane s theorem, from D98. Suppose that f BV [0, 1] with M := Var [0,1] (f ). Since f is continuous, we can find a partition T = [0 = t 0,..., t n < t n+1 = 1] such that Var [ti 1,t i ](f ) = M/n. Let s = i α iχ [ti 1,t i ) with α i = (f (t i 1 ) + f (t i ))/2. Then, s f M 2n. (IMS Spline Workshop) Spline Interpolation December 5, / 58
78 Example (f (x) = x) Since f is monotonic, M = var(, [0, 1]) = 1. Hence, M n = var(, [0, 1]) = Following the proof, we require var(, [t i 1, t i ]) = t i t i 1 = 1 5. This gives, t i = ( i n ) 2, and so T = [0,.04,.16,.36,.64, 1]. By choosing α i = ( i 1 n + i n ) /2, the error on each piece is 1 M = 1, hence 2 n 10 s f = M 2n =.1. (IMS Spline Workshop) Spline Interpolation December 5, / 58
79 Remark (Balanced Intervals) Kahane s balances the error on each piece. In this case, f s = max f s (t i 1, t i ) M i 2n. Hence, the error on the entire interval is balanced by the error on the worst interval, which is about the same. If f is continuous, these local errors are the same.. So by balancing the variation of a function, we are balancing the polynomial error. (IMS Spline Workshop) Spline Interpolation December 5, / 58
80 Theorem (Existence and Error from Fixed Knot Spline Space) For f C k ([0, 1]) with 0 k < r, there exists s S r (T ) such that s f C r h k ω(f (k), h). for some constant C r depending only on r and h := max{t i t i 1 : i = 1,..., n}, with ω(g, h) := sup{ g(x) g(y) : x y h}. r + 1 In [PGS] deboor shows C r when k = 0. 2 Corollary For f C r ([0, 1]), there exists s S r (T ) such that s f C r h r f (r). If T is uniform (in which case h = 1 ) n s f C r n r f (r). (IMS Spline Workshop) Spline Interpolation December 5, / 58
81 Definition (Free Knot Spline Space) Let Σ n,r be the space of all splines of order r with n + 1 knots (at most n intervals) Σ n,r := } {S r (T ) : T = [0 = t 0 < t 1 t 2 t n = 1]. Remarks: This space is nonlinear! (I.e., The space is not closed under addition, since adding two splines in Σ n,r with different knots typically results in a spline with 2n knots.) We want to find the best knots, if possible, but usually settle for good knots, which is usually good enough. The best (good) knots depend on the function. How to choose the knots for piecewise constants? Want bounds on approximation, and theorems of existence and uniquenss. We can often get the same approximation error with far fewer knots. (IMS Spline Workshop) Spline Interpolation December 5, / 58
82 Definition (Distance to Nonlinear Free-Knot Spline Space) σ n,r (f ) p := inf{ s f p : s Σ n,r } Theorem (R69,Existence of Best Approximation) Let f L p([0, 1]) for 0 < p < or f C([0, 1]) for p =. There exists s Σ n,r such that s f p = σ n,r (f ) p. Theorem (DL93,Burchard74, Smooth Approximation) Let f L p([0, 1]) for 0 < p and n, r 2. Then inf{ s f p : s Σ n,r C r 2 } = σ n,r (f ) p. Hence, we can get arbitrarily close to a best piecewise polynomial approximation with a smooth spline. (IMS Spline Workshop) Spline Interpolation December 5, / 58
83 Piecewise Constants: Balanced and Uniform Knots Knots: t i = i equally spaced. n Max error occurs on the left: s = 1 t1 = n Not the optimal rate! Knots: t i = ( i n ) 2. More knots placed near singularity. Max error occurs on the left: Optimal rate. s = 1 t1 = n (IMS Spline Workshop) Spline Interpolation December 5, / 58
84 Free-Knot Spline Approximation Estimate Remark The following theorem generalizes Kahane s theorem. The statement of the theorem is taken from [D93], Chap. 12, Theorem 4.5. Note that while in fixed knot approximation we usually see the (maximal) mesh spacing h in the estimates. For free-knot splines we don t know the mesh spacing, but we do have a term 1/n which is h for a uniform parametrization. Theorem (Freud and Popov (1969), Subbotin and Chernykh (1970)) If r = 1, 2,... and f (r 1) is of bounded variation on [0, 1], then σ n,r (f ) C r n r var [0,1] f (r 1). (IMS Spline Workshop) Spline Interpolation December 5, / 58
85 Remark (Conclusion of Free-Knot Spline Basics) The key aspect from the previous discussion relevant to the remainder of this talk is the balancing of intervals. In particular, we have showed for the simplest case of piecewise constant approximation that balanced intervals provide the best bound for approximation. Carl s program newknt() addresses this. (IMS Spline Workshop) Spline Interpolation December 5, / 58
86 Consequences: 1 Assume f (4) L 1[0, 1]. Then λ i 2 ti+1 t i 1 f (4) (t) dt. 2 The balancing functions have the form: F i r i := (t i+1 t i 1 ) 3 λ i /2. By [PGS], F i is connected to polynomial error on an interval. 3 s 0 is piecewise constant with coefficients α the cumulative sum of λ. That is, α j = j λ i. i=0 (IMS Spline Workshop) Spline Interpolation December 5, / 58
87 Proofs. 1 For the first corollary, λ i = 2 s f (t + i ) s f (t i ) = 2 s 0 (t i+1) s 0 (t + i 1) = 2 s 0 (t i+1 ) s 0 (t i 1 ) (t i+1 t i 1 ) t i+1 t i 1 = 2 2 ti+1 s t i 1 ti+1 t i 1 0 (t i ) s 0 (t i 1 ) dt t i t i 1 f (4) (t) dt. 2 The second corollary follows by F i (t i+1 t i 1 ) 3 ti+1 t i 1 f (4) (t) dt (t i+1 t i 1 ) 3 λ i /2. 3 For the third corollary, we note that since s 0 is a piecewise cubic spline, then s 0 is piecewise constant. Hence, the result follows since λ i is the jump in the third derivative across the knot. (IMS Spline Workshop) Spline Interpolation December 5, / 58
88 Variational Approach 1 Solve the inequality constrained program to find a good initial spline approximation s 0 to f such that s 0 f ɛ/2 with active knots t i and Lagrange multipliers λ i. 2 Set n, the number of intervals (n + 1 knots) 3 Rank the n 1 interior knots according to: r i = λ i (t i+1 t i 1 ) 3. 4 Using the highest rank n 1 interior knots and two end knots, find the least squares spline fit s f. 5 If s 0 s f ɛ/2, increase n and go to step 3. (IMS Spline Workshop) Spline Interpolation December 5, / 58
89 Titanium Heat Data Runge Function f (x) = 1/(1 + x 2 ) 8 intervals (7 interior knots) Error: intervals (15 interior knots) Error (IMS Spline Workshop) Spline Interpolation December 5, / 58
90 Remark (Conclusion) The proposed variational approach begins with a very large (dense) sampling of data, and hence a very large dense set of knots. Our method is to remove knots. The first set of knots fall out easily where the constraints are inactive. This does not change the spline fit. We then delete more that are ranked lower according to our rank measure. After choosing the most influential knots, we find a least square spline fit. In practice, it maintains the good error estimate, as well as the near-interpolant would. We don t feel it necessary to work harder to move the final knots to optimal positions, because the original set of knots was already from a dense subset. This may not always be acceptable, such as for the square root function where optimal knots are on the order of e 5 in magnitudes. (IMS Spline Workshop) Spline Interpolation December 5, / 58
91 Part V: Applications to Parametric Curves and Surfaces (IMS Spline Workshop) Spline Interpolation December 5, / 58
92 Parametric Curves We apply to parametric curves as follows: f (t) = (x(t), y(t)) with x(t) and y(t) spline functions. represents the Euclidean norm Interval constraints become polygonal constraints For the problem of near-interpolation 1, circles can be approximated polygons. We would like to provide optimal parametrizations (data sites and knots). 7 S. Kersey, Near-Interpolation, Numer. Math. 94, (2003) (IMS Spline Workshop) Spline Interpolation December 5, / 58
93 Typical Inequality Constraints Functions: f (t i ) b f (t i ) a K ij = Parametric Curves: { } x : x (N j P j ) 0 (Half Space) f (t i ) K i := j K ij (Convex Set) b f(t i ) f(t i ) N P a (IMS Spline Workshop) Spline Interpolation December 5, / 58
94 Example: Parametric Curves with Polygonal Constraints minimize f b a 1 2 f (t) f (t) 2 dt for quintic spline curve f under constraints f (t i ) K i. We approximate balls using polygons with several sides. Now we have a simple way to solve the problem of near-interpolation with fixed data sites. (IMS Spline Workshop) Spline Interpolation December 5, / 58
95 Example: Bad Parametrizations for Spline Curve Interpolation Best spline interpolation with free data sites (or knots) is a difficult problem. In the example, we have badly chosen sites. We choose balls with centers at the data points. While the interpolant is a bad fit, the near-interpolant improves things. But can we do better? (IMS Spline Workshop) Spline Interpolation December 5, / 58
96 Example: Optimizing Data Sites Consider near-interpolant constraints f (t i ) z i ɛ i where f is a spline curve that solves the problem of best near-interpolation. Hence, f (t i ) is constrained to lie in a closed ball of radius ɛ i. Optimal data sites satisfy the condition Hence, we want a zero of f (t i ) z i f (t i ). F (t i ) := (f (t i ) z i ) f (t i ). By Newton s method, we update t i to t i + t i with t i := F (t i) F (t i ) = (f (t i ) z i ) f (t i ) (f (t i ) z i ) f (t i ) + f (t i ) f (t i ). (0.1) (IMS Spline Workshop) Spline Interpolation December 5, / 58
97 Example: Best Interpolation with Free Data Sites After applying the parameter update to the previous example, we get: (IMS Spline Workshop) Spline Interpolation December 5, / 58
98 Example: Best Spline Interpolation with Free Data Sites Repeating the Process: Solve the problem of near-interpolation, update knots, shrink the constraints K i, and repeat until close to interpolation. Now we have a simple way to solve the problem of best spline curve interpolation with free data sites for basic configurations. If the data sites and knots coincide, we also get the optimal knots. (IMS Spline Workshop) Spline Interpolation December 5, / 58
99 Example: Cornu Spiral Optimal parametrization for interpolation of the Cornu spiral. (IMS Spline Workshop) Spline Interpolation December 5, / 58
100 Example: Parametric Space Curves Consider polyhedrons around each point of valence 3 (this is needed for linear indepedence of the active constraints). We update data sites just as we did for 2-D curves. (IMS Spline Workshop) Spline Interpolation December 5, / 58
101 The End. Thank You! (IMS Spline Workshop) Spline Interpolation December 5, / 58
A C 2 Four-Point Subdivision Scheme with Fourth Order Accuracy and its Extensions
A C 2 Four-Point Subdivision Scheme with Fourth Order Accuracy and its Extensions Nira Dyn School of Mathematical Sciences Tel Aviv University Michael S. Floater Department of Informatics University of
More informationParameterization for curve interpolation
Working title: Topics in Multivariate Approximation and Interpolation 101 K. Jetter et al., Editors c 2005 Elsevier B.V. All rights reserved Parameterization for curve interpolation Michael S. Floater
More informationOn the deviation of a parametric cubic spline interpolant from its data polygon
Computer Aided Geometric Design 25 (2008) 148 156 wwwelseviercom/locate/cagd On the deviation of a parametric cubic spline interpolant from its data polygon Michael S Floater Department of Computer Science,
More informationA C 2 Four-Point Subdivision Scheme with Fourth Order Accuracy and its Extensions
A C 2 Four-Point Subdivision Scheme with Fourth Order Accuracy and its Extensions Nira Dyn Michael S. Floater Kai Hormann Abstract. We present a new four-point subdivision scheme that generates C 2 curves.
More informationParameterization of triangular meshes
Parameterization of triangular meshes Michael S. Floater November 10, 2009 Triangular meshes are often used to represent surfaces, at least initially, one reason being that meshes are relatively easy to
More informationLecture VIII. Global Approximation Methods: I
Lecture VIII Global Approximation Methods: I Gianluca Violante New York University Quantitative Macroeconomics G. Violante, Global Methods p. 1 /29 Global function approximation Global methods: function
More informationApplied Lagrange Duality for Constrained Optimization
Applied Lagrange Duality for Constrained Optimization Robert M. Freund February 10, 2004 c 2004 Massachusetts Institute of Technology. 1 1 Overview The Practical Importance of Duality Review of Convexity
More informationCHAPTER 6 Parametric Spline Curves
CHAPTER 6 Parametric Spline Curves When we introduced splines in Chapter 1 we focused on spline curves, or more precisely, vector valued spline functions. In Chapters 2 and 4 we then established the basic
More informationParameterization. Michael S. Floater. November 10, 2011
Parameterization Michael S. Floater November 10, 2011 Triangular meshes are often used to represent surfaces, at least initially, one reason being that meshes are relatively easy to generate from point
More informationLecture 2 September 3
EE 381V: Large Scale Optimization Fall 2012 Lecture 2 September 3 Lecturer: Caramanis & Sanghavi Scribe: Hongbo Si, Qiaoyang Ye 2.1 Overview of the last Lecture The focus of the last lecture was to give
More informationProgramming, numerics and optimization
Programming, numerics and optimization Lecture C-4: Constrained optimization Łukasz Jankowski ljank@ippt.pan.pl Institute of Fundamental Technological Research Room 4.32, Phone +22.8261281 ext. 428 June
More informationPolynomials tend to oscillate (wiggle) a lot, even when our true function does not.
AMSC/CMSC 460 Computational Methods, Fall 2007 UNIT 2: Spline Approximations Dianne P O Leary c 2001, 2002, 2007 Piecewise polynomial interpolation Piecewise polynomial interpolation Read: Chapter 3 Skip:
More informationConvexity Theory and Gradient Methods
Convexity Theory and Gradient Methods Angelia Nedić angelia@illinois.edu ISE Department and Coordinated Science Laboratory University of Illinois at Urbana-Champaign Outline Convex Functions Optimality
More informationShiqian Ma, MAT-258A: Numerical Optimization 1. Chapter 2. Convex Optimization
Shiqian Ma, MAT-258A: Numerical Optimization 1 Chapter 2 Convex Optimization Shiqian Ma, MAT-258A: Numerical Optimization 2 2.1. Convex Optimization General optimization problem: min f 0 (x) s.t., f i
More informationA Short SVM (Support Vector Machine) Tutorial
A Short SVM (Support Vector Machine) Tutorial j.p.lewis CGIT Lab / IMSC U. Southern California version 0.zz dec 004 This tutorial assumes you are familiar with linear algebra and equality-constrained optimization/lagrange
More informationConvex Optimization MLSS 2015
Convex Optimization MLSS 2015 Constantine Caramanis The University of Texas at Austin The Optimization Problem minimize : f (x) subject to : x X. The Optimization Problem minimize : f (x) subject to :
More informationFebruary 2017 (1/20) 2 Piecewise Polynomial Interpolation 2.2 (Natural) Cubic Splines. MA378/531 Numerical Analysis II ( NA2 )
f f f f f (/2).9.8.7.6.5.4.3.2. S Knots.7.6.5.4.3.2. 5 5.2.8.6.4.2 S Knots.2 5 5.9.8.7.6.5.4.3.2..9.8.7.6.5.4.3.2. S Knots 5 5 S Knots 5 5 5 5.35.3.25.2.5..5 5 5.6.5.4.3.2. 5 5 4 x 3 3.5 3 2.5 2.5.5 5
More informationMathematical Programming and Research Methods (Part II)
Mathematical Programming and Research Methods (Part II) 4. Convexity and Optimization Massimiliano Pontil (based on previous lecture by Andreas Argyriou) 1 Today s Plan Convex sets and functions Types
More informationConvexity: an introduction
Convexity: an introduction Geir Dahl CMA, Dept. of Mathematics and Dept. of Informatics University of Oslo 1 / 74 1. Introduction 1. Introduction what is convexity where does it arise main concepts and
More informationConstrained Optimization and Lagrange Multipliers
Constrained Optimization and Lagrange Multipliers MATH 311, Calculus III J. Robert Buchanan Department of Mathematics Fall 2011 Constrained Optimization In the previous section we found the local or absolute
More informationConvex Optimization M2
Convex Optimization M2 Lecture 1 A. d Aspremont. Convex Optimization M2. 1/49 Today Convex optimization: introduction Course organization and other gory details... Convex sets, basic definitions. A. d
More informationIntroduction to Optimization
Introduction to Optimization Constrained Optimization Marc Toussaint U Stuttgart Constrained Optimization General constrained optimization problem: Let R n, f : R n R, g : R n R m, h : R n R l find min
More information08 - Designing Approximating Curves
08 - Designing Approximating Curves Acknowledgement: Olga Sorkine-Hornung, Alexander Sorkine-Hornung, Ilya Baran Last time Interpolating curves Monomials Lagrange Hermite Different control types Polynomials
More informationIntroduction to Modern Control Systems
Introduction to Modern Control Systems Convex Optimization, Duality and Linear Matrix Inequalities Kostas Margellos University of Oxford AIMS CDT 2016-17 Introduction to Modern Control Systems November
More informationNonlinear Programming
Nonlinear Programming SECOND EDITION Dimitri P. Bertsekas Massachusetts Institute of Technology WWW site for book Information and Orders http://world.std.com/~athenasc/index.html Athena Scientific, Belmont,
More informationCalifornia Institute of Technology Crash-Course on Convex Optimization Fall Ec 133 Guilherme Freitas
California Institute of Technology HSS Division Crash-Course on Convex Optimization Fall 2011-12 Ec 133 Guilherme Freitas In this text, we will study the following basic problem: maximize x C f(x) subject
More informationIntroduction to optimization
Introduction to optimization G. Ferrari Trecate Dipartimento di Ingegneria Industriale e dell Informazione Università degli Studi di Pavia Industrial Automation Ferrari Trecate (DIS) Optimization Industrial
More informationApproximation of 3D-Parametric Functions by Bicubic B-spline Functions
International Journal of Mathematical Modelling & Computations Vol. 02, No. 03, 2012, 211-220 Approximation of 3D-Parametric Functions by Bicubic B-spline Functions M. Amirfakhrian a, a Department of Mathematics,
More informationLecture 2 - Introduction to Polytopes
Lecture 2 - Introduction to Polytopes Optimization and Approximation - ENS M1 Nicolas Bousquet 1 Reminder of Linear Algebra definitions Let x 1,..., x m be points in R n and λ 1,..., λ m be real numbers.
More informationIntroduction to Optimization Problems and Methods
Introduction to Optimization Problems and Methods wjch@umich.edu December 10, 2009 Outline 1 Linear Optimization Problem Simplex Method 2 3 Cutting Plane Method 4 Discrete Dynamic Programming Problem Simplex
More informationCMU-Q Lecture 9: Optimization II: Constrained,Unconstrained Optimization Convex optimization. Teacher: Gianni A. Di Caro
CMU-Q 15-381 Lecture 9: Optimization II: Constrained,Unconstrained Optimization Convex optimization Teacher: Gianni A. Di Caro GLOBAL FUNCTION OPTIMIZATION Find the global maximum of the function f x (and
More informationSPLINE APPROXIMATION VIA THE CONTROL POLYGON
SPLINE APPROXIMATION VIA THE CONTROL POLYGON by Håkon Mørk THESIS for the degree of MASTER S DEGREE IN APPLIED MATHEMATICS AND MECHANICS (Master i Anvendt matematikk og mekanikk) Faculty of Mathematics
More informationLinear methods for supervised learning
Linear methods for supervised learning LDA Logistic regression Naïve Bayes PLA Maximum margin hyperplanes Soft-margin hyperplanes Least squares resgression Ridge regression Nonlinear feature maps Sometimes
More information1. Introduction. performance of numerical methods. complexity bounds. structural convex optimization. course goals and topics
1. Introduction EE 546, Univ of Washington, Spring 2016 performance of numerical methods complexity bounds structural convex optimization course goals and topics 1 1 Some course info Welcome to EE 546!
More informationOptimal Control Techniques for Dynamic Walking
Optimal Control Techniques for Dynamic Walking Optimization in Robotics & Biomechanics IWR, University of Heidelberg Presentation partly based on slides by Sebastian Sager, Moritz Diehl and Peter Riede
More informationLecture 10: SVM Lecture Overview Support Vector Machines The binary classification problem
Computational Learning Theory Fall Semester, 2012/13 Lecture 10: SVM Lecturer: Yishay Mansour Scribe: Gitit Kehat, Yogev Vaknin and Ezra Levin 1 10.1 Lecture Overview In this lecture we present in detail
More informationLecture 25: Bezier Subdivision. And he took unto him all these, and divided them in the midst, and laid each piece one against another: Genesis 15:10
Lecture 25: Bezier Subdivision And he took unto him all these, and divided them in the midst, and laid each piece one against another: Genesis 15:10 1. Divide and Conquer If we are going to build useful
More informationFall CSCI 420: Computer Graphics. 4.2 Splines. Hao Li.
Fall 2014 CSCI 420: Computer Graphics 4.2 Splines Hao Li http://cs420.hao-li.com 1 Roller coaster Next programming assignment involves creating a 3D roller coaster animation We must model the 3D curve
More informationCS 450 Numerical Analysis. Chapter 7: Interpolation
Lecture slides based on the textbook Scientific Computing: An Introductory Survey by Michael T. Heath, copyright c 2018 by the Society for Industrial and Applied Mathematics. http://www.siam.org/books/cl80
More informationGeneralised Mean Averaging Interpolation by Discrete Cubic Splines
Publ. RIMS, Kyoto Univ. 30 (1994), 89-95 Generalised Mean Averaging Interpolation by Discrete Cubic Splines By Manjulata SHRIVASTAVA* Abstract The aim of this work is to introduce for a discrete function,
More informationNumerical Optimization
Numerical Optimization Quantitative Macroeconomics Raül Santaeulàlia-Llopis MOVE-UAB and Barcelona GSE Fall 2018 Raül Santaeulàlia-Llopis (MOVE-UAB,BGSE) QM: Numerical Optimization Fall 2018 1 / 46 1 Introduction
More informationThe goal is the definition of points with numbers and primitives with equations or functions. The definition of points with numbers requires a
The goal is the definition of points with numbers and primitives with equations or functions. The definition of points with numbers requires a coordinate system and then the measuring of the point with
More informationDeficient Quartic Spline Interpolation
International Journal of Computational Science and Mathematics. ISSN 0974-3189 Volume 3, Number 2 (2011), pp. 227-236 International Research Publication House http://www.irphouse.com Deficient Quartic
More informationConvex Optimization - Chapter 1-2. Xiangru Lian August 28, 2015
Convex Optimization - Chapter 1-2 Xiangru Lian August 28, 2015 1 Mathematical optimization minimize f 0 (x) s.t. f j (x) 0, j=1,,m, (1) x S x. (x 1,,x n ). optimization variable. f 0. R n R. objective
More informationSupport Vector Machines.
Support Vector Machines srihari@buffalo.edu SVM Discussion Overview 1. Overview of SVMs 2. Margin Geometry 3. SVM Optimization 4. Overlapping Distributions 5. Relationship to Logistic Regression 6. Dealing
More informationBézier Splines. B-Splines. B-Splines. CS 475 / CS 675 Computer Graphics. Lecture 14 : Modelling Curves 3 B-Splines. n i t i 1 t n i. J n,i.
Bézier Splines CS 475 / CS 675 Computer Graphics Lecture 14 : Modelling Curves 3 n P t = B i J n,i t with 0 t 1 J n, i t = i=0 n i t i 1 t n i No local control. Degree restricted by the control polygon.
More informationDM545 Linear and Integer Programming. Lecture 2. The Simplex Method. Marco Chiarandini
DM545 Linear and Integer Programming Lecture 2 The Marco Chiarandini Department of Mathematics & Computer Science University of Southern Denmark Outline 1. 2. 3. 4. Standard Form Basic Feasible Solutions
More informationMath 5593 Linear Programming Lecture Notes
Math 5593 Linear Programming Lecture Notes Unit II: Theory & Foundations (Convex Analysis) University of Colorado Denver, Fall 2013 Topics 1 Convex Sets 1 1.1 Basic Properties (Luenberger-Ye Appendix B.1).........................
More informationCentral issues in modelling
Central issues in modelling Construct families of curves, surfaces and volumes that can represent common objects usefully; are easy to interact with; interaction includes: manual modelling; fitting to
More informationCS 475 / CS Computer Graphics. Modelling Curves 3 - B-Splines
CS 475 / CS 675 - Computer Graphics Modelling Curves 3 - Bézier Splines n P t = i=0 No local control. B i J n,i t with 0 t 1 J n,i t = n i t i 1 t n i Degree restricted by the control polygon. http://www.cs.mtu.edu/~shene/courses/cs3621/notes/spline/bezier/bezier-move-ct-pt.html
More informationComputational Methods. Constrained Optimization
Computational Methods Constrained Optimization Manfred Huber 2010 1 Constrained Optimization Unconstrained Optimization finds a minimum of a function under the assumption that the parameters can take on
More informationBezier Curves, B-Splines, NURBS
Bezier Curves, B-Splines, NURBS Example Application: Font Design and Display Curved objects are everywhere There is always need for: mathematical fidelity high precision artistic freedom and flexibility
More informationLocal Approximation by Splines with Displacement of Nodes
ISSN 1055-1344, Siberian Advances in Mathematics, 013, Vol. 3, No. 1, pp. 69 75. c Allerton Press, Inc., 013. Original Russian Text c Yu. S. Volkov, E. V. Strelkova, and V. T. Shevaldin, 011, published
More informationLecture IV Bézier Curves
Lecture IV Bézier Curves Why Curves? Why Curves? Why Curves? Why Curves? Why Curves? Linear (flat) Curved Easier More pieces Looks ugly Complicated Fewer pieces Looks smooth What is a curve? Intuitively:
More informationLecture 8. Divided Differences,Least-Squares Approximations. Ceng375 Numerical Computations at December 9, 2010
Lecture 8, Ceng375 Numerical Computations at December 9, 2010 Computer Engineering Department Çankaya University 8.1 Contents 1 2 3 8.2 : These provide a more efficient way to construct an interpolating
More informationPS Geometric Modeling Homework Assignment Sheet I (Due 20-Oct-2017)
Homework Assignment Sheet I (Due 20-Oct-2017) Assignment 1 Let n N and A be a finite set of cardinality n = A. By definition, a permutation of A is a bijective function from A to A. Prove that there exist
More informationAn interpolating 4-point C 2 ternary stationary subdivision scheme
Computer Aided Geometric Design 9 (2002) 8 www.elsevier.com/locate/comaid An interpolating 4-point C 2 ternary stationary subdivision scheme M.F Hassan a,, I.P. Ivrissimitzis a, N.A. Dodgson a,m.a.sabin
More information5 Machine Learning Abstractions and Numerical Optimization
Machine Learning Abstractions and Numerical Optimization 25 5 Machine Learning Abstractions and Numerical Optimization ML ABSTRACTIONS [some meta comments on machine learning] [When you write a large computer
More informationMaximizing an interpolating quadratic
Week 11: Monday, Apr 9 Maximizing an interpolating quadratic Suppose that a function f is evaluated on a reasonably fine, uniform mesh {x i } n i=0 with spacing h = x i+1 x i. How can we find any local
More informationInterpolation with complex B-splines
Interpolation with complex B-splines Brigitte Forster Fakultät für Informatik und Mathematik Universität Passau Brigitte Forster (Passau) Bernried 2016 1 / 32 The first part of a story in three chapters
More informationAlmost Curvature Continuous Fitting of B-Spline Surfaces
Journal for Geometry and Graphics Volume 2 (1998), No. 1, 33 43 Almost Curvature Continuous Fitting of B-Spline Surfaces Márta Szilvási-Nagy Department of Geometry, Mathematical Institute, Technical University
More informationSPERNER S LEMMA MOOR XU
SPERNER S LEMMA MOOR XU Abstract. Is it possible to dissect a square into an odd number of triangles of equal area? This question was first answered by Paul Monsky in 970, and the solution requires elements
More informationx n x n stepnumber k order r error constant C r+1 1/2 5/12 3/8 251/720 abs. stab. interval (α,0) /11-3/10
MATH 573 LECTURE NOTES 77 13.8. Predictor-corrector methods. We consider the Adams methods, obtained from the formula xn+1 xn+1 y(x n+1 y(x n ) = y (x)dx = f(x,y(x))dx x n x n by replacing f by an interpolating
More informationMathematical and Algorithmic Foundations Linear Programming and Matchings
Adavnced Algorithms Lectures Mathematical and Algorithmic Foundations Linear Programming and Matchings Paul G. Spirakis Department of Computer Science University of Patras and Liverpool Paul G. Spirakis
More informationIntroduction to Mathematical Programming IE406. Lecture 20. Dr. Ted Ralphs
Introduction to Mathematical Programming IE406 Lecture 20 Dr. Ted Ralphs IE406 Lecture 20 1 Reading for This Lecture Bertsimas Sections 10.1, 11.4 IE406 Lecture 20 2 Integer Linear Programming An integer
More informationPost-Processing Radial Basis Function Approximations: A Hybrid Method
Post-Processing Radial Basis Function Approximations: A Hybrid Method Muhammad Shams Dept. of Mathematics UMass Dartmouth Dartmouth MA 02747 Email: mshams@umassd.edu August 4th 2011 Abstract With the use
More informationPiecewise polynomial interpolation
Chapter 2 Piecewise polynomial interpolation In ection.6., and in Lab, we learned that it is not a good idea to interpolate unctions by a highorder polynomials at equally spaced points. However, it transpires
More informationNormals of subdivision surfaces and their control polyhedra
Computer Aided Geometric Design 24 (27 112 116 www.elsevier.com/locate/cagd Normals of subdivision surfaces and their control polyhedra I. Ginkel a,j.peters b,,g.umlauf a a University of Kaiserslautern,
More informationRational Bezier Curves
Rational Bezier Curves Use of homogeneous coordinates Rational spline curve: define a curve in one higher dimension space, project it down on the homogenizing variable Mathematical formulation: n P(u)
More informationOptimization III: Constrained Optimization
Optimization III: Constrained Optimization CS 205A: Mathematical Methods for Robotics, Vision, and Graphics Doug James (and Justin Solomon) CS 205A: Mathematical Methods Optimization III: Constrained Optimization
More information8 Piecewise Polynomial Interpolation
Applied Math Notes by R. J. LeVeque 8 Piecewise Polynomial Interpolation 8. Pitfalls of high order interpolation Suppose we know the value of a function at several points on an interval and we wish to
More informationIntroduction to Constrained Optimization
Introduction to Constrained Optimization Duality and KKT Conditions Pratik Shah {pratik.shah [at] lnmiit.ac.in} The LNM Institute of Information Technology www.lnmiit.ac.in February 13, 2013 LNMIIT MLPR
More informationGeometric approximation of curves and singularities of secant maps Ghosh, Sunayana
University of Groningen Geometric approximation of curves and singularities of secant maps Ghosh, Sunayana IMPORTANT NOTE: You are advised to consult the publisher's version (publisher's PDF) if you wish
More informationAnimation Lecture 10 Slide Fall 2003
Animation Lecture 10 Slide 1 6.837 Fall 2003 Conventional Animation Draw each frame of the animation great control tedious Reduce burden with cel animation layer keyframe inbetween cel panoramas (Disney
More informationApproximation of a Fuzzy Function by Using Radial Basis Functions Interpolation
International Journal of Mathematical Modelling & Computations Vol. 07, No. 03, Summer 2017, 299-307 Approximation of a Fuzzy Function by Using Radial Basis Functions Interpolation R. Firouzdor a and M.
More informationand the crooked shall be made straight, and the rough ways shall be made smooth; Luke 3:5
ecture 8: Knot Insertion Algorithms for B-Spline Curves and Surfaces and the crooked shall be made straight, and the rough ways shall be made smooth; uke 3:5. Motivation B-spline methods have several advantages
More informationAM 221: Advanced Optimization Spring 2016
AM 221: Advanced Optimization Spring 2016 Prof. Yaron Singer Lecture 2 Wednesday, January 27th 1 Overview In our previous lecture we discussed several applications of optimization, introduced basic terminology,
More information15.082J and 6.855J. Lagrangian Relaxation 2 Algorithms Application to LPs
15.082J and 6.855J Lagrangian Relaxation 2 Algorithms Application to LPs 1 The Constrained Shortest Path Problem (1,10) 2 (1,1) 4 (2,3) (1,7) 1 (10,3) (1,2) (10,1) (5,7) 3 (12,3) 5 (2,2) 6 Find the shortest
More informationAn Introduction to Numerical Analysis
Weimin Han AMCS & Dept of Math University of Iowa MATH:38 Example 1 Question: What is the area of the region between y = e x 2 and the x-axis for x 1? Answer: Z 1 e x 2 dx = : 1.9.8.7.6.5.4.3.2.1 1.5.5
More informationAsymptotic Error Analysis
Asymptotic Error Analysis Brian Wetton Mathematics Department, UBC www.math.ubc.ca/ wetton PIMS YRC, June 3, 2014 Outline Overview Some History Romberg Integration Cubic Splines - Periodic Case More History:
More informationConvergence of C 2 Deficient Quartic Spline Interpolation
Advances in Computational Sciences and Technology ISSN 0973-6107 Volume 10, Number 4 (2017) pp. 519-527 Research India Publications http://www.ripublication.com Convergence of C 2 Deficient Quartic Spline
More informationCS321 Introduction To Numerical Methods
CS3 Introduction To Numerical Methods Fuhua (Frank) Cheng Department of Computer Science University of Kentucky Lexington KY 456-46 - - Table of Contents Errors and Number Representations 3 Error Types
More information1. Lecture notes on bipartite matching
Massachusetts Institute of Technology 18.453: Combinatorial Optimization Michel X. Goemans February 5, 2017 1. Lecture notes on bipartite matching Matching problems are among the fundamental problems in
More informationLagrangian Relaxation: An overview
Discrete Math for Bioinformatics WS 11/12:, by A. Bockmayr/K. Reinert, 22. Januar 2013, 13:27 4001 Lagrangian Relaxation: An overview Sources for this lecture: D. Bertsimas and J. Tsitsiklis: Introduction
More informationSplines. Parameterization of a Curve. Curve Representations. Roller coaster. What Do We Need From Curves in Computer Graphics? Modeling Complex Shapes
CSCI 420 Computer Graphics Lecture 8 Splines Jernej Barbic University of Southern California Hermite Splines Bezier Splines Catmull-Rom Splines Other Cubic Splines [Angel Ch 12.4-12.12] Roller coaster
More informationSpline Methods Draft. Tom Lyche and Knut Mørken
Spline Methods Draft Tom Lyche and Knut Mørken 24th May 2002 2 Contents 1 Splines and B-splines an introduction 3 1.1 Convex combinations and convex hulls..................... 3 1.1.1 Stable computations...........................
More informationM3P1/M4P1 (2005) Dr M Ruzhansky Metric and Topological Spaces Summary of the course: definitions, examples, statements.
M3P1/M4P1 (2005) Dr M Ruzhansky Metric and Topological Spaces Summary of the course: definitions, examples, statements. Chapter 1: Metric spaces and convergence. (1.1) Recall the standard distance function
More information6 Randomized rounding of semidefinite programs
6 Randomized rounding of semidefinite programs We now turn to a new tool which gives substantially improved performance guarantees for some problems We now show how nonlinear programming relaxations can
More informationSolution Methods Numerical Algorithms
Solution Methods Numerical Algorithms Evelien van der Hurk DTU Managment Engineering Class Exercises From Last Time 2 DTU Management Engineering 42111: Static and Dynamic Optimization (6) 09/10/2017 Class
More informationDiscrete Cubic Interpolatory Splines
Publ RIMS, Kyoto Univ. 28 (1992), 825-832 Discrete Cubic Interpolatory Splines By Manjulata SHRIVASTAVA* Abstract In the present paper, existence, uniqueness and convergence properties of a discrete cubic
More informationAPPROXIMATION BY FUZZY B-SPLINE SERIES
J. Appl. Math. & Computing Vol. 20(2006), No. 1-2, pp. 157-169 Website: http://jamc.net APPROXIMATION BY FUZZY B-SPLINE SERIES PETRU BLAGA AND BARNABÁS BEDE Abstract. We study properties concerning approximation
More informationInterpolation. TANA09 Lecture 7. Error analysis for linear interpolation. Linear Interpolation. Suppose we have a table x x 1 x 2...
TANA9 Lecture 7 Interpolation Suppose we have a table x x x... x n+ Interpolation Introduction. Polynomials. Error estimates. Runge s phenomena. Application - Equation solving. Spline functions and interpolation.
More informationMachine Learning for Signal Processing Lecture 4: Optimization
Machine Learning for Signal Processing Lecture 4: Optimization 13 Sep 2015 Instructor: Bhiksha Raj (slides largely by Najim Dehak, JHU) 11-755/18-797 1 Index 1. The problem of optimization 2. Direct optimization
More informationSpline Methods Draft. Tom Lyche and Knut Mørken
Spline Methods Draft Tom Lyche and Knut Mørken January 5, 2005 2 Contents 1 Splines and B-splines an Introduction 3 1.1 Convex combinations and convex hulls.................... 3 1.1.1 Stable computations...........................
More informationUniversity of Twente. Faculty of Mathematical Sciences. Convexity preservation of the four-point interpolatory subdivision scheme
Faculty of Mathematical Sciences University of Twente University for Technical and Social Sciences P.O. Box 17 7500 AE Enschede The Netherlands Phone: +31-53-4893400 Fax: +31-53-4893114 Email: memo@math.utwente.nl
More informationNewton Polygons of L-Functions
Newton Polygons of L-Functions Phong Le Department of Mathematics University of California, Irvine June 2009/Ph.D. Defense Phong Le Newton Polygons of L-Functions 1/33 Laurent Polynomials Let q = p a where
More informationMar. 20 Math 2335 sec 001 Spring 2014
Mar. 20 Math 2335 sec 001 Spring 2014 Chebyshev Polynomials Definition: For an integer n 0 define the function ( ) T n (x) = cos n cos 1 (x), 1 x 1. It can be shown that T n is a polynomial of degree n.
More informationThis lecture: Convex optimization Convex sets Convex functions Convex optimization problems Why convex optimization? Why so early in the course?
Lec4 Page 1 Lec4p1, ORF363/COS323 This lecture: Convex optimization Convex sets Convex functions Convex optimization problems Why convex optimization? Why so early in the course? Instructor: Amir Ali Ahmadi
More informationConvex Optimization CMU-10725
Convex Optimization CMU-10725 Ellipsoid Methods Barnabás Póczos & Ryan Tibshirani Outline Linear programs Simplex algorithm Running time: Polynomial or Exponential? Cutting planes & Ellipsoid methods for
More informationLecture notes on the simplex method September We will present an algorithm to solve linear programs of the form. maximize.
Cornell University, Fall 2017 CS 6820: Algorithms Lecture notes on the simplex method September 2017 1 The Simplex Method We will present an algorithm to solve linear programs of the form maximize subject
More information