Recursive Estimation
|
|
- Paul Norris
- 5 years ago
- Views:
Transcription
1 Recursive Estimatio Raffaello D Adrea Sprig 2 Problem Set: Probability Review Last updated: February 28, 2 Notes: Notatio: Uless otherwise oted, x, y, ad z deote radom variables, f x (x) (or the short had f(x)) deotes the probability desity fuctio of x, ad f x y (x y) (or f(x y)) deotes the coditioal probability desity fuctio of x coditioed o y. The expected value is deoted by E [ ], the variace is deoted by Var[ ], ad Pr (Z) deotes the probability that the evet Z occurs. Please report ay errors foud i this problem set to the teachig assistats (strimpe@ethz.ch or aschoellig@ethz.ch).
2 Problem Set Problem Prove f(x y) = f(x) f(y x) = f(y). Problem 2 Prove f(x y, z) = f(x z) f(x, y z) = f(x z) f(y z). Problem 3 Come up with a example where f(x, y z) = f(x z) f(y z) but f(x, y) f(x) f(y) for cotiuous radom variables x, y, ad z. Problem 4 Come up with a example where f(x, y z) = f(x z) f(y z) but f(x, y) f(x) f(y) for discrete radom variables x, y, ad z. Problem 5 Let x ad y be biary radom variables: x, y {, }. Prove that f x,y (x, y) f x (x) + f y (y), which is called Boferroi s iequality. Problem 6 Let y be a scalar cotiuous radom variable with probability desity fuctio f y (y), ad g be a fuctio trasformig y to a ew variable x by x = g(y). Derive the chage of variables formula, i.e. the equatio for the probability desity fuctio f x (x), uder the assumptio that g is cotiuously differetiable with dg(y) dy < y. Problem 7 Let x X be a scalar valued cotiuous radom variable with probability desity fuctio f x (x). Prove the law of the ucoscious statisticia, that is, for a fuctio g( ) show that the expected value of y = g(x) is give by E [y] = g(x)f x (x) dx. X You may cosider the special case where g( ) is a cotiuously differetiable, strictly mootoically icreasig fuctio. Problem 8 Prove E [ax + b] = ae [x] + b, where a ad b are costats. Problem 9 Let x ad y be scalar radom variables. Prove that, if x ad y are idepedet, the for ay fuctios g( ) ad h( ), E [g(x)h(y)] = E [g(x)] E [h(y)]. 2
3 Problem From above, it follows that if x ad y are idepedet, the E [xy] = E [x] E [y]. Is the coverse true, that is, if E [xy] = E [x] E [y], does it imply that x ad y are idepedet? If yes, prove it. If o, fid a couter-example. Problem Let x X ad y Y be idepedet, scalar valued discrete radom variables. Let z = x + y. Prove that f z (z) = y Y f x (z y) f y (y) = x X f x (x) f y (z x), that is, the probability desity fuctio is the covolutio of the idividual probability desity fuctios. Problem 2 Let x be a scalar cotiuous radom variable that takes o oly o-egative values. Prove that, for a >, Pr (x a) E [x] a, which is called Markov s iequality. Problem 3 Let x be a scalar cotiuous radom variable. Let x = E [x], σ 2 = Var[x]. Prove that for ay k >, Pr ( x x k) σ2 k 2, which is called Chebyshev s iequality. Problem 4 Let x, x 2,..., x be idepedet radom variables, each havig a uiform distributio over [, ]. Let the radom variable m be defied as the maximum of x,..., x, that is, m = max{x, x 2,..., x }. Show that the cumulative distributio fuctio of m, F m ( ), is give by F m (m) = m, m. What is the probability desity fuctio of m? Problem 5 Prove that E [ x 2] (E [x]) 2. Whe does the statemet hold with equality? Problem 6 Suppose that x ad y are idepedet scalar cotiuous radom variables. Show that Pr (x y) = F x (y)f y (y) dy. 3
4 Problem 7 Use Chebyshev s iequality to prove the weak law of large umbers. Namely, if x, x 2,... are idepedet ad idetically distributed with mea µ ad variace σ 2 the, for ay ε >, ( ) x + x x Pr µ > ε as. Problem 8 Suppose that x is a radom variable with mea ad variace 5. What ca we say about Pr (5 < x < 5)? Problem 9 Let x ad y be idepedet radom variables with meas µ x ad µ y ad variaces σ 2 x ad σ 2 y, respectively. Show that Var[xy] = σ 2 xσ 2 y + µ 2 yσ 2 x + µ 2 xσ 2 y. Problem 2 a) Use the method preseted i class to obtai a sample x of the expoetial distributio { λe ˆf λx x x (x) = x < from a give sample u of a uiform distributio. b) Expoetial radom variables are used to model failures of compoets that do ot wear, for example solid state electroics. This is based o their property Pr (x > s + t x > t) = Pr (x > s) s, t. A radom variable with this property is said to be memoryless. variable with a expoetial distributio satisfies this property. Prove that a radom 4
5 Sample solutios Problem From the defiitio of coditioal probability, we have f(x, y) = f(x y)f(y) ad f(x, y) = f(y x)f(x) ad therefore f(x y)f(y) = f(y x)f(x). () We ca assume that f(x) ad f(y) ; otherwise f(y x) ad f(x y), respectively, are ot defied, ad the statemet uder cosideratio does ot make sese. We will check both directios of the equivalece statemet: f(x y) = f(x) f(y x) = f(y) () = f(x)f(y) = f(y x)f(x) f(x) = f(y) = f(y x) () = f(x y)f(y) = f(y)f(x) f(y) = f(x) = f(x y) Therefore, f(x y) = f(x) f(y x) = f(y). Problem 2 Usig f(x, y z) = f(x y, z)f(y z) (2) both directios of the equivalece statemet ca be show as follows: f(x y, z) = f(x z) f(x, y z) = f(x z)f(y z) (2) = f(x, y z) = f(x z)f(y z) (2) = f(x y, z)f(y z) = f(x z)f(y z) = f(x y, z) = f(x z) sice f(y z), otherwise f(x y, z) is ot defied. Problem 3 Let x, y, z [, ] be cotiuous radom variables. Cosider the joit pdf f(x, y, z) = c g x (x, z) g y (y, z) where g x ad g y are fuctios (ot ecessarily pdfs) ad c is a costat such that f(x, y, z) dx dy dz = The f(x, y z) = with f(x, y, z) f(z) = c g x(x, z) g y (y, z), c G x (z) G y (z) G x (z) = g x (x, z) dx, G y = g y (y, z) dy 5
6 sice f(z) = c g x (x, z) g y (y, z) dx dy = c G x (z) g y (y, z) dy = c G x (z) G y (z). Furthermore, f(x z) = f(x, z) f(z) = f(x, y, z) dy f(z) = c g x(x, z)g y (z) c G x (z)g y (z) = g x(x, z) G x (z) ad, by aalogy, f(y z) = g y(y, z) G y (z). Cotiuig the above, f(x, y z) = g x(x, z)g y (y, z) G x (z)g y (z) = f(x z)f(y z), that is, x ad y are coditioally idepedet. Now, let g x (x, z) = x + z ad g y (y, z) = y + z. The, f(x, y) = = c f(x, y, z) dz = c [ 3 z3 + 2 (x + y)z2 + xyz (x + z)(y + z) dz = c ] z= z= z 2 + (x + y)z + xy dz ( = c 3 + ) (x + y) + xy 2 f(x) = f(y) = Therefore, f(x, y) dx = c f(x, y) dy = c x + ( y + xy dx = c y + ) ( 2 y = c y + 7 ) 2 ( x + 7 ) 2 (by symmetry). ( 49 f(x)f(y) = c ) (x + y) + xy f(x, y), 2 that is, x ad y are ot idepedet. Problem 4 As i Problem 3, let f(x, y, z) = c g x (x, z)g y (y, z). This esures that f(x, y z) = f(x z)f(y z). Let x, y, z {, }. 6
7 Defie g x ad g y by value tables: x y g x (x, z) y z g y (y, z) x y z f(x, y, z) = 2 g x(x, z)g y (y, z).5.5 Compute f(x, y), f(x), f(y): x y f(x, y).5.5 x f(x).5.5 y f(y).5.5 x y f(x)f(y) From this we see f(x, y) f(x)f(y). Remark: For verificatio, oe may also compute f(x, y z), f(x z), f(y z) i order to verify f(x, y z) = f(x z) f(y z), although this holds by costructio of f(x, y, z) ad the derivatio i Problem 3. Problem 5 For all x, y {, } we have by margializatio, f x (x) = f xy (x, y) = f xy (x, ) + f xy (x, ) = f xy (x, y) + f xy (x, y) f y (y) = Therefore, y {,} x {,} f xy (x, y) = f xy (x, y) + f xy ( x, y). f x (x) + f y (y) = 2f xy (x, y) + f xy (x, y) + f xy ( x, y) = 2f xy (x, y) + f xy (x, y) + f xy ( x, y) + f xy ( x, y) f xy ( x, y) = f xy (x, y) + f xy (x, y) + f xy ( x, y) + f xy ( x, y) }{{} = f xy (x, y) = y {,} x {,} f xy ( x, y) + f xy (x, y) = + f xy (x, y) f xy ( x, y) + f xy (x, y) = f xy (x, y) f x (x) + f y (y). 7
8 Problem 6 Cosider the probability that y is i a small iterval [ȳ, ȳ + y] (with y > small), Pr (y [ȳ, ȳ + y]) = ȳ+ y ȳ f y (y) dy, which approaches f y (ȳ) y i the limit as y. Let x := g(ȳ). For small y, we have by a Taylor series approximatio, g(ȳ + y) g( y) + dg dy (ȳ) y = x + x, x < }{{} =: x Sice g(y) is decreasig, x <, see Figure. x g(y) x + x ȳ ȳ + y Figure : Decreasig fuctio g(y) o a small iterval [ȳ, ȳ + y]. We are iterested i the probability of x [ x + x, x]. For small x, this probability is equal to the probability that y [ȳ, ȳ + y] (sice y [ȳ, ȳ + y] g(y) [g(ȳ), g(ȳ + y)] x [ x + x, x] for small y ad x). Therefore, for small y (ad thus small x), Pr (y [ȳ, ȳ + y]) = f y (ȳ) y = Pr (x [ x + x, x]) = f x ( x) x f y (ȳ) = f x ( x) x f x ( x) = f y(ȳ) x y As y (ad thus x ), x f x ( x) =. f y(ȳ) dg dy (ȳ) or f x(x) = y dg dy f y(y) dg dy (y). (ȳ) ad therefore Problem 7 From the chage of variables formula, we have f y (y) = f x(x) dg dx (x) See lecture. 8
9 sice g is cotiuously differetiable ad strictly mootoic. Furthermore, y = g(x) dy = dg dx (x)dx. Let Y = g(x ), that is Y = {y x X : y = g(x)}. The E [y] = yf y (y) dy = Y X g(x) f x(x) dg dg dx (x) dx (x) dx = g(x)f x (x) dx. X Problem 8 Usig the law of the ucoscious statisticia 2, we have for a discrete radom variable x, E [ax + b] = x X ad for a cotiuous radom variable x, E [ax + b] = (ax + b)f x (x) = a xf x (x) +b f x (x) = ae [x] + b x X x X (ax + b)f x (x) dx = a } {{ } E[x] xf x (x) dx +b } {{ } E[x] } {{ } f x (x) dx = ae [x] + b. } {{ } Problem 9 Usig the law of the ucoscious statisticia 3 applied to the vector radom variable pdf f xy (x, y) we have, [ ] x with y E [g(x)h(y)] = g(x)h(y)f xy (x, y) dx dy = g(x)h(y)f x (x) f y (y) dx dy (by idepedece of x, y) = g(x)f x (x) dx h(y)f y (y) dy = E [g(x)] E [h(y)]. Ad similarly for discrete radom variables. Problem We will costruct a couter-example. Let x be a discrete radom variable that takes values -,, ad with probabilities 4, 2, ad 4, respectively. 2 See Problem 7. 3 See Problem 7. 9
10 Let w be a discrete radom variable takig the values -, with equal probability. Let x ad w be idepedet. Let y be a discrete radom variable defied by y = xw (it follows that y ca take values -,, ). By costructio, it is clear that y depeds o x. We will ow show that y ad x are ot idepedet, but E [xy] = E [x] E [y]. PDF f xy (x, y): x y f xy (x, y) x = (Prob 4 ) w = + (Prob 2 ) - impossible sice w - 8 x = (Prob 4 ) w = (Prob 2 ) - impossible 2 w either ±, x = Margializatio f x (x), f y (y):. x f(x) y f(y) It follows that f xy (x, y) = f x (x) f y (y) x, y does ot hold. For example, f xy (, ) = 8 = f x ( ) f y (). Expected values: E [xy] = x f xy (x, y) y = ( )( ) 8 + ( )() 8 + ()() 2 + ()( ) 8 + ()() 8 = E [x] = x xf x (x) E [y] = = = So, for all x, y, E [xy] = E [x] E [y], but ot f xy (x, y) = f x (x) f y (y). Hece, we have showed by couterexample that E [xy] = E [x] E [y] does ot imply idepedece of x ad y. Problem From the defiitio of the probability desity fuctio for discrete radom variables, f z ( z) = Pr (z = z).
11 The probability that z takes o z is give by the sum of the probabilities of all possibilities of x ad y such that z = x + y, that is all ȳ Y such that x = z ȳ ad y = ȳ (or, alteratively, x X s.t. x = x ad y = z x). That is, f z ( z) = Pr (z = z) = ȳ Y Pr (x = z ȳ) Pr (y = ȳ) (by idepedece assumptio) = ȳ Y f x ( z ȳ) f y (ȳ) Rewritig the last equatio yields f z (z) = y Y f x (z y) f y (y). Similarly, f z (z) = x X f x (x) f y (z x) may be obtaied. Problem 2 E [x] = = a a a xf(x) dx = xf(x) dx a xf(x) dx + } {{ } a af(x) dx f(x) dx = a Pr (x a) a xf(x) dx Problem 3 This iequality ca be obtaied usig Markov s iequality 4 : (x x) 2 is a oegative radom variable; apply Markov s iequality with a = k 2 (k ): Pr ( (x x) 2 k 2) E [ (x x) 2] k 2 = Var[x] k 2 = σ2 k 2 Sice (x x) 2 k 2 x x k, the result follows: Pr ( x x k) σ2 k 2. Problem 4 For t, we write F m (t) = Pr (m [, t]) = Pr (max{x,..., x } [, t]) = Pr (x i [, t] i {,..., }) = Pr (x [, t]) Pr (x 2 [, t]) Pr (x [, t]) = t. 4 See Problem 2.
12 By substitutig m for t, we obtai the desired result. Sice F m (m) = f m (m) = df m dm (m) = f m (τ) dτ, the pdf of m is obtaied by differetiatig, d dm (m ) = m. Problem 5 Let x = E [x]. The Var[x] = (x x) 2 f(x) dx = = E [ x 2] 2 x 2 + x 2 = E [ x 2] x 2 Sice Var[x], we have E [ x 2] = x 2 + Var[x] x 2, with equality if Var[x] =. x 2 f(x) dx 2 x xf(x) dx + x 2 } {{ } = x f(x) dx } {{ } = Problem 6 For fixed ȳ, Pr (x ȳ) = F x (ȳ). The probability that y [ȳ, ȳ + y] is Pr (y [ȳ, ȳ + y]) = ȳ+ y ȳ f y (y) dy f y (ȳ) y for small y. Therefore, the probability that x ȳ ad y [ȳ, ȳ + y] is Pr (x ȳ y [ȳ, ȳ + y]) = Pr (x ȳ) Pr (y [ȳ, ȳ + y]) F x (ȳ) f y (ȳ) y (3) by idepedece of x ad y. Now, sice we are iterested i Pr (x y), i.e. i the probabilty of x beig less tha ay y ad ot just a fixed ȳ, we ca sum (3) over all possible itervals [ȳ i, ȳ i + y] Pr ( ȳ i such that x ȳ i ) = lim By lettig y, we obtai Pr (x y) = F x (y) f y (y) dy. N N i= N F x (ȳ i ) f y (ȳ i ) y 2
13 Problem 7 Cosider the radom variable x +x 2 + +x. It has the mea [ ] x + x x E = (E [x ] + + E [x ]) = ( µ) = µ ad variace [ ] [ (x x + x x + x x Var = E = [ (E 2 (x µ) (x µ) 2 + cross terms The expected value of the cross terms is zero, for example, Hece, ) ] 2 µ ]). E [(x i µ) (x j µ)] = E [x i µ] E [x j µ] for i j, by idepedece =. [ ] x + x x Var = 2 (Var[x ] +... Var[x ]) = σ2 2 = σ2 Applyig Chebyshev s iequality with ϵ > gives ( ) x + x x Pr ϵ σ2 ϵ 2 ( ) x + x x Pr > ϵ Remark: Chagig to > is valid here, sice ( x,..., x ) ( x,..., x ) ( x,..., x ) Pr µ ϵ = Pr µ > ϵ + Pr µ =. } {{} = sice x + +x is a CRV Problem 8 First, we rewrite Pr (5 < x < 5) = Pr ( x < 5) = Pr ( x 5). Usig Chebyshev s iequality, with x =, σ 2 = 5, k = 5, yields Pr ( x 5) = 5 25 = 3 5. Therefore, we ca say that Pr (5 < x < 5) 3 5 =
14 Problem 9 First, we compute the mea of xy, E [xy] = E [x] E [y] = µ x µ y. Hece, by usig idepedece of x ad y ad the result of Problem 7, [ Var[xy] = E (xy) 2] (µ x µ y ) 2 = E [ x 2] E [ y 2] µ 2 xµ 2 y Usig E [ x 2] = σ 2 x + µ 2 x ad E [ y 2] = σ 2 y + µ 2 y, we obtai the result Var[xy] = ( σ 2 x + µ 2 x) ( σ 2 y + µ 2 y) µx µ y = σ 2 xσ 2 y + µ 2 yσ 2 x + µ 2 xσ 2 y. Problem 2 a) The cumulative distributio is ˆF x (x) = x λe λt dt = [ e λt] x t= = e λx. Let u be a sample from a uiform distributio. Accordig to the method preseted i class, we obtai a sample x by solvig u = ˆF x (x) for x, that is, u = e λx e λx = u λx = l ( u) x = Notice the followig properties: u x, u x +. b) For s, t, l( u). λ Pr (x > s + t x > t) Pr (x > s + t) Pr (x > s + t x > t) = = Pr (x > t) Pr (x > t) [ s+t = λe λx dx e λx ] t λe λx dx = s+t [ e λx ] = e λ(s+t) t e λt = e λs = s = Pr (x > s). λe λx dx 4
Recursive Estimation
Recursive Estimation Raffaello D Andrea Spring 28 Problem Set : Probability Review Last updated: March 6, 28 Notes: Notation: Unless otherwise noted, x, y, and z denote random variables, p x denotes the
More informationConvergence results for conditional expectations
Beroulli 11(4), 2005, 737 745 Covergece results for coditioal expectatios IRENE CRIMALDI 1 ad LUCA PRATELLI 2 1 Departmet of Mathematics, Uiversity of Bologa, Piazza di Porta Sa Doato 5, 40126 Bologa,
More informationThe golden search method: Question 1
1. Golde Sectio Search for the Mode of a Fuctio The golde search method: Questio 1 Suppose the last pair of poits at which we have a fuctio evaluatio is x(), y(). The accordig to the method, If f(x())
More informationON MATHIEU-BERG S INEQUALITY
ON MATHIEU-BERG S INEQUALITY BICHENG YANG DEPARTMENT OF MATHEMATICS, GUANGDONG EDUCATION COLLEGE, GUANGZHOU, GUANGDONG 533, PEOPLE S REPUBLIC OF CHINA. bcyag@pub.guagzhou.gd.c ABSTRACT. I this paper, by
More informationCIS 121 Data Structures and Algorithms with Java Fall Big-Oh Notation Tuesday, September 5 (Make-up Friday, September 8)
CIS 11 Data Structures ad Algorithms with Java Fall 017 Big-Oh Notatio Tuesday, September 5 (Make-up Friday, September 8) Learig Goals Review Big-Oh ad lear big/small omega/theta otatios Practice solvig
More informationBig-O Analysis. Asymptotics
Big-O Aalysis 1 Defiitio: Suppose that f() ad g() are oegative fuctios of. The we say that f() is O(g()) provided that there are costats C > 0 ad N > 0 such that for all > N, f() Cg(). Big-O expresses
More informationBig-O Analysis. Asymptotics
Big-O Aalysis 1 Defiitio: Suppose that f() ad g() are oegative fuctios of. The we say that f() is O(g()) provided that there are costats C > 0 ad N > 0 such that for all > N, f() Cg(). Big-O expresses
More informationCS 683: Advanced Design and Analysis of Algorithms
CS 683: Advaced Desig ad Aalysis of Algorithms Lecture 6, February 1, 2008 Lecturer: Joh Hopcroft Scribes: Shaomei Wu, Etha Feldma February 7, 2008 1 Threshold for k CNF Satisfiability I the previous lecture,
More informationLecture 2: Spectra of Graphs
Spectral Graph Theory ad Applicatios WS 20/202 Lecture 2: Spectra of Graphs Lecturer: Thomas Sauerwald & He Su Our goal is to use the properties of the adjacecy/laplacia matrix of graphs to first uderstad
More informationHomework 1 Solutions MA 522 Fall 2017
Homework 1 Solutios MA 5 Fall 017 1. Cosider the searchig problem: Iput A sequece of umbers A = [a 1,..., a ] ad a value v. Output A idex i such that v = A[i] or the special value NIL if v does ot appear
More informationPLEASURE TEST SERIES (XI) - 04 By O.P. Gupta (For stuffs on Math, click at theopgupta.com)
wwwtheopguptacom wwwimathematiciacom For all the Math-Gya Buy books by OP Gupta A Compilatio By : OP Gupta (WhatsApp @ +9-9650 350 0) For more stuffs o Maths, please visit : wwwtheopguptacom Time Allowed
More informationLecture 6. Lecturer: Ronitt Rubinfeld Scribes: Chen Ziv, Eliav Buchnik, Ophir Arie, Jonathan Gradstein
068.670 Subliear Time Algorithms November, 0 Lecture 6 Lecturer: Roitt Rubifeld Scribes: Che Ziv, Eliav Buchik, Ophir Arie, Joatha Gradstei Lesso overview. Usig the oracle reductio framework for approximatig
More informationRandom Graphs and Complex Networks T
Radom Graphs ad Complex Networks T-79.7003 Charalampos E. Tsourakakis Aalto Uiversity Lecture 3 7 September 013 Aoucemet Homework 1 is out, due i two weeks from ow. Exercises: Probabilistic iequalities
More informationCS473-Algorithms I. Lecture 2. Asymptotic Notation. CS 473 Lecture 2 1
CS473-Algorithms I Lecture Asymptotic Notatio CS 473 Lecture 1 O-otatio (upper bouds) f() = O(g()) if positive costats c, 0 such that e.g., = O( 3 ) 0 f() cg(), 0 c 3 c c = 1 & 0 = or c = & 0 = 1 Asymptotic
More informationLecture 1: Introduction and Strassen s Algorithm
5-750: Graduate Algorithms Jauary 7, 08 Lecture : Itroductio ad Strasse s Algorithm Lecturer: Gary Miller Scribe: Robert Parker Itroductio Machie models I this class, we will primarily use the Radom Access
More informationENGI 4421 Probability and Statistics Faculty of Engineering and Applied Science Problem Set 1 Descriptive Statistics
ENGI 44 Probability ad Statistics Faculty of Egieerig ad Applied Sciece Problem Set Descriptive Statistics. If, i the set of values {,, 3, 4, 5, 6, 7 } a error causes the value 5 to be replaced by 50,
More informationPseudocode ( 1.1) Analysis of Algorithms. Primitive Operations. Pseudocode Details. Running Time ( 1.1) Estimating performance
Aalysis of Algorithms Iput Algorithm Output A algorithm is a step-by-step procedure for solvig a problem i a fiite amout of time. Pseudocode ( 1.1) High-level descriptio of a algorithm More structured
More informationLecture 18. Optimization in n dimensions
Lecture 8 Optimizatio i dimesios Itroductio We ow cosider the problem of miimizig a sigle scalar fuctio of variables, f x, where x=[ x, x,, x ]T. The D case ca be visualized as fidig the lowest poit of
More informationMathematical Stat I: solutions of homework 1
Mathematical Stat I: solutios of homework Name: Studet Id N:. Suppose we tur over cards simultaeously from two well shuffled decks of ordiary playig cards. We say we obtai a exact match o a particular
More information1 Graph Sparsfication
CME 305: Discrete Mathematics ad Algorithms 1 Graph Sparsficatio I this sectio we discuss the approximatio of a graph G(V, E) by a sparse graph H(V, F ) o the same vertex set. I particular, we cosider
More informationCivil Engineering Computation
Civil Egieerig Computatio Fidig Roots of No-Liear Equatios March 14, 1945 World War II The R.A.F. first operatioal use of the Grad Slam bomb, Bielefeld, Germay. Cotets 2 Root basics Excel solver Newto-Raphso
More informationPackage popkorn. R topics documented: February 20, Type Package
Type Pacage Pacage popkor February 20, 2015 Title For iterval estimatio of mea of selected populatios Versio 0.3-0 Date 2014-07-04 Author Vi Gopal, Claudio Fuetes Maitaier Vi Gopal Depeds
More information5.3 Recursive definitions and structural induction
/8/05 5.3 Recursive defiitios ad structural iductio CSE03 Discrete Computatioal Structures Lecture 6 A recursively defied picture Recursive defiitios e sequece of powers of is give by a = for =0,,, Ca
More informationAlgorithms Chapter 3 Growth of Functions
Algorithms Chapter 3 Growth of Fuctios Istructor: Chig Chi Li 林清池助理教授 chigchi.li@gmail.com Departmet of Computer Sciece ad Egieerig Natioal Taiwa Ocea Uiversity Outlie Asymptotic otatio Stadard otatios
More informationProject 2.5 Improved Euler Implementation
Project 2.5 Improved Euler Implemetatio Figure 2.5.10 i the text lists TI-85 ad BASIC programs implemetig the improved Euler method to approximate the solutio of the iitial value problem dy dx = x+ y,
More informationPattern Recognition Systems Lab 1 Least Mean Squares
Patter Recogitio Systems Lab 1 Least Mea Squares 1. Objectives This laboratory work itroduces the OpeCV-based framework used throughout the course. I this assigmet a lie is fitted to a set of poits usig
More informationSome cycle and path related strongly -graphs
Some cycle ad path related strogly -graphs I. I. Jadav, G. V. Ghodasara Research Scholar, R. K. Uiversity, Rajkot, Idia. H. & H. B. Kotak Istitute of Sciece,Rajkot, Idia. jadaviram@gmail.com gaurag ejoy@yahoo.co.i
More informationTest 4 Review. dy du 9 5. sin5 zdz. dt. 5 Ê. x 2 È 1, 3. 2cos( x) dx is less than using Simpson's. ,1 t 5 t 2. ft () t2 4.
Name: Class: Date: ID: A Test Review Short Aswer. Fid the geeral solutio of the differetial equatio below ad check the result by differetiatio. dy du 9 u. Use the error formula to estimate the error i
More informationModule 8-7: Pascal s Triangle and the Binomial Theorem
Module 8-7: Pascal s Triagle ad the Biomial Theorem Gregory V. Bard April 5, 017 A Note about Notatio Just to recall, all of the followig mea the same thig: ( 7 7C 4 C4 7 7C4 5 4 ad they are (all proouced
More informationFundamentals of Media Processing. Shin'ichi Satoh Kazuya Kodama Hiroshi Mo Duy-Dinh Le
Fudametals of Media Processig Shi'ichi Satoh Kazuya Kodama Hiroshi Mo Duy-Dih Le Today's topics Noparametric Methods Parze Widow k-nearest Neighbor Estimatio Clusterig Techiques k-meas Agglomerative Hierarchical
More informationThe Extended Weibull Geometric Family
The Exteded Weibull Geometric Family Giovaa Oliveira Silva 1 Gauss M. Cordeiro 2 Edwi M. M. Ortega 3 1 Itroductio The literature o Weibull models is vast, disjoited, ad scattered across may differet jourals.
More informationMATHEMATICAL METHODS OF ANALYSIS AND EXPERIMENTAL DATA PROCESSING (Or Methods of Curve Fitting)
MATHEMATICAL METHODS OF ANALYSIS AND EXPERIMENTAL DATA PROCESSING (Or Methods of Curve Fittig) I this chapter, we will eamie some methods of aalysis ad data processig; data obtaied as a result of a give
More informationCONTINUI TY. JEE-Mathematics. Illustration 1 : Solution : Illustration 2 : 1. CONTINUOUS FUNCTIONS :
J-Mathematics. CONTINUOUS FUNCTIONS : CONTINUI TY A fuctio for which a small chage i the idepedet variable causes oly a small chage ad ot a sudde jump i the depedet variable are called cotiuous fuctios.
More informationThe Adjacency Matrix and The nth Eigenvalue
Spectral Graph Theory Lecture 3 The Adjacecy Matrix ad The th Eigevalue Daiel A. Spielma September 5, 2012 3.1 About these otes These otes are ot ecessarily a accurate represetatio of what happeed i class.
More informationIntegration: Reduction Formulas Any positive integer power of sin x can be integrated by using a reduction formula.
Itegratio: Reductio Formulas Ay positive iteger power of si x ca be itegrated by usig a reductio formula. Prove that for ay iteger 2, si xdx = 1 si 1 x cos x + 1 si Solutio. Weuseitegratiobyparts. Let
More informationData Structures and Algorithms. Analysis of Algorithms
Data Structures ad Algorithms Aalysis of Algorithms Outlie Ruig time Pseudo-code Big-oh otatio Big-theta otatio Big-omega otatio Asymptotic algorithm aalysis Aalysis of Algorithms Iput Algorithm Output
More informationOur Learning Problem, Again
Noparametric Desity Estimatio Matthew Stoe CS 520, Sprig 2000 Lecture 6 Our Learig Problem, Agai Use traiig data to estimate ukow probabilities ad probability desity fuctios So far, we have depeded o describig
More informationNumerical Methods Lecture 6 - Curve Fitting Techniques
Numerical Methods Lecture 6 - Curve Fittig Techiques Topics motivatio iterpolatio liear regressio higher order polyomial form expoetial form Curve fittig - motivatio For root fidig, we used a give fuctio
More informationBASED ON ITERATIVE ERROR-CORRECTION
A COHPARISO OF CRYPTAALYTIC PRICIPLES BASED O ITERATIVE ERROR-CORRECTIO Miodrag J. MihaljeviC ad Jova Dj. GoliC Istitute of Applied Mathematics ad Electroics. Belgrade School of Electrical Egieerig. Uiversity
More informationFINITE DIFFERENCE TIME DOMAIN METHOD (FDTD)
FINIT DIFFRNC TIM DOMAIN MTOD (FDTD) The FDTD method, proposed b Yee, 1966, is aother umerical method, used widel for the solutio of M problems. It is used to solve ope-regio scatterig, radiatio, diffusio,
More informationRunning Time. Analysis of Algorithms. Experimental Studies. Limitations of Experiments
Ruig Time Aalysis of Algorithms Iput Algorithm Output A algorithm is a step-by-step procedure for solvig a problem i a fiite amout of time. Most algorithms trasform iput objects ito output objects. The
More informationCIS 121 Data Structures and Algorithms with Java Spring Stacks and Queues Monday, February 12 / Tuesday, February 13
CIS Data Structures ad Algorithms with Java Sprig 08 Stacks ad Queues Moday, February / Tuesday, February Learig Goals Durig this lab, you will: Review stacks ad queues. Lear amortized ruig time aalysis
More informationRunning Time ( 3.1) Analysis of Algorithms. Experimental Studies. Limitations of Experiments
Ruig Time ( 3.1) Aalysis of Algorithms Iput Algorithm Output A algorithm is a step- by- step procedure for solvig a problem i a fiite amout of time. Most algorithms trasform iput objects ito output objects.
More informationAnalysis of Algorithms
Aalysis of Algorithms Iput Algorithm Output A algorithm is a step-by-step procedure for solvig a problem i a fiite amout of time. Ruig Time Most algorithms trasform iput objects ito output objects. The
More informationComputational Geometry
Computatioal Geometry Chapter 4 Liear programmig Duality Smallest eclosig disk O the Ageda Liear Programmig Slides courtesy of Craig Gotsma 4. 4. Liear Programmig - Example Defie: (amout amout cosumed
More informationOn Infinite Groups that are Isomorphic to its Proper Infinite Subgroup. Jaymar Talledo Balihon. Abstract
O Ifiite Groups that are Isomorphic to its Proper Ifiite Subgroup Jaymar Talledo Baliho Abstract Two groups are isomorphic if there exists a isomorphism betwee them Lagrage Theorem states that the order
More informationSection 7.2: Direction Fields and Euler s Methods
Sectio 7.: Directio ields ad Euler s Methods Practice HW from Stewart Tetbook ot to had i p. 5 # -3 9-3 odd or a give differetial equatio we wat to look at was to fid its solutio. I this chapter we will
More informationWhat are we going to learn? CSC Data Structures Analysis of Algorithms. Overview. Algorithm, and Inputs
What are we goig to lear? CSC316-003 Data Structures Aalysis of Algorithms Computer Sciece North Carolia State Uiversity Need to say that some algorithms are better tha others Criteria for evaluatio Structure
More informationcondition w i B i S maximum u i
ecture 10 Dyamic Programmig 10.1 Kapsack Problem November 1, 2004 ecturer: Kamal Jai Notes: Tobias Holgers We are give a set of items U = {a 1, a 2,..., a }. Each item has a weight w i Z + ad a utility
More informationHow do we evaluate algorithms?
F2 Readig referece: chapter 2 + slides Algorithm complexity Big O ad big Ω To calculate ruig time Aalysis of recursive Algorithms Next time: Litterature: slides mostly The first Algorithm desig methods:
More informationExamples and Applications of Binary Search
Toy Gog ITEE Uiersity of Queeslad I the secod lecture last week we studied the biary search algorithm that soles the problem of determiig if a particular alue appears i a sorted list of iteger or ot. We
More informationProtected points in ordered trees
Applied Mathematics Letters 008 56 50 www.elsevier.com/locate/aml Protected poits i ordered trees Gi-Sag Cheo a, Louis W. Shapiro b, a Departmet of Mathematics, Sugkyukwa Uiversity, Suwo 440-746, Republic
More informationOutline and Reading. Analysis of Algorithms. Running Time. Experimental Studies. Limitations of Experiments. Theoretical Analysis
Outlie ad Readig Aalysis of Algorithms Iput Algorithm Output Ruig time ( 3.) Pseudo-code ( 3.2) Coutig primitive operatios ( 3.3-3.) Asymptotic otatio ( 3.6) Asymptotic aalysis ( 3.7) Case study Aalysis
More informationCounting the Number of Minimum Roman Dominating Functions of a Graph
Coutig the Number of Miimum Roma Domiatig Fuctios of a Graph SHI ZHENG ad KOH KHEE MENG, Natioal Uiversity of Sigapore We provide two algorithms coutig the umber of miimum Roma domiatig fuctios of a graph
More informationNew Results on Energy of Graphs of Small Order
Global Joural of Pure ad Applied Mathematics. ISSN 0973-1768 Volume 13, Number 7 (2017), pp. 2837-2848 Research Idia Publicatios http://www.ripublicatio.com New Results o Eergy of Graphs of Small Order
More informationOctahedral Graph Scaling
Octahedral Graph Scalig Peter Russell Jauary 1, 2015 Abstract There is presetly o strog iterpretatio for the otio of -vertex graph scalig. This paper presets a ew defiitio for the term i the cotext of
More information6.854J / J Advanced Algorithms Fall 2008
MIT OpeCourseWare http://ocw.mit.edu 6.854J / 18.415J Advaced Algorithms Fall 2008 For iformatio about citig these materials or our Terms of Use, visit: http://ocw.mit.edu/terms. 18.415/6.854 Advaced Algorithms
More informationImage Segmentation EEE 508
Image Segmetatio Objective: to determie (etract) object boudaries. It is a process of partitioig a image ito distict regios by groupig together eighborig piels based o some predefied similarity criterio.
More informationAlpha Individual Solutions MAΘ National Convention 2013
Alpha Idividual Solutios MAΘ Natioal Covetio 0 Aswers:. D. A. C 4. D 5. C 6. B 7. A 8. C 9. D 0. B. B. A. D 4. C 5. A 6. C 7. B 8. A 9. A 0. C. E. B. D 4. C 5. A 6. D 7. B 8. C 9. D 0. B TB. 570 TB. 5
More informationArea As A Limit & Sigma Notation
Area As A Limit & Sigma Notatio SUGGESTED REFERENCE MATERIAL: As you work through the problems listed below, you should referece Chapter 5.4 of the recommeded textbook (or the equivalet chapter i your
More informationUNIT 4 Section 8 Estimating Population Parameters using Confidence Intervals
UNIT 4 Sectio 8 Estimatig Populatio Parameters usig Cofidece Itervals To make ifereces about a populatio that caot be surveyed etirely, sample statistics ca be take from a SRS of the populatio ad used
More informationOn (K t e)-saturated Graphs
Noame mauscript No. (will be iserted by the editor O (K t e-saturated Graphs Jessica Fuller Roald J. Gould the date of receipt ad acceptace should be iserted later Abstract Give a graph H, we say a graph
More informationMath 216A Notes, Week 4
Math 216A Notes, Week 4 Scribe: Jaso Erbele Disclaimer: These otes are ot early as polished ad quite possibly ot early as correct) as a published paper. Please use them at your ow risk. 1. Probabilistic
More informationImproved Random Graph Isomorphism
Improved Radom Graph Isomorphism Tomek Czajka Gopal Paduraga Abstract Caoical labelig of a graph cosists of assigig a uique label to each vertex such that the labels are ivariat uder isomorphism. Such
More informationA Study on Weibull Distribution for Estimating the Reliability Dr. P. K. Suri 1, Parul Raheja 2
www.ijecs.i Iteratioal Joural Of Egieerig Ad Computer Sciece ISSN:239-7242 Volume 4 Issue 7 July 205, Page No. 3447-345 A Study o Weibull Distributio for Estimatig the Reliability Dr. P. K. Suri, Parul
More informationMarkov Chain Model of HomePlug CSMA MAC for Determining Optimal Fixed Contention Window Size
Markov Chai Model of HomePlug CSMA MAC for Determiig Optimal Fixed Cotetio Widow Size Eva Krimiger * ad Haiph Latchma Dept. of Electrical ad Computer Egieerig, Uiversity of Florida, Gaiesville, FL, USA
More informationOn Spectral Theory Of K-n- Arithmetic Mean Idempotent Matrices On Posets
Iteratioal Joural of Sciece, Egieerig ad echology Research (IJSER), Volume 5, Issue, February 016 O Spectral heory Of -- Arithmetic Mea Idempotet Matrices O Posets 1 Dr N Elumalai, ProfRMaikada, 3 Sythiya
More informationBayesian approach to reliability modelling for a probability of failure on demand parameter
Bayesia approach to reliability modellig for a probability of failure o demad parameter BÖRCSÖK J., SCHAEFER S. Departmet of Computer Architecture ad System Programmig Uiversity Kassel, Wilhelmshöher Allee
More informationCIS 121 Data Structures and Algorithms with Java Spring Stacks, Queues, and Heaps Monday, February 18 / Tuesday, February 19
CIS Data Structures ad Algorithms with Java Sprig 09 Stacks, Queues, ad Heaps Moday, February 8 / Tuesday, February 9 Stacks ad Queues Recall the stack ad queue ADTs (abstract data types from lecture.
More informationBezier curves. Figure 2 shows cubic Bezier curves for various control points. In a Bezier curve, only
Edited: Yeh-Liag Hsu (998--; recommeded: Yeh-Liag Hsu (--9; last updated: Yeh-Liag Hsu (9--7. Note: This is the course material for ME55 Geometric modelig ad computer graphics, Yua Ze Uiversity. art of
More information( n+1 2 ) , position=(7+1)/2 =4,(median is observation #4) Median=10lb
Chapter 3 Descriptive Measures Measures of Ceter (Cetral Tedecy) These measures will tell us where is the ceter of our data or where most typical value of a data set lies Mode the value that occurs most
More informationEVALUATION OF TRIGONOMETRIC FUNCTIONS
EVALUATION OF TRIGONOMETRIC FUNCTIONS Whe first exposed to trigoometric fuctios i high school studets are expected to memorize the values of the trigoometric fuctios of sie cosie taget for the special
More information15-859E: Advanced Algorithms CMU, Spring 2015 Lecture #2: Randomized MST and MST Verification January 14, 2015
15-859E: Advaced Algorithms CMU, Sprig 2015 Lecture #2: Radomized MST ad MST Verificatio Jauary 14, 2015 Lecturer: Aupam Gupta Scribe: Yu Zhao 1 Prelimiaries I this lecture we are talkig about two cotets:
More informationUniversity of Waterloo Department of Electrical and Computer Engineering ECE 250 Algorithms and Data Structures
Uiversity of Waterloo Departmet of Electrical ad Computer Egieerig ECE 250 Algorithms ad Data Structures Midterm Examiatio ( pages) Istructor: Douglas Harder February 7, 2004 7:30-9:00 Name (last, first)
More informationBOOLEAN MATHEMATICS: GENERAL THEORY
CHAPTER 3 BOOLEAN MATHEMATICS: GENERAL THEORY 3.1 ISOMORPHIC PROPERTIES The ame Boolea Arithmetic was chose because it was discovered that literal Boolea Algebra could have a isomorphic umerical aspect.
More informationCSC165H1 Worksheet: Tutorial 8 Algorithm analysis (SOLUTIONS)
CSC165H1, Witer 018 Learig Objectives By the ed of this worksheet, you will: Aalyse the ruig time of fuctios cotaiig ested loops. 1. Nested loop variatios. Each of the followig fuctios takes as iput a
More informationThe number n of subintervals times the length h of subintervals gives length of interval (b-a).
Simulator with MadMath Kit: Riema Sums (Teacher s pages) I your kit: 1. GeoGebra file: Ready-to-use projector sized simulator: RiemaSumMM.ggb 2. RiemaSumMM.pdf (this file) ad RiemaSumMMEd.pdf (educator's
More informationCharacterizing graphs of maximum principal ratio
Characterizig graphs of maximum pricipal ratio Michael Tait ad Josh Tobi November 9, 05 Abstract The pricipal ratio of a coected graph, deoted γg, is the ratio of the maximum ad miimum etries of its first
More informationTaylor Series and Applications - (8.7)(8.8) b n!x # c" n for x # c " R.!x # c" # f %%!c" 2! T!x"! 1 # x # x2 2! # x3. 3! n!
Taylor Series ad Applicatios - (8.7)(8.8). Taylor ad Maclauri Series: For a give fuctio f!x, how ca we fid its power series represetatio? If f has a power series represetatio at a umber a, that is, if
More informationOn Computing the Fuzzy Weighted Average Using the KM Algorithms
O Computig the Fuzzy Weighted Average Usig the KM Algorithms Feilog iu ad Jerry M Medel Sigal ad Image Processig Istitute, Departmet of Electrical Egieerig Uiversity of Souther Califoria, 3740 McClitock
More informationSome new results on recursive aggregation rules
Some ew results o recursive aggregatio rules Daiel Gómez Escuela de Estadística Uiversidad Complutese Madrid, 28040 Spai dagomez@estad.ucm.es Javier Motero Facultad de Matemáticas Uiversidad Complutese
More informationMessage Authentication Codes. Reading: Chapter 4 of Katz & Lindell
Message Autheticatio Codes Readig: Chapter 4 of Katz & Lidell 1 Message autheticatio Bob receives a message m from Alice, he wats to ow (Data origi autheticatio) whether the message was really set by Alice.
More informationRedundancy Allocation for Series Parallel Systems with Multiple Constraints and Sensitivity Analysis
IOSR Joural of Egieerig Redudacy Allocatio for Series Parallel Systems with Multiple Costraits ad Sesitivity Aalysis S. V. Suresh Babu, D.Maheswar 2, G. Ragaath 3 Y.Viaya Kumar d G.Sakaraiah e (Mechaical
More informationAlgorithm. Counting Sort Analysis of Algorithms
Algorithm Coutig Sort Aalysis of Algorithms Assumptios: records Coutig sort Each record cotais keys ad data All keys are i the rage of 1 to k Space The usorted list is stored i A, the sorted list will
More informationLecture 13: Validation
Lecture 3: Validatio Resampli methods Holdout Cross Validatio Radom Subsampli -Fold Cross-Validatio Leave-oe-out The Bootstrap Bias ad variace estimatio Three-way data partitioi Itroductio to Patter Recoitio
More informationCubic Polynomial Curves with a Shape Parameter
roceedigs of the th WSEAS Iteratioal Coferece o Robotics Cotrol ad Maufacturig Techology Hagzhou Chia April -8 00 (pp5-70) Cubic olyomial Curves with a Shape arameter MO GUOLIANG ZHAO YANAN Iformatio ad
More informationAssignment 5; Due Friday, February 10
Assigmet 5; Due Friday, February 10 17.9b The set X is just two circles joied at a poit, ad the set X is a grid i the plae, without the iteriors of the small squares. The picture below shows that the iteriors
More informationA Note on Chromatic Transversal Weak Domination in Graphs
Iteratioal Joural of Mathematics Treds ad Techology Volume 17 Number 2 Ja 2015 A Note o Chromatic Trasversal Weak Domiatio i Graphs S Balamuruga 1, P Selvalakshmi 2 ad A Arivalaga 1 Assistat Professor,
More informationOnes Assignment Method for Solving Traveling Salesman Problem
Joural of mathematics ad computer sciece 0 (0), 58-65 Oes Assigmet Method for Solvig Travelig Salesma Problem Hadi Basirzadeh Departmet of Mathematics, Shahid Chamra Uiversity, Ahvaz, Ira Article history:
More informationThe Closest Line to a Data Set in the Plane. David Gurney Southeastern Louisiana University Hammond, Louisiana
The Closest Lie to a Data Set i the Plae David Gurey Southeaster Louisiaa Uiversity Hammod, Louisiaa ABSTRACT This paper looks at three differet measures of distace betwee a lie ad a data set i the plae:
More informationSD vs. SD + One of the most important uses of sample statistics is to estimate the corresponding population parameters.
SD vs. SD + Oe of the most importat uses of sample statistics is to estimate the correspodig populatio parameters. The mea of a represetative sample is a good estimate of the mea of the populatio that
More informationFuzzy Minimal Solution of Dual Fully Fuzzy Matrix Equations
Iteratioal Coferece o Applied Mathematics, Simulatio ad Modellig (AMSM 2016) Fuzzy Miimal Solutio of Dual Fully Fuzzy Matrix Equatios Dequa Shag1 ad Xiaobi Guo2,* 1 Sciece Courses eachig Departmet, Gasu
More informationML Estimation of the Multivariate t Distribution and the EM Algorithm
Joural of Multivariate Aalysis 63, 9631 (1997) Article No. MV971703 ML Estimatio of the Multivariate t Distributio ad the EM Algorithm Chuahai Liu Bell Laboratories, Lucet Techologies Maximum likelihood
More informationA New Morphological 3D Shape Decomposition: Grayscale Interframe Interpolation Method
A ew Morphological 3D Shape Decompositio: Grayscale Iterframe Iterpolatio Method D.. Vizireau Politehica Uiversity Bucharest, Romaia ae@comm.pub.ro R. M. Udrea Politehica Uiversity Bucharest, Romaia mihea@comm.pub.ro
More informationThe isoperimetric problem on the hypercube
The isoperimetric problem o the hypercube Prepared by: Steve Butler November 2, 2005 1 The isoperimetric problem We will cosider the -dimesioal hypercube Q Recall that the hypercube Q is a graph whose
More informationThe Platonic solids The five regular polyhedra
The Platoic solids The five regular polyhedra Ole Witt-Hase jauary 7 www.olewitthase.dk Cotets. Polygos.... Topologically cosideratios.... Euler s polyhedro theorem.... Regular ets o a sphere.... The dihedral
More informationMatrix representation of a solution of a combinatorial problem of the group theory
Matrix represetatio of a solutio of a combiatorial problem of the group theory Krasimir Yordzhev, Lilyaa Totia Faculty of Mathematics ad Natural Scieces South-West Uiversity 66 Iva Mihailov Str, 2700 Blagoevgrad,
More informationIMP: Superposer Integrated Morphometrics Package Superposition Tool
IMP: Superposer Itegrated Morphometrics Package Superpositio Tool Programmig by: David Lieber ( 03) Caisius College 200 Mai St. Buffalo, NY 4208 Cocept by: H. David Sheets, Dept. of Physics, Caisius College
More informationCOMP 558 lecture 6 Sept. 27, 2010
Radiometry We have discussed how light travels i straight lies through space. We would like to be able to talk about how bright differet light rays are. Imagie a thi cylidrical tube ad cosider the amout
More informationΣ P(i) ( depth T (K i ) + 1),
EECS 3101 York Uiversity Istructor: Ady Mirzaia DYNAMIC PROGRAMMING: OPIMAL SAIC BINARY SEARCH REES his lecture ote describes a applicatio of the dyamic programmig paradigm o computig the optimal static
More information