EC 521 MATHEMATICAL METHODS FOR ECONOMICS. Lecture 2: Convex Sets
|
|
- Jasper Morris
- 5 years ago
- Views:
Transcription
1 EC 51 MATHEMATICAL METHODS FOR ECONOMICS Lecture : Convex Sets Murat YILMAZ Boğaziçi University In this section, we focus on convex sets, separating hyperplane theorems and Farkas Lemma. And as an application we look at a linear production model and characterize efficiency. We begin with the definition of a convex set. These lecture notes are mostly based on Chapter 3 in Advanced Mathematical Economics by R.V. Vohra. Definition 1 A set C of vectors/points is called convex if for all x, y C and λ [0, 1], λx + (1 λ)y C. convex not convex Remark 1. (1) A set in R n is convex if whenever it contains two vectors/elements, it also contains the entire line segment connecting them. () If x 1, x,..., x k C is convex, then k i=1 λ ix i C where k i=1 λ i = 1, λ i 0 i. (3) Let X, Y R n be two convex sets. Then: (i) X + Y = {z R n : z = x + y x X, y Y } is convex. (ii) αx = {z R n : z = αx x X, α R} is convex. 1
2 (iii) X Y is convex (in fact, intersection of any collection of convex sets is convex.) (iv) X Y might not be convex. (4) {x : Ax = b x = 0} is convex. Why? Let x 1, x C = {x : Ax = b x 0}. Then, Ax 1 = b = Ax, and A(λx 1 + (1 λ)x ) = λax 1 + (1 λ)ax = λb + (1 λ)b = b. Thus, λx 1 + (1 λ)x C. (5) If f : S R is concave, then the set {(x, y) R n+1 : y f(x) x S R n } is convex. Why? Let (x 1, y 1 ), (x, y ) {(x, y) : y f(x)}. Then, y 1 f(x 1 ) and y f(x ). That is, λy 1 + (1 λ)y λf(x 1 ) + (1 λ)f(x ) f(λx 1 + (1 λ)x ). Thus, we get the following: (λy 1 + (1 λ)y, λx 1 + (1 λ)x ) {(x, y) : y f(x)} Note the reflection of this property in consumer theory: u concave upper contour set convex. Separating Hyperplane Theorems Main idea: b / C straight line C convex b y L z x C convex x chosen to be the closest element in C to point b, with b x. Line L is perpendicular to [b, x ] segment and is midway between x and b. For L to be our separator, need to show y C lies to the left/up of L. If not, all z [y, x ] C. But z is closer to b.
3 First, we make sure such an x (closest point to b) exists. Lemma 1 Let C be a compact set not containing the origin. Then, there exists an x C such that d(x, 0) = inf x C d(x, 0) > 0. Proof. Follows directly from the continuity of d(x) and the Weierstrass Maximum Theorem. Definition Let h R n and β R. A hyperplane is a set H h,β = {x R n : hx = β} A halfspace (below H h,β ) is a set H h,β = {x R n : hx β} A halfspace (above H h,β ) is a set H h,β = {x R n : hx β} x x {x R : (a, b) x 1} H (a,b),1 :ax 1 + bx = 1 ax 1 + bx 1 x 1 x 1 a hyperplane a half space Theorem 1 (Strict Separating Hyperplane Theorem) Let C be a closed convex set and b / C. Then there is a hyperplane H h,β such that h b < β < h x x C Proof. By a translation of the coordinates we assume that b = 0, without loss of generality. Choose x C that minimizes d(x, 0) for x C. By Lemma 1 above, such an x exists and d(x, 0) > 0. (Note that Lemma 1 assumes compactness but here we don t. Here is why: Pick any y C and let C = C {x C : d(x, 0) d(y, 0)}. Notice that C is closed because both C and {x C : d(x, 0) d(y, 0)} are closed. C is also bounded. Now, it is easy to see that the point in C closest to 0 is also the point in C closest to 0.) Let m be the midpoint of the line joining 0 to x, i.e. m = x. Choose H h,β that goes through m and is perpendicular to the line joining 0 and x. That is, we choose h to be the vector x scaled by d(x, 0). That is, h = x d(x x,0). Set β = h m. Notice β = h m = x d(x,0) = d(x,0). 3
4 Next, we verify that b = 0 is on one side of H h,β and x is on the other side. Observe that h b = 0 < d(x,0) = h m = β. Next, h x = x x d(x,0) = d(x, 0) > d(x,0) = h m = β. Now, pick any x C (x x ). Since C is convex (1 λ)x + λx C. From the choice of x, d(x, 0) d((1 λ)x + λx, 0). Since d(z, 0) = z z we have d(x, 0) [(1 λ)x + λx] [(1 λ)x + λx] = (x + λ(x x )) (x + λ(x x )) = d(x, 0) + λx (x x ) + λ d(x x, 0). That is, 0 x (x x ) + λd(x x, 0). Since, λ can be picked arbitrarily small, we get x (x x ) 0 x C. Using x = m and h = is, h x m h > h m = β. So x C, h x > β. x d(x,0), we get 0 [d(x, 0) h] (x m), that x x m C b = 0 H h,β x 1 h x = β This theorem basically says that a hyperplane H h,β strictly separates C from b, if C is closed and convex. If we drop the requirement that C be closed, we obtain a weaker result. Theorem (Weak Separating Hyperplane Theorem) Let C be a convex set and b / C. Then there is a hyperplane H h,β such that h b β h x x C Proof. The only difference from the proof of the previous theorem is that x is chosen so that d(x, 0) = inf x C d(x, 0). Since it is possible that x = b (i.e., if b were on the boundary of C, x not necessarily in C), the strict inequalities in the previous theorem must be replaced by weak inequalities. Theorem 3 Let C, D R n be two non-empty, disjoint, convex sets. Then there exists a hyperplane H h,β such that h x β h y for all x C and y D. Proof. K = {z : z = x y, x C, y D} is convex and 0 / K. By weak seperating hyperplane theorem, H h,β such that h 0 β h z z K. Pick any x C, y D. Then 4
5 h (x y) = h x h y 0. In particular, h x inf u C h u sup v D h v h y. Choose β [inf u C h u, sup v D h v] to complete the proof. What if both C and D are also closed? Do we get the strict version of above theorem? No, only if one of them is bounded. (counterexample?) Theorem 4 Let C, D R n be two non-empty, disjoint, closed and convex sets with at least one of them being bounded. Then there exists a hyperplane H h,β such that h x > β > h y for all x C and y D (where C is bounded). Proof. Similar to the one above. Just show K is closed and apply strict seperating hyperplane theorem. Definition 3 The set of all non-negative linear combinations of the columns of A m n is called the finite cone generated by the columns of A m n and denoted by cone(a). That is, cone(a) = {y R m : y = A m n x for some x R n +} Lemma cone(a) is convex and closed. Proof. Convexity is easy. For closedness, first show cone(b) is closed if all columns of B are LI. Complete the proof as an exercise. Theorem 5 (Farkas Lemma) Let A be an m n matrix and b R m. Let F = {x R n : Ax = b, x 0}. Then, either F 0 or y R m such that ya 0, y b < 0, but not both. Proof. First, we show not both part: Suppose F 0. Choose any x F. Then y b = y Ax = (y A)x 0. Now, suppose F = 0. Then, b / cone(a). Since cone(a) is closed and convex, we can use the strict seperating hyperplane theorem to identify a hyperplane H h,β that seperates b from cone(a). Without loss of generality, we can assume that h b < β < h z z cone(a). Since the origin is in cone(a), it is easy to see that β < 0. Let a j be the j th column vector of the matrix A. We show that h a j 0. Suppose not, i.e. h a j < 0. Note that λa j cone(a) for any λ 0. Thus, h (λa j ) > β since λa j cone(a). Since λ can be chosen arbitrarily large, h (λa j ) can be made smaller than β, which gives a contradiction. Thus, h a j 0 for all columns of A. Hence y = h is our required vector with y A 0 and y b < 0. 5
6 Polyhedrons and Polytopes Definition 4 Let S R n. A vector v R n can be expressed as a convex combination of vectors in S if there is a finite set {v 1,..., v m } S such that v = m j=1 λ jv j with m j=1 λ j = 1, λ j 0 j. Definition 5 Let S R n. The convex hull of S, conv(s), is the set of all vectors that can be expressed as a convex combination of vectors in S. (Alternatively: conv(s) is the smallest convex set containing S, or conv(s) is the intersection of all convex sets that contain S.) Definition 6 A set P R n is called a polytope if there is a finite S R n such that P = conv(s). Definition 7 A non-empty set P R n is called a polyhedron if there is an m n matrix A and a vector b R m such that P = {x R n : Ax b}. Theorem 6 The set of all convex combinations of a finite number of vectors is a polyhedron. Thus, a polytope is a polyhedron. A polyhedron is a polytope if it is also bounded. Definition 8 Let S R n be convex. An extreme point of S is a point that can not be expressed as a convex combination of any other points in S. Theorem 7 If P is a polytope, then each x P can be written as a convex combination of its extreme points. Application: Linear Production Model Let x R m be a non-negative input vector. Let y R n be a non-negative output vector. Let P be a m n production matrix that relates outputs to inputs as follows: y 1 n = x 1 m P m n. Here p ij is the amount of the j th output generated from one unit of the i th input. Let b R k be a non-negative resource/capacity vector that lists the amount of raw materials available for production. Let C m k be an m k non-negative consumption matrix that relates inputs to resources: x 1 m C m k b 1 k. Here c ij is the amount of resource j consumed to produce one unit of input i. The input space is X = {x R m : x C b, x 0}. The output space is Y = {y R n : y = x P, x X, y 0}. An output vector y is efficient if there is no other y Y such that y y. 6
7 Theorem 8 A vector y Y is efficient iff there exists a non-negative, non-trivial price vector p such that y p y p for all y Y. Proof. ( ): This is almost trivial. If y p y p y Y for some price vector p, then for no other y Y, y y. Thus, y is efficient. ( ): Suppose that y is efficient. First we prove the following claim: Claim 1 There exists a matrix D with n rows and a vector r such that Y = {y R n : y D r} Proof. Let x 1, x,..., x k be the extreme points of X. Pick any y Y. Then there is an x X such that y = x P. Since X is a polytope (X is a polyhedron and bounded. And every polyhedron that is bounded is also a polytope), any element in X can be expressed as a convex combination of its extreme points. Thus, {λ j } k j=1 such that x = λ 1x 1 +λ x +...+λ k x k. Thus, we can write y = λ 1 x 1 P + λ x P λ k x k P. This means, each y Y can be written as a convex combination of {x 1 P, x P,..., x k P }. It is straightforward to see any convex combination of these vectors is also in Y. Hence, Y is a convex combination of a finite number of points, i.e., Y = conv({x 1 P,..., x k P }). Thus, Y is a polytope and hence it is a polyhedron, that is, A m n and b R m such that Y = {y R n : A y b} and the result follows. So, now we know Y = {y R n : y D r} for some D and r. Let S = {j : y d j = r j } where d j is the j th column of D. We show S. Suppose not. Then, y d j < r j for all j. Let w be the vector obtained from y by adding ɛ > 0 to the first component of y. Then w d j = y d j + ɛd 1j. The assumption S = allows us to choose ɛ sufficiently small so that y d j + ɛd 1j r j. Thus, w Y and w y contradicting the efficiency of y. Thus, S. Consider now the system {z d j 0} j S. We claim that there is no non-trivial non-negative solution z R n. If there is, there is an ɛ > 0 sufficiently small such that (y + ɛz)d j r j j, implying y + ɛz Y contradicting the efficiency of y. Since the system {z d j 0} j S does not admit a non-trivial non-negative solution, we have by a version of Farkas Lemma, non-negative numbers {λ j } j S such that j S λ jd j > 0. Setting p = j S λ jd j completes the proof of Theorem 8, since y j S λ jd j y j S λ jd j y Y. Note that y j S λ jd j = j S λ jyd j j S λ jr j = j S λ jy d j. See Propositions 5.F.1 and 5.F. in Mas-Colell et al, Microeconomic Theory, page , for a similar result. Theorem 8 is a simpler version of first and second welfare theorems. 7
Numerical Optimization
Convex Sets Computer Science and Automation Indian Institute of Science Bangalore 560 012, India. NPTEL Course on Let x 1, x 2 R n, x 1 x 2. Line and line segment Line passing through x 1 and x 2 : {y
More informationLecture 2 - Introduction to Polytopes
Lecture 2 - Introduction to Polytopes Optimization and Approximation - ENS M1 Nicolas Bousquet 1 Reminder of Linear Algebra definitions Let x 1,..., x m be points in R n and λ 1,..., λ m be real numbers.
More informationMath 5593 Linear Programming Lecture Notes
Math 5593 Linear Programming Lecture Notes Unit II: Theory & Foundations (Convex Analysis) University of Colorado Denver, Fall 2013 Topics 1 Convex Sets 1 1.1 Basic Properties (Luenberger-Ye Appendix B.1).........................
More informationConvex Optimization Lecture 2
Convex Optimization Lecture 2 Today: Convex Analysis Center-of-mass Algorithm 1 Convex Analysis Convex Sets Definition: A set C R n is convex if for all x, y C and all 0 λ 1, λx + (1 λ)y C Operations that
More informationLecture 5: Duality Theory
Lecture 5: Duality Theory Rajat Mittal IIT Kanpur The objective of this lecture note will be to learn duality theory of linear programming. We are planning to answer following questions. What are hyperplane
More informationCS522: Advanced Algorithms
Lecture 1 CS5: Advanced Algorithms October 4, 004 Lecturer: Kamal Jain Notes: Chris Re 1.1 Plan for the week Figure 1.1: Plan for the week The underlined tools, weak duality theorem and complimentary slackness,
More informationConvexity: an introduction
Convexity: an introduction Geir Dahl CMA, Dept. of Mathematics and Dept. of Informatics University of Oslo 1 / 74 1. Introduction 1. Introduction what is convexity where does it arise main concepts and
More informationLecture 2 September 3
EE 381V: Large Scale Optimization Fall 2012 Lecture 2 September 3 Lecturer: Caramanis & Sanghavi Scribe: Hongbo Si, Qiaoyang Ye 2.1 Overview of the last Lecture The focus of the last lecture was to give
More informationORIE 6300 Mathematical Programming I September 2, Lecture 3
ORIE 6300 Mathematical Programming I September 2, 2014 Lecturer: David P. Williamson Lecture 3 Scribe: Divya Singhvi Last time we discussed how to take dual of an LP in two different ways. Today we will
More informationMathematical Programming and Research Methods (Part II)
Mathematical Programming and Research Methods (Part II) 4. Convexity and Optimization Massimiliano Pontil (based on previous lecture by Andreas Argyriou) 1 Today s Plan Convex sets and functions Types
More informationConvex Geometry arising in Optimization
Convex Geometry arising in Optimization Jesús A. De Loera University of California, Davis Berlin Mathematical School Summer 2015 WHAT IS THIS COURSE ABOUT? Combinatorial Convexity and Optimization PLAN
More informationLecture 4: Rational IPs, Polyhedron, Decomposition Theorem
IE 5: Integer Programming, Spring 29 24 Jan, 29 Lecture 4: Rational IPs, Polyhedron, Decomposition Theorem Lecturer: Karthik Chandrasekaran Scribe: Setareh Taki Disclaimer: These notes have not been subjected
More informationAM 221: Advanced Optimization Spring 2016
AM 221: Advanced Optimization Spring 2016 Prof. Yaron Singer Lecture 2 Wednesday, January 27th 1 Overview In our previous lecture we discussed several applications of optimization, introduced basic terminology,
More informationLecture 4: Convexity
10-725: Convex Optimization Fall 2013 Lecture 4: Convexity Lecturer: Barnabás Póczos Scribes: Jessica Chemali, David Fouhey, Yuxiong Wang Note: LaTeX template courtesy of UC Berkeley EECS dept. Disclaimer:
More informationConic Duality. yyye
Conic Linear Optimization and Appl. MS&E314 Lecture Note #02 1 Conic Duality Yinyu Ye Department of Management Science and Engineering Stanford University Stanford, CA 94305, U.S.A. http://www.stanford.edu/
More informationConvexity. 1 X i is convex. = b is a hyperplane in R n, and is denoted H(p, b) i.e.,
Convexity We ll assume throughout, without always saying so, that we re in the finite-dimensional Euclidean vector space R n, although sometimes, for statements that hold in any vector space, we ll say
More informationLinear Programming. Larry Blume. Cornell University & The Santa Fe Institute & IHS
Linear Programming Larry Blume Cornell University & The Santa Fe Institute & IHS Linear Programs The general linear program is a constrained optimization problem where objectives and constraints are all
More informationMTAEA Convexity and Quasiconvexity
School of Economics, Australian National University February 19, 2010 Convex Combinations and Convex Sets. Definition. Given any finite collection of points x 1,..., x m R n, a point z R n is said to be
More informationDivision of the Humanities and Social Sciences. Convex Analysis and Economic Theory Winter Separation theorems
Division of the Humanities and Social Sciences Ec 181 KC Border Convex Analysis and Economic Theory Winter 2018 Topic 8: Separation theorems 8.1 Hyperplanes and half spaces Recall that a hyperplane in
More informationIntroduction to Modern Control Systems
Introduction to Modern Control Systems Convex Optimization, Duality and Linear Matrix Inequalities Kostas Margellos University of Oxford AIMS CDT 2016-17 Introduction to Modern Control Systems November
More informationCombinatorial Geometry & Topology arising in Game Theory and Optimization
Combinatorial Geometry & Topology arising in Game Theory and Optimization Jesús A. De Loera University of California, Davis LAST EPISODE... We discuss the content of the course... Convex Sets A set is
More informationLecture 5: Properties of convex sets
Lecture 5: Properties of convex sets Rajat Mittal IIT Kanpur This week we will see properties of convex sets. These properties make convex sets special and are the reason why convex optimization problems
More informationFACES OF CONVEX SETS
FACES OF CONVEX SETS VERA ROSHCHINA Abstract. We remind the basic definitions of faces of convex sets and their basic properties. For more details see the classic references [1, 2] and [4] for polytopes.
More informationmaximize c, x subject to Ax b,
Lecture 8 Linear programming is about problems of the form maximize c, x subject to Ax b, where A R m n, x R n, c R n, and b R m, and the inequality sign means inequality in each row. The feasible set
More informationCS 473: Algorithms. Ruta Mehta. Spring University of Illinois, Urbana-Champaign. Ruta (UIUC) CS473 1 Spring / 29
CS 473: Algorithms Ruta Mehta University of Illinois, Urbana-Champaign Spring 2018 Ruta (UIUC) CS473 1 Spring 2018 1 / 29 CS 473: Algorithms, Spring 2018 Simplex and LP Duality Lecture 19 March 29, 2018
More informationCS675: Convex and Combinatorial Optimization Spring 2018 Convex Sets. Instructor: Shaddin Dughmi
CS675: Convex and Combinatorial Optimization Spring 2018 Convex Sets Instructor: Shaddin Dughmi Outline 1 Convex sets, Affine sets, and Cones 2 Examples of Convex Sets 3 Convexity-Preserving Operations
More informationA mini-introduction to convexity
A mini-introduction to convexity Geir Dahl March 14, 2017 1 Introduction Convexity, or convex analysis, is an area of mathematics where one studies questions related to two basic objects, namely convex
More informationOPERATIONS RESEARCH. Linear Programming Problem
OPERATIONS RESEARCH Chapter 1 Linear Programming Problem Prof. Bibhas C. Giri Department of Mathematics Jadavpur University Kolkata, India Email: bcgiri.jumath@gmail.com 1.0 Introduction Linear programming
More informationChapter 4 Concepts from Geometry
Chapter 4 Concepts from Geometry An Introduction to Optimization Spring, 2014 Wei-Ta Chu 1 Line Segments The line segment between two points and in R n is the set of points on the straight line joining
More informationMath 414 Lecture 2 Everyone have a laptop?
Math 44 Lecture 2 Everyone have a laptop? THEOREM. Let v,...,v k be k vectors in an n-dimensional space and A = [v ;...; v k ] v,..., v k independent v,..., v k span the space v,..., v k a basis v,...,
More informationPOLYHEDRAL GEOMETRY. Convex functions and sets. Mathematical Programming Niels Lauritzen Recall that a subset C R n is convex if
POLYHEDRAL GEOMETRY Mathematical Programming Niels Lauritzen 7.9.2007 Convex functions and sets Recall that a subset C R n is convex if {λx + (1 λ)y 0 λ 1} C for every x, y C and 0 λ 1. A function f :
More informationLecture 2: August 29, 2018
10-725/36-725: Convex Optimization Fall 2018 Lecturer: Ryan Tibshirani Lecture 2: August 29, 2018 Scribes: Adam Harley Note: LaTeX template courtesy of UC Berkeley EECS dept. Disclaimer: These notes have
More informationApplied Lagrange Duality for Constrained Optimization
Applied Lagrange Duality for Constrained Optimization Robert M. Freund February 10, 2004 c 2004 Massachusetts Institute of Technology. 1 1 Overview The Practical Importance of Duality Review of Convexity
More informationREVIEW OF FUZZY SETS
REVIEW OF FUZZY SETS CONNER HANSEN 1. Introduction L. A. Zadeh s paper Fuzzy Sets* [1] introduces the concept of a fuzzy set, provides definitions for various fuzzy set operations, and proves several properties
More informationTHREE LECTURES ON BASIC TOPOLOGY. 1. Basic notions.
THREE LECTURES ON BASIC TOPOLOGY PHILIP FOTH 1. Basic notions. Let X be a set. To make a topological space out of X, one must specify a collection T of subsets of X, which are said to be open subsets of
More informationPolar Duality and Farkas Lemma
Lecture 3 Polar Duality and Farkas Lemma October 8th, 2004 Lecturer: Kamal Jain Notes: Daniel Lowd 3.1 Polytope = bounded polyhedron Last lecture, we were attempting to prove the Minkowsky-Weyl Theorem:
More informationAdvanced Operations Research Techniques IE316. Quiz 1 Review. Dr. Ted Ralphs
Advanced Operations Research Techniques IE316 Quiz 1 Review Dr. Ted Ralphs IE316 Quiz 1 Review 1 Reading for The Quiz Material covered in detail in lecture. 1.1, 1.4, 2.1-2.6, 3.1-3.3, 3.5 Background material
More informationCS599: Convex and Combinatorial Optimization Fall 2013 Lecture 4: Convex Sets. Instructor: Shaddin Dughmi
CS599: Convex and Combinatorial Optimization Fall 2013 Lecture 4: Convex Sets Instructor: Shaddin Dughmi Announcements New room: KAP 158 Today: Convex Sets Mostly from Boyd and Vandenberghe. Read all of
More informationDM545 Linear and Integer Programming. Lecture 2. The Simplex Method. Marco Chiarandini
DM545 Linear and Integer Programming Lecture 2 The Marco Chiarandini Department of Mathematics & Computer Science University of Southern Denmark Outline 1. 2. 3. 4. Standard Form Basic Feasible Solutions
More informationMA4254: Discrete Optimization. Defeng Sun. Department of Mathematics National University of Singapore Office: S Telephone:
MA4254: Discrete Optimization Defeng Sun Department of Mathematics National University of Singapore Office: S14-04-25 Telephone: 6516 3343 Aims/Objectives: Discrete optimization deals with problems of
More informationWeek 5. Convex Optimization
Week 5. Convex Optimization Lecturer: Prof. Santosh Vempala Scribe: Xin Wang, Zihao Li Feb. 9 and, 206 Week 5. Convex Optimization. The convex optimization formulation A general optimization problem is
More informationConvexity and Optimization
Convexity and Optimization Richard Lusby DTU Management Engineering Class Exercises From Last Time 2 DTU Management Engineering 42111: Static and Dynamic Optimization (3) 18/09/2017 Today s Material Extrema
More informationMathematical and Algorithmic Foundations Linear Programming and Matchings
Adavnced Algorithms Lectures Mathematical and Algorithmic Foundations Linear Programming and Matchings Paul G. Spirakis Department of Computer Science University of Patras and Liverpool Paul G. Spirakis
More informationConvexity and Optimization
Convexity and Optimization Richard Lusby Department of Management Engineering Technical University of Denmark Today s Material Extrema Convex Function Convex Sets Other Convexity Concepts Unconstrained
More informationLinear programming and duality theory
Linear programming and duality theory Complements of Operations Research Giovanni Righini Linear Programming (LP) A linear program is defined by linear constraints, a linear objective function. Its variables
More informationHowever, this is not always true! For example, this fails if both A and B are closed and unbounded (find an example).
98 CHAPTER 3. PROPERTIES OF CONVEX SETS: A GLIMPSE 3.2 Separation Theorems It seems intuitively rather obvious that if A and B are two nonempty disjoint convex sets in A 2, then there is a line, H, separating
More informationCollege of Computer & Information Science Fall 2007 Northeastern University 14 September 2007
College of Computer & Information Science Fall 2007 Northeastern University 14 September 2007 CS G399: Algorithmic Power Tools I Scribe: Eric Robinson Lecture Outline: Linear Programming: Vertex Definitions
More informationCMU-Q Lecture 9: Optimization II: Constrained,Unconstrained Optimization Convex optimization. Teacher: Gianni A. Di Caro
CMU-Q 15-381 Lecture 9: Optimization II: Constrained,Unconstrained Optimization Convex optimization Teacher: Gianni A. Di Caro GLOBAL FUNCTION OPTIMIZATION Find the global maximum of the function f x (and
More informationLocally convex topological vector spaces
Chapter 4 Locally convex topological vector spaces 4.1 Definition by neighbourhoods Let us start this section by briefly recalling some basic properties of convex subsets of a vector space over K (where
More informationIntroduction to optimization
Introduction to optimization G. Ferrari Trecate Dipartimento di Ingegneria Industriale e dell Informazione Università degli Studi di Pavia Industrial Automation Ferrari Trecate (DIS) Optimization Industrial
More informationKey points. Assume (except for point 4) f : R n R is twice continuously differentiable. strictly above the graph of f except at x
Key points Assume (except for point 4) f : R n R is twice continuously differentiable 1 If Hf is neg def at x, then f attains a strict local max at x iff f(x) = 0 In (1), replace Hf(x) negative definite
More informationLinear Optimization. Andongwisye John. November 17, Linkoping University. Andongwisye John (Linkoping University) November 17, / 25
Linear Optimization Andongwisye John Linkoping University November 17, 2016 Andongwisye John (Linkoping University) November 17, 2016 1 / 25 Overview 1 Egdes, One-Dimensional Faces, Adjacency of Extreme
More informationLecture 2 Convex Sets
Optimization Theory and Applications Lecture 2 Convex Sets Prof. Chun-Hung Liu Dept. of Electrical and Computer Engineering National Chiao Tung University Fall 2016 2016/9/29 Lecture 2: Convex Sets 1 Outline
More informationShiqian Ma, MAT-258A: Numerical Optimization 1. Chapter 2. Convex Optimization
Shiqian Ma, MAT-258A: Numerical Optimization 1 Chapter 2 Convex Optimization Shiqian Ma, MAT-258A: Numerical Optimization 2 2.1. Convex Optimization General optimization problem: min f 0 (x) s.t., f i
More informationCompact Sets. James K. Peterson. September 15, Department of Biological Sciences and Department of Mathematical Sciences Clemson University
Compact Sets James K. Peterson Department of Biological Sciences and Department of Mathematical Sciences Clemson University September 15, 2017 Outline 1 Closed Sets 2 Compactness 3 Homework Closed Sets
More informationOpen and Closed Sets
Open and Closed Sets Definition: A subset S of a metric space (X, d) is open if it contains an open ball about each of its points i.e., if x S : ɛ > 0 : B(x, ɛ) S. (1) Theorem: (O1) and X are open sets.
More information60 2 Convex sets. {x a T x b} {x ã T x b}
60 2 Convex sets Exercises Definition of convexity 21 Let C R n be a convex set, with x 1,, x k C, and let θ 1,, θ k R satisfy θ i 0, θ 1 + + θ k = 1 Show that θ 1x 1 + + θ k x k C (The definition of convexity
More informationCOMP331/557. Chapter 2: The Geometry of Linear Programming. (Bertsimas & Tsitsiklis, Chapter 2)
COMP331/557 Chapter 2: The Geometry of Linear Programming (Bertsimas & Tsitsiklis, Chapter 2) 49 Polyhedra and Polytopes Definition 2.1. Let A 2 R m n and b 2 R m. a set {x 2 R n A x b} is called polyhedron
More informationSimplex Algorithm in 1 Slide
Administrivia 1 Canonical form: Simplex Algorithm in 1 Slide If we do pivot in A r,s >0, where c s
More informationIn this chapter we introduce some of the basic concepts that will be useful for the study of integer programming problems.
2 Basics In this chapter we introduce some of the basic concepts that will be useful for the study of integer programming problems. 2.1 Notation Let A R m n be a matrix with row index set M = {1,...,m}
More informationLecture 3. Corner Polyhedron, Intersection Cuts, Maximal Lattice-Free Convex Sets. Tepper School of Business Carnegie Mellon University, Pittsburgh
Lecture 3 Corner Polyhedron, Intersection Cuts, Maximal Lattice-Free Convex Sets Gérard Cornuéjols Tepper School of Business Carnegie Mellon University, Pittsburgh January 2016 Mixed Integer Linear Programming
More informationCS675: Convex and Combinatorial Optimization Spring 2018 Consequences of the Ellipsoid Algorithm. Instructor: Shaddin Dughmi
CS675: Convex and Combinatorial Optimization Spring 2018 Consequences of the Ellipsoid Algorithm Instructor: Shaddin Dughmi Outline 1 Recapping the Ellipsoid Method 2 Complexity of Convex Optimization
More informationOptimality certificates for convex minimization and Helly numbers
Optimality certificates for convex minimization and Helly numbers Amitabh Basu Michele Conforti Gérard Cornuéjols Robert Weismantel Stefan Weltge May 10, 2017 Abstract We consider the problem of minimizing
More informationLecture 1: Introduction
Lecture 1 1 Linear and Combinatorial Optimization Anders Heyden Centre for Mathematical Sciences Lecture 1: Introduction The course and its goals Basic concepts Optimization Combinatorial optimization
More informationLECTURE 10 LECTURE OUTLINE
We now introduce a new concept with important theoretical and algorithmic implications: polyhedral convexity, extreme points, and related issues. LECTURE 1 LECTURE OUTLINE Polar cones and polar cone theorem
More informationC&O 355 Lecture 16. N. Harvey
C&O 355 Lecture 16 N. Harvey Topics Review of Fourier-Motzkin Elimination Linear Transformations of Polyhedra Convex Combinations Convex Hulls Polytopes & Convex Hulls Fourier-Motzkin Elimination Joseph
More informationSection Notes 5. Review of Linear Programming. Applied Math / Engineering Sciences 121. Week of October 15, 2017
Section Notes 5 Review of Linear Programming Applied Math / Engineering Sciences 121 Week of October 15, 2017 The following list of topics is an overview of the material that was covered in the lectures
More information2. Convex sets. x 1. x 2. affine set: contains the line through any two distinct points in the set
2. Convex sets Convex Optimization Boyd & Vandenberghe affine and convex sets some important examples operations that preserve convexity generalized inequalities separating and supporting hyperplanes dual
More informationLECTURE 7 LECTURE OUTLINE. Review of hyperplane separation Nonvertical hyperplanes Convex conjugate functions Conjugacy theorem Examples
LECTURE 7 LECTURE OUTLINE Review of hyperplane separation Nonvertical hyperplanes Convex conjugate functions Conjugacy theorem Examples Reading: Section 1.5, 1.6 All figures are courtesy of Athena Scientific,
More informationConvex sets and convex functions
Convex sets and convex functions Convex optimization problems Convex sets and their examples Separating and supporting hyperplanes Projections on convex sets Convex functions, conjugate functions ECE 602,
More informationLecture 2: August 31
10-725/36-725: Convex Optimization Fall 2016 Lecture 2: August 31 Lecturer: Lecturer: Ryan Tibshirani Scribes: Scribes: Lidan Mu, Simon Du, Binxuan Huang 2.1 Review A convex optimization problem is of
More informationAdvanced Linear Programming. Organisation. Lecturers: Leen Stougie, CWI and Vrije Universiteit in Amsterdam
Advanced Linear Programming Organisation Lecturers: Leen Stougie, CWI and Vrije Universiteit in Amsterdam E-mail: stougie@cwi.nl Marjan van den Akker Universiteit Utrecht marjan@cs.uu.nl Advanced Linear
More information2. Convex sets. affine and convex sets. some important examples. operations that preserve convexity. generalized inequalities
2. Convex sets Convex Optimization Boyd & Vandenberghe affine and convex sets some important examples operations that preserve convexity generalized inequalities separating and supporting hyperplanes dual
More informationConvex sets and convex functions
Convex sets and convex functions Convex optimization problems Convex sets and their examples Separating and supporting hyperplanes Projections on convex sets Convex functions, conjugate functions ECE 602,
More informationTopology and Topological Spaces
Topology and Topological Spaces Mathematical spaces such as vector spaces, normed vector spaces (Banach spaces), and metric spaces are generalizations of ideas that are familiar in R or in R n. For example,
More informationAMS : Combinatorial Optimization Homework Problems - Week V
AMS 553.766: Combinatorial Optimization Homework Problems - Week V For the following problems, A R m n will be m n matrices, and b R m. An affine subspace is the set of solutions to a a system of linear
More informationOptimality certificates for convex minimization and Helly numbers
Optimality certificates for convex minimization and Helly numbers Amitabh Basu Michele Conforti Gérard Cornuéjols Robert Weismantel Stefan Weltge October 20, 2016 Abstract We consider the problem of minimizing
More informationCOM Optimization for Communications Summary: Convex Sets and Convex Functions
1 Convex Sets Affine Sets COM524500 Optimization for Communications Summary: Convex Sets and Convex Functions A set C R n is said to be affine if A point x 1, x 2 C = θx 1 + (1 θ)x 2 C, θ R (1) y = k θ
More informationConvex Sets. Pontus Giselsson
Convex Sets Pontus Giselsson 1 Today s lecture convex sets convex, affine, conical hulls closure, interior, relative interior, boundary, relative boundary separating and supporting hyperplane theorems
More informationLecture 6: Faces, Facets
IE 511: Integer Programming, Spring 2019 31 Jan, 2019 Lecturer: Karthik Chandrasekaran Lecture 6: Faces, Facets Scribe: Setareh Taki Disclaimer: These notes have not been subjected to the usual scrutiny
More informationarxiv: v1 [math.co] 12 Dec 2017
arxiv:1712.04381v1 [math.co] 12 Dec 2017 Semi-reflexive polytopes Tiago Royer Abstract The Ehrhart function L P(t) of a polytope P is usually defined only for integer dilation arguments t. By allowing
More informationLecture 19 Subgradient Methods. November 5, 2008
Subgradient Methods November 5, 2008 Outline Lecture 19 Subgradients and Level Sets Subgradient Method Convergence and Convergence Rate Convex Optimization 1 Subgradients and Level Sets A vector s is a
More informationAdvanced Operations Research Techniques IE316. Quiz 2 Review. Dr. Ted Ralphs
Advanced Operations Research Techniques IE316 Quiz 2 Review Dr. Ted Ralphs IE316 Quiz 2 Review 1 Reading for The Quiz Material covered in detail in lecture Bertsimas 4.1-4.5, 4.8, 5.1-5.5, 6.1-6.3 Material
More informationModeling and Analysis of Hybrid Systems
Modeling and Analysis of Hybrid Systems Convex polyhedra Prof. Dr. Erika Ábrahám Informatik 2 - LuFG Theory of Hybrid Systems RWTH Aachen University Szeged, Hungary, 27 September - 06 October 2017 Ábrahám
More informationModeling and Analysis of Hybrid Systems
Modeling and Analysis of Hybrid Systems 6. Convex polyhedra Prof. Dr. Erika Ábrahám Informatik 2 - LuFG Theory of Hybrid Systems RWTH Aachen University Szeged, Hungary, 27 September - 06 October 2017 Ábrahám
More informationConvex Sets. CSCI5254: Convex Optimization & Its Applications. subspaces, affine sets, and convex sets. operations that preserve convexity
CSCI5254: Convex Optimization & Its Applications Convex Sets subspaces, affine sets, and convex sets operations that preserve convexity generalized inequalities separating and supporting hyperplanes dual
More informationLinear Programming in Small Dimensions
Linear Programming in Small Dimensions Lekcija 7 sergio.cabello@fmf.uni-lj.si FMF Univerza v Ljubljani Edited from slides by Antoine Vigneron Outline linear programming, motivation and definition one dimensional
More informationConvex Optimization. Convex Sets. ENSAE: Optimisation 1/24
Convex Optimization Convex Sets ENSAE: Optimisation 1/24 Today affine and convex sets some important examples operations that preserve convexity generalized inequalities separating and supporting hyperplanes
More informationLecture 2. Topology of Sets in R n. August 27, 2008
Lecture 2 Topology of Sets in R n August 27, 2008 Outline Vectors, Matrices, Norms, Convergence Open and Closed Sets Special Sets: Subspace, Affine Set, Cone, Convex Set Special Convex Sets: Hyperplane,
More information11 Linear Programming
11 Linear Programming 11.1 Definition and Importance The final topic in this course is Linear Programming. We say that a problem is an instance of linear programming when it can be effectively expressed
More information3. The Simplex algorithmn The Simplex algorithmn 3.1 Forms of linear programs
11 3.1 Forms of linear programs... 12 3.2 Basic feasible solutions... 13 3.3 The geometry of linear programs... 14 3.4 Local search among basic feasible solutions... 15 3.5 Organization in tableaus...
More informationLecture 3: Convex sets
Lecture 3: Convex sets Rajat Mittal IIT Kanpur We denote the set of real numbers as R. Most of the time we will be working with space R n and its elements will be called vectors. Remember that a subspace
More informationPolytopes Course Notes
Polytopes Course Notes Carl W. Lee Department of Mathematics University of Kentucky Lexington, KY 40506 lee@ms.uky.edu Fall 2013 i Contents 1 Polytopes 1 1.1 Convex Combinations and V-Polytopes.....................
More informationLecture 2: August 29, 2018
10-725/36-725: Convex Optimization Fall 2018 Lecturer: Ryan Tibshirani Lecture 2: August 29, 2018 Scribes: Yingjing Lu, Adam Harley, Ruosong Wang Note: LaTeX template courtesy of UC Berkeley EECS dept.
More informationCS 473: Algorithms. Ruta Mehta. Spring University of Illinois, Urbana-Champaign. Ruta (UIUC) CS473 1 Spring / 50
CS 473: Algorithms Ruta Mehta University of Illinois, Urbana-Champaign Spring 2018 Ruta (UIUC) CS473 1 Spring 2018 1 / 50 CS 473: Algorithms, Spring 2018 Introduction to Linear Programming Lecture 18 March
More informationPolyhedral Computation and their Applications. Jesús A. De Loera Univ. of California, Davis
Polyhedral Computation and their Applications Jesús A. De Loera Univ. of California, Davis 1 1 Introduction It is indeniable that convex polyhedral geometry is an important tool of modern mathematics.
More information6.854 Advanced Algorithms. Scribes: Jay Kumar Sundararajan. Duality
6.854 Advanced Algorithms Scribes: Jay Kumar Sundararajan Lecturer: David Karger Duality This lecture covers weak and strong duality, and also explains the rules for finding the dual of a linear program,
More informationMATH 890 HOMEWORK 2 DAVID MEREDITH
MATH 890 HOMEWORK 2 DAVID MEREDITH (1) Suppose P and Q are polyhedra. Then P Q is a polyhedron. Moreover if P and Q are polytopes then P Q is a polytope. The facets of P Q are either F Q where F is a facet
More informationConvex Optimization. 2. Convex Sets. Prof. Ying Cui. Department of Electrical Engineering Shanghai Jiao Tong University. SJTU Ying Cui 1 / 33
Convex Optimization 2. Convex Sets Prof. Ying Cui Department of Electrical Engineering Shanghai Jiao Tong University 2018 SJTU Ying Cui 1 / 33 Outline Affine and convex sets Some important examples Operations
More informationPoint-Set Topology 1. TOPOLOGICAL SPACES AND CONTINUOUS FUNCTIONS
Point-Set Topology 1. TOPOLOGICAL SPACES AND CONTINUOUS FUNCTIONS Definition 1.1. Let X be a set and T a subset of the power set P(X) of X. Then T is a topology on X if and only if all of the following
More information