Convex Algebraic Geometry

Similar documents
Introduction to Mathematical Programming IE496. Final Review. Dr. Ted Ralphs

Lec13p1, ORF363/COS323

An SDP Approach to Multi-level Crossing Minimization

AMS : Combinatorial Optimization Homework Problems - Week V

DM545 Linear and Integer Programming. Lecture 2. The Simplex Method. Marco Chiarandini

Research Interests Optimization:

Mathematical and Algorithmic Foundations Linear Programming and Matchings

CS 473: Algorithms. Ruta Mehta. Spring University of Illinois, Urbana-Champaign. Ruta (UIUC) CS473 1 Spring / 36

The Convex Hull of a Space Curve

Introduction to Mathematical Programming IE406. Lecture 20. Dr. Ted Ralphs

Automated Precision Tuning using Semidefinite Programming

Conic Duality. yyye

60 2 Convex sets. {x a T x b} {x ã T x b}

Parameterization. Michael S. Floater. November 10, 2011

THEORY OF LINEAR AND INTEGER PROGRAMMING

Outline. CS38 Introduction to Algorithms. Linear programming 5/21/2014. Linear programming. Lecture 15 May 20, 2014

The Convex Hull of a Space Curve. Bernd Sturmfels, UC Berkeley (two papers with Kristian Ranestad)

Lecture 2 September 3

A Course in Convexity

Algorithmic Semi-algebraic Geometry and its applications. Saugata Basu School of Mathematics & College of Computing Georgia Institute of Technology.

Chapter 3. Quadric hypersurfaces. 3.1 Quadric hypersurfaces Denition.

Discriminative Clustering for Image Co-segmentation

Binary Positive Semidefinite Matrices and Associated Integer Polytopes

Chapter 8. Voronoi Diagrams. 8.1 Post Oce Problem

Lecture 9. Semidefinite programming is linear programming where variables are entries in a positive semidefinite matrix.

Lecture 3. Corner Polyhedron, Intersection Cuts, Maximal Lattice-Free Convex Sets. Tepper School of Business Carnegie Mellon University, Pittsburgh

Rounding procedures in Semidefinite Programming

High School Geometry. Correlation of the ALEKS course High School Geometry to the ACT College Readiness Standards for Mathematics

Lecture 2. Topology of Sets in R n. August 27, 2008

DETERMINISTIC OPERATIONS RESEARCH

Integer Programming Theory

4 Integer Linear Programming (ILP)

Convex Optimization - Chapter 1-2. Xiangru Lian August 28, 2015

Week 5. Convex Optimization

Randomized rounding of semidefinite programs and primal-dual method for integer linear programming. Reza Moosavi Dr. Saeedeh Parsaeefard Dec.

RESEARCH ARTICLE. Dualize it: software for automatic primal and dual conversions of conic programs

Algebraic Geometry of Segmentation and Tracking

The Farthest Point Delaunay Triangulation Minimizes Angles

Some Advanced Topics in Linear Programming

6 Randomized rounding of semidefinite programs

Parameterization of triangular meshes

Polytopes Course Notes

CSC Linear Programming and Combinatorial Optimization Lecture 12: Semidefinite Programming(SDP) Relaxation

Towards Efficient Higher-Order Semidefinite Relaxations for Max-Cut

Lecture 2 Convex Sets

Convex Sets. CSCI5254: Convex Optimization & Its Applications. subspaces, affine sets, and convex sets. operations that preserve convexity

2. Convex sets. affine and convex sets. some important examples. operations that preserve convexity. generalized inequalities

Enclosures of Roundoff Errors using SDP

THE BASIC THEORY OF PERSISTENT HOMOLOGY

Nonlinear Programming

= f (a, b) + (hf x + kf y ) (a,b) +

arxiv: v1 [math.co] 27 Feb 2015

Generalized barycentric coordinates

Mirror Symmetry Through Reflexive Polytopes

LECTURE 18 LECTURE OUTLINE

Open problems in convex geometry

Course Number 432/433 Title Algebra II (A & B) H Grade # of Days 120

arxiv: v1 [math.co] 15 Dec 2009

2. Give an example of a non-constant function f(x, y) such that the average value of f over is 0.

Certification of Roundoff Errors with SDP Relaxations and Formal Interval Methods

Pacific Journal of Mathematics

Solutions for Operations Research Final Exam

Projective spaces and Bézout s theorem

Convexity: an introduction

MA4254: Discrete Optimization. Defeng Sun. Department of Mathematics National University of Singapore Office: S Telephone:

3 No-Wait Job Shops with Variable Processing Times

Convex Optimization. 2. Convex Sets. Prof. Ying Cui. Department of Electrical Engineering Shanghai Jiao Tong University. SJTU Ying Cui 1 / 33

Financial Optimization ISE 347/447. Lecture 13. Dr. Ted Ralphs

Artificial Intelligence

2. Convex sets. x 1. x 2. affine set: contains the line through any two distinct points in the set

High School Geometry

On the number of distinct directions of planes determined by n points in R 3

Definition. Given a (v,k,λ)- BIBD, (X,B), a set of disjoint blocks of B which partition X is called a parallel class.

XLVI Pesquisa Operacional na Gestão da Segurança Pública

Convex Optimization. Convex Sets. ENSAE: Optimisation 1/24

Lesson 17. Geometry and Algebra of Corner Points

Geometric Steiner Trees

Technische Universität München Zentrum Mathematik

Ray shooting from convex ranges

ELEMENTARY NUMBER THEORY AND METHODS OF PROOF

Discovering Geometry: 1 st Quarter. California Geometry Standard Resources

Investigating Mixed-Integer Hulls using a MIP-Solver

Lecture 2 - Introduction to Polytopes

Realizing Planar Graphs as Convex Polytopes. Günter Rote Freie Universität Berlin

ELEMENTARY NUMBER THEORY AND METHODS OF PROOF

Chapter 15: Functions of Several Variables

Outline. Combinatorial Optimization 2. Finite Systems of Linear Inequalities. Finite Systems of Linear Inequalities. Theorem (Weyl s theorem :)

Montana Instructional Alignment HPS Critical Competencies Mathematics Honors Pre-Calculus

arxiv: v1 [cs.cc] 30 Jun 2017

Polar Duality and Farkas Lemma

Open problems in convex optimisation

MATH 423 Linear Algebra II Lecture 17: Reduced row echelon form (continued). Determinant of a matrix.

Flows on surface embedded graphs. Erin Chambers

Lecture 14: Linear Programming II

FOUNDATIONS OF ALGEBRAIC GEOMETRY CLASS 14

An O(log n/ log log n)-approximation Algorithm for the Asymmetric Traveling Salesman Problem

1. Lecture notes on bipartite matching

ORIE 6300 Mathematical Programming I September 2, Lecture 3

A mini-introduction to convexity

Linear Optimization and Extensions: Theory and Algorithms

Transcription:

, North Carolina State University

What is convex algebraic geometry? Convex algebraic geometry is the study of convex semialgebraic objects, especially those arising in optimization and statistics.

What is convex algebraic geometry? Convex algebraic geometry is the study of convex semialgebraic objects, especially those arising in optimization and statistics. Many convex concepts have algebraic analogues. convex duality algebraic duality convex combinations secant varieties boundary of a projection branch locus

What is convex algebraic geometry? Convex algebraic geometry is the study of convex semialgebraic objects, especially those arising in optimization and statistics. Many convex concepts have algebraic analogues. convex duality algebraic duality convex combinations secant varieties boundary of a projection branch locus Algebraic techniques can help answer questions about these convex sets. Convexity provides additions tools and challenges.

Motivational Example: The elliptope The 3-elliptope is 1 x y (x, y, z) R3 : x 1 z 0 y z 1

Motivational Example: The elliptope The 3-elliptope is 1 x y (x, y, z) R3 : x 1 z 0 y z 1 I convex, semialgebraic (defined by polynomial s)

Motivational Example: The elliptope The 3-elliptope is 1 x y (x, y, z) R3 : x 1 z 0 y z 1 I I convex, semialgebraic (defined by polynomial s) a spectrahedron (feasible set of a semidefinite program)

Motivational Example: The elliptope The 3-elliptope is 1 x y (x, y, z) R3 : x 1 z 0 y z 1 I I convex, semialgebraic (defined by polynomial s) a spectrahedron (feasible set of a semidefinite program) appears in... I statistics as set of correlation matrices I combinatorial optimization

The elliptope: convex algebraic istructure Convex structure

The elliptope: convex algebraic istructure Convex structure -many zero-dim l faces 6 one-dim l faces 4 vertices

The elliptope: convex algebraic istructure Convex structure -many zero-dim l faces 6 one-dim l faces 4 vertices t Algebraic structure Bounded by a cubic hypersurface, {(x, y, z) R 3 : f = 2xyz x 2 y 2 z 2 + 1 = 0} that has 4 nodes and contains 6 lines.

Low-rank matrices The elliptope exhibits general behavior for its size and dimension. For general A 0, A 1, A 2, A 3 R 3 3 sym the set of matrices {A 0 + xa 1 + ya 2 + za 3 : (x, y, z) R 3 or C 3 } contains 4 rank-one matrices over C and 0,2, or 4 over R.

Low-rank matrices The elliptope exhibits general behavior for its size and dimension. For general A 0, A 1, A 2, A 3 R 3 3 sym the set of matrices {A 0 + xa 1 + ya 2 + za 3 : (x, y, z) R 3 or C 3 } contains 4 rank-one matrices over C and 0,2, or 4 over R. Why? The set of matrices of rank 1 is variety of codimension 3 and degree 4 in R 3 3 sym = R 6.

Low-rank matrices The elliptope exhibits general behavior for its size and dimension. For general A 0, A 1, A 2, A 3 R 3 3 sym the set of matrices {A 0 + xa 1 + ya 2 + za 3 : (x, y, z) R 3 or C 3 } contains 4 rank-one matrices over C and 0,2, or 4 over R. Why? The set of matrices of rank 1 is variety of codimension 3 and degree 4 in R 3 3 sym = R 6. If A 0 0, there will always be 2 or 4 matrices of rank-one over R.

Algebraic and convex duality In contrast to the approach in the proof of Lemma 4.7, in this representation we only need to solve a system of two polynomial equations in two unknowns, regardless of the cycle size m. Theequationsare (K 1 )11 =1 and (K 1 )12 = x. By clearing denominators we obtain two polynomial equations intheunknownsλ1 and λ2. Weneedto express these in terms of the parameter x, buttherearemanyextraneoussolutions.themldegreeis algebraic degree of the special solution (ˆλ1(x), ˆλ2(x)) which makes (34) positive definite. We can use duality in algebraic geometry to calculate hypersurface bounding the dual of a convex body. Fig. 4 The cross section of the cone of sufficient statistics in Example 5.3 is the red convex body shown in the left figure. It is dual to Cayley s cubic surface, which is shown in yellow in the right figure and also in Fig. 1 on the left. Example 5.3. Let G be the colored triangle with the same color for all three vertices and three distinct colors for the edges. This is an RCOP model with m =3andd =4.ThecorrespondingsubspaceL of S 3 consists of all concentration matrices K = λ4 λ1 λ2 λ1 λ4 λ3. λ2 λ3 λ4

Algebraic and convex duality In contrast to the approach in the proof of Lemma 4.7, in this representation we only need to solve a system of two polynomial equations in two unknowns, regardless of the cycle size m. Theequationsare (K 1 )11 =1 and (K 1 )12 = x. By clearing denominators we obtain two polynomial equations intheunknownsλ1 and λ2. Weneedto express these in terms of the parameter x, buttherearemanyextraneoussolutions.themldegreeis algebraic degree of the special solution (ˆλ1(x), ˆλ2(x)) which makes (34) positive definite. We can use duality in algebraic geometry to calculate hypersurface bounding the dual of a convex body. The dual of the elliptope is bounded by the union of a quartic surface and four planes. Fig. 4 The cross section of the cone of sufficient statistics in Example 5.3 is the red convex body shown in the left figure. It is dual to Cayley s cubic surface, which is shown in yellow in the right figure and also in Fig. 1 on the left. Example 5.3. Let G be the colored triangle with the same color for all three vertices and three distinct colors for the edges. This is an RCOP model with m =3andd =4.ThecorrespondingsubspaceL of S 3 consists of all concentration matrices K = λ4 λ1 λ2 λ1 λ4 λ3. λ2 λ3 λ4

Algebraic and convex duality In contrast to the approach in the proof of Lemma 4.7, in this representation we only need to solve a system of two polynomial equations in two unknowns, regardless of the cycle size m. Theequationsare (K 1 )11 =1 and (K 1 )12 = x. By clearing denominators we obtain two polynomial equations intheunknownsλ1 and λ2. Weneedto express these in terms of the parameter x, buttherearemanyextraneoussolutions.themldegreeis algebraic degree of the special solution (ˆλ1(x), ˆλ2(x)) which makes (34) positive definite. We can use duality in algebraic geometry to calculate hypersurface bounding the dual of a convex body. The dual of the elliptope is bounded by the union of a quartic surface and four planes. Writing down the solution of a random Fig. 4 The cross section of the cone of sufficient statistics in Example 5.3 is the red convex body shown in the left figure. It is dual to Cayley s cubic surface, which is shown in yellow in the right figure and also in Fig. 1 on the left. Example 5.3. Let G be the colored triangle with the same color for all three vertices and three distinct colors for the edges. This is an RCOP model with m =3andd =4.ThecorrespondingsubspaceL of S 3 consists of all concentration matrices λ4 λ1 λ2 K = λ1 λ4 λ3. linear optimization problem over the elliptope requires solving a λ2 λ3 λ4 degree four polynomial.

Moments and Sums of Squares The cone of nonnegative polynomials NN n,2d = {p R[x 1,..., x n ] 2d : p(x) 0 for all R n } is convex, semialgebraic, and contains the cone of sums of squares SOS n,2d = {h1 2 +... + hr 2 : h j R[x 1,..., x n ] d }.

Moments and Sums of Squares The cone of nonnegative polynomials NN n,2d = {p R[x 1,..., x n ] 2d : p(x) 0 for all R n } is convex, semialgebraic, and contains the cone of sums of squares SOS n,2d = {h 2 1 +... + h 2 r : h j R[x 1,..., x n ] d }. The dual cone to NN n,2d is the cone of moments of degree 2d: NN n,2d = conv{λ(1, x 1,..., x n, x 2 1, x 1 x 2,..., x 2d n ) : λ R, x R n }.

Moments and Sums of Squares The cone of nonnegative polynomials NN n,2d = {p R[x 1,..., x n ] 2d : p(x) 0 for all R n } is convex, semialgebraic, and contains the cone of sums of squares SOS n,2d = {h 2 1 +... + h 2 r : h j R[x 1,..., x n ] d }. The dual cone to NN n,2d is the cone of moments of degree 2d: NN n,2d = conv{λ(1, x 1,..., x n, x 2 1, x 1 x 2,..., x 2d n ) : λ R, x R n }. Duality reverses inclusion, so NN n,2d SOS n,2d.

Moments and Sums of Squares The cone of nonnegative polynomials NN n,2d = {p R[x 1,..., x n ] 2d : p(x) 0 for all R n } is convex, semialgebraic, and contains the cone of sums of squares SOS n,2d = {h 2 1 +... + h 2 r : h j R[x 1,..., x n ] d }. The dual cone to NN n,2d is the cone of moments of degree 2d: NN n,2d = conv{λ(1, x 1,..., x n, x 2 1, x 1 x 2,..., x 2d n ) : λ R, x R n }. Duality reverses inclusion, so NN n,2d SOS n,2d. Moreover SOS n,2d is a spectrahedron!

Sums of squares and the Goemans-Williamson relaxation MAXCUT: Given weights w e R to the edges of a graph G = (V, E), find a cut V {±1} maximizing the summed weight of mixed edges. max w ij (1 x i x j ) s.t. x 2 1 = x 2 2 = x 2 3 = 1 w 13 w 23 w 12

Sums of squares and the Goemans-Williamson relaxation MAXCUT: Given weights w e R to the edges of a graph G = (V, E), find a cut V {±1} maximizing the summed weight of mixed edges. max w ij (1 x i x j ) s.t. x 2 1 = x 2 2 = x 2 3 = 1 w 13 w 23 = max w ij (1 y ij ) s.t. y belongs to w 12 C = conv{(x 1 x 2, x 1 x 3, x 2 x 3 ) : x {±1} 3 }

Sums of squares and the Goemans-Williamson relaxation MAXCUT: Given weights w e R to the edges of a graph G = (V, E), find a cut V {±1} maximizing the summed weight of mixed edges. max w ij (1 x i x j ) s.t. x 2 1 = x 2 2 = x 2 3 = 1 w 13 w 23 = max w ij (1 y ij ) s.t. y belongs to w 12 C = conv{(x 1 x 2, x 1 x 3, x 2 x 3 ) : x {±1} 3 } The dual convex body is C = {(a 12, a 13, a 23 ) : a ij x i x j 1 for x {±1} 3 } {(a 12, a 13, a 23 ) : 1 a ij x i x j is SOS mod x 2 j 1 } = S

Sums of squares and the Goemans-Williamson relaxation MAXCUT: Given weights w e R to the edges of a graph G = (V, E), find a cut V {±1} maximizing the summed weight of mixed edges. max w ij (1 x i x j ) s.t. x 2 1 = x 2 2 = x 2 3 = 1 w 13 w 23 = max w ij (1 y ij ) s.t. y belongs to w 12 C = conv{(x 1 x 2, x 1 x 3, x 2 x 3 ) : x {±1} 3 } The dual convex body is C = {(a 12, a 13, a 23 ) : a ij x i x j 1 for x {±1} 3 } {(a 12, a 13, a 23 ) : 1 a ij x i x j is SOS mod x 2 j 1 } = S Then C S =

Sums of squares and the Goemans-Williamson relaxation MAXCUT: Given weights w e R to the edges of a graph G = (V, E), find a cut V {±1} maximizing the summed weight of mixed edges. max w ij (1 x i x j ) s.t. x 2 1 = x 2 2 = x 2 3 = 1 w 13 w 23 = max w ij (1 y ij ) s.t. y belongs to w 12 C = conv{(x 1 x 2, x 1 x 3, x 2 x 3 ) : x {±1} 3 } The dual convex body is C = {(a 12, a 13, a 23 ) : a ij x i x j 1 for x {±1} 3 } {(a 12, a 13, a 23 ) : 1 a ij x i x j is SOS mod x 2 j 1 } = S Then C S = Thanks!