Constrained Optimization and Lagrange Multipliers

Similar documents
MATH2111 Higher Several Variable Calculus Lagrange Multipliers

Lagrange multipliers October 2013

Lagrange multipliers 14.8

Math 233. Lagrange Multipliers Basics

Lagrange Multipliers. Lagrange Multipliers. Lagrange Multipliers. Lagrange Multipliers. Lagrange Multipliers. Lagrange Multipliers

MATH 19520/51 Class 10

Math 233. Lagrange Multipliers Basics

Math 21a Homework 22 Solutions Spring, 2014

we wish to minimize this function; to make life easier, we may minimize

Gradient and Directional Derivatives

Bounded, Closed, and Compact Sets

14.5 Directional Derivatives and the Gradient Vector

(c) 0 (d) (a) 27 (b) (e) x 2 3x2

1. Show that the rectangle of maximum area that has a given perimeter p is a square.

Math 209 (Fall 2007) Calculus III. Solution #5. 1. Find the minimum and maximum values of the following functions f under the given constraints:

Lagrangian Multipliers

Lagrangian Multipliers

1. Suppose that the equation F (x, y, z) = 0 implicitly defines each of the three variables x, y, and z as functions of the other two:

Math 213 Exam 2. Each question is followed by a space to write your answer. Please write your answer neatly in the space provided.

MATH. 2153, Spring 16, MWF 12:40 p.m. QUIZ 1 January 25, 2016 PRINT NAME A. Derdzinski Show all work. No calculators. The problem is worth 10 points.

Math 241, Final Exam. 12/11/12.

Lagrange Multipliers. Joseph Louis Lagrange was born in Turin, Italy in Beginning

Calculus III. Math 233 Spring In-term exam April 11th. Suggested solutions

x 6 + λ 2 x 6 = for the curve y = 1 2 x3 gives f(1, 1 2 ) = λ actually has another solution besides λ = 1 2 = However, the equation λ

Section 4: Extreme Values & Lagrange Multipliers.

REVIEW I MATH 254 Calculus IV. Exam I (Friday, April 29) will cover sections

Kevin James. MTHSC 206 Section 15.6 Directional Derivatives and the Gra

MATH Lagrange multipliers in 3 variables Fall 2016

Directional Derivatives and the Gradient Vector Part 2

21-256: Lagrange multipliers

3.3 Optimizing Functions of Several Variables 3.4 Lagrange Multipliers

= w. w u. u ; u + w. x x. z z. y y. v + w. . Remark. The formula stated above is very important in the theory of. surface integral.

Solution 2. ((3)(1) (2)(1), (4 3), (4)(2) (3)(3)) = (1, 1, 1) D u (f) = (6x + 2yz, 2y + 2xz, 2xy) (0,1,1) = = 4 14

Math 213 Calculus III Practice Exam 2 Solutions Fall 2002

The Divergence Theorem

Directional Derivatives and the Gradient Vector Part 2

. Tutorial Class V 3-10/10/2012 First Order Partial Derivatives;...

Solution of final examination

Absolute extrema of two variables functions

Worksheet 2.7: Critical Points, Local Extrema, and the Second Derivative Test

A small review, Second Midterm, Calculus 3, Prof. Montero 3450: , Fall 2008

Trigonometric Functions of Any Angle

Math 210, Exam 2, Spring 2010 Problem 1 Solution

Second Midterm Exam Math 212 Fall 2010

In other words, we want to find the domain points that yield the maximum or minimum values (extrema) of the function.

. 1. Chain rules. Directional derivative. Gradient Vector Field. Most Rapid Increase. Implicit Function Theorem, Implicit Differentiation

Mat 241 Homework Set 7 Due Professor David Schultz

Lecture 15. Lecturer: Prof. Sergei Fedotov Calculus and Vectors. Length of a Curve and Parametric Equations

Classroom Tips and Techniques: The Lagrange Multiplier Method

Practice problems from old exams for math 233 William H. Meeks III December 21, 2009

Lagrange Multipliers

Math 113 Calculus III Final Exam Practice Problems Spring 2003

Math 126 Final Examination Autumn CHECK that your exam contains 9 problems on 10 pages.

Directional Derivatives. Directional Derivatives. Directional Derivatives. Directional Derivatives. Directional Derivatives. Directional Derivatives

MATH 2400, Analytic Geometry and Calculus 3

Graphs of Equations. MATH 160, Precalculus. J. Robert Buchanan. Fall Department of Mathematics. J. Robert Buchanan Graphs of Equations

5 Day 5: Maxima and minima for n variables.

Winter 2012 Math 255 Section 006. Problem Set 7

13.1. Functions of Several Variables. Introduction to Functions of Several Variables. Functions of Several Variables. Objectives. Example 1 Solution

Paul's Online Math Notes Calculus III (Notes) / Applications of Partial Derivatives / Lagrange Multipliers Problems][Assignment Problems]

ds dt ds 1 dt 1 dt v v v dt ds and the normal vector is given by N

ORIE 6300 Mathematical Programming I September 2, Lecture 3

13.7 LAGRANGE MULTIPLIER METHOD

Constrained extrema of two variables functions

Introduction. Classroom Tips and Techniques: The Lagrange Multiplier Method

Lagrange multipliers. Contents. Introduction. From Wikipedia, the free encyclopedia

Background for Surface Integration

Quasilinear First-Order PDEs

f xx (x, y) = 6 + 6x f xy (x, y) = 0 f yy (x, y) = y In general, the quantity that we re interested in is

Multivariate Calculus Review Problems for Examination Two

Lagrange Multipliers and Problem Formulation

12.7 Tangent Planes and Normal Lines

d f(g(t), h(t)) = x dt + f ( y dt = 0. Notice that we can rewrite the relationship on the left hand side of the equality using the dot product: ( f

11/1/2017 Second Hourly Practice 11 Math 21a, Fall Name:

Instructions and information

Chapter 5 Partial Differentiation

MAT175 Overview and Sample Problems

MAT203 OVERVIEW OF CONTENTS AND SAMPLE PROBLEMS

Grad operator, triple and line integrals. Notice: this material must not be used as a substitute for attending the lectures

Equation of tangent plane: for implicitly defined surfaces section 12.9

Total. Math 2130 Practice Final (Spring 2017) (1) (2) (3) (4) (5) (6) (7) (8)

14.6 Directional Derivatives and the Gradient Vector

Optimization III: Constrained Optimization

Calculus 234. Problems. May 15, 2003

Topic 5.1: Line Elements and Scalar Line Integrals. Textbook: Section 16.2

Functions of Several Variables

HOMEWORK ASSIGNMENT #4, MATH 253

MATH 261 FALL 2000 FINAL EXAM INSTRUCTIONS. 1. This test booklet has 14 pages including this one. There are 25 questions, each worth 8 points.

30. Constrained Optimization

1 Vector Functions and Space Curves

Increasing and Decreasing Functions. MATH 1003 Calculus and Linear Algebra (Lecture 20) Increasing and Decreasing Functions

University of California, Berkeley

11.3 The Tangent Line Problem

Physics 235 Chapter 6. Chapter 6 Some Methods in the Calculus of Variations

Optimizations and Lagrange Multiplier Method

Solutions to assignment 3

Linear Programming. Larry Blume. Cornell University & The Santa Fe Institute & IHS

Math Exam III Review

Calculus III Meets the Final

Exam 2 Preparation Math 2080 (Spring 2011) Exam 2: Thursday, May 12.

Transcription:

Constrained Optimization and Lagrange Multipliers MATH 311, Calculus III J. Robert Buchanan Department of Mathematics Fall 2011

Constrained Optimization In the previous section we found the local or absolute extrema of a function either on the entire domain of the function or on a bounded region. Now we will look for extrema which satisfy some side condition(s) known as constraint(s).

Example Find the point on the parabola y = x 2 + 3x + 2 closest to the origin. f (x, y) = x 2 + (x 2 + 3x + 2) 2 2.0 1.5 1.0 0.5 2 1 1 2 x 0.5 1.0 1.5

Geometry (1 of 2) Note: At the minimum distance from the origin the parabola and the circle are tangent. The normals to the parabola and the circle are parallel at the point of tangency. The gradient is always normal to the curve.

Geometry (2 of 2) Gradients: parabola: x 2 + 3x + 2 y = 0 circle: x 2 + y 2 = r 2 (x 2 + y 2 ) = λ (x 2 + 3x + 2 y) 2x, 2y = λ 2x + 3, 1 Equivalent system of equations: 2x = λ(2x + 3) 2y = λ 0 = x 2 + 3x + 2 y

Solution y = x 2 + 3x + 2 λ = 2(x 2 + 3x + 2) 0 = 2(x 2 + 3x + 2)(2x + 3) 2x x 0.682817 which implies y 0.417788.

Method of Lagrange Multipliers (1 of 2) Problem: find the extreme values of f (x, y, z) subject to the constraint g(x, y, z) = 0. Solution: Suppose f has an extremum at (x 0, y 0, z 0 ) on the surface S defined by g(x, y, z) = 0. Let C be a curve traced out by the vector-valued function r(t) = x(t), y(t), z(t) such that r(t 0 ) = x 0, y 0, z 0. Define h(t) = f (x(t), y(t), z(t)), then at the extremum h (t 0 ) = 0.

Method of Lagrange Multipliers (2 of 2) 0 = h (t 0 ) = f x (x(t 0 ), y(t 0 ), z(t 0 ))x (t 0 ) + f y (x(t 0 ), y(t 0 ), z(t 0 ))y (t 0 ) + f z (x(t 0 ), y(t 0 ), z(t 0 ))z (t 0 ) = f x (x 0, y 0, z 0 ), f y (x 0, y 0, z 0 ), f z (x 0, y 0, z 0 ) x (t 0 ), y (t 0 ), z (t 0 ) = f (x 0, y 0, z 0 ) r (t 0 ) Thus f (x 0, y 0, z 0 ) is orthogonal to r (t 0 ).

Method of Lagrange Multipliers (2 of 2) 0 = h (t 0 ) = f x (x(t 0 ), y(t 0 ), z(t 0 ))x (t 0 ) + f y (x(t 0 ), y(t 0 ), z(t 0 ))y (t 0 ) + f z (x(t 0 ), y(t 0 ), z(t 0 ))z (t 0 ) = f x (x 0, y 0, z 0 ), f y (x 0, y 0, z 0 ), f z (x 0, y 0, z 0 ) x (t 0 ), y (t 0 ), z (t 0 ) = f (x 0, y 0, z 0 ) r (t 0 ) Thus f (x 0, y 0, z 0 ) is orthogonal to r (t 0 ). Since r(t) is arbitrary, f (x 0, y 0, z 0 ) is orthogonal to S and hence parallel to g(x 0, y 0, z 0 ). f (x 0, y 0, z 0 ) = λ g(x 0, y 0, z 0 )

Result Theorem Suppose that f (x, y, z) and g(x, y, z) are functions with continuous first partial derivatives and g(x, y, z) 0 on the surface g(x, y, z) = 0. Suppose that either 1 the minimum value of f (x, y, z) subject to the constraint g(x, y, z) = 0 occurs at (x 0, y 0, z 0 ); or 2 the maximum value of f (x, y, z) subject to the constraint g(x, y, z) = 0 occurs at (x 0, y 0, z 0 ). Then f (x 0, y 0, z 0 ) = λ g(x 0, y 0, z 0 ), for some constant λ (called a Lagrange multiplier).

Equivalent Set of Equations f x (x, y, z) = λg x (x, y, z) f y (x, y, z) = λg y (x, y, z) f z (x, y, z) = λg z (x, y, z) g(x, y, z) = 0

Equivalent Set of Equations f x (x, y, z) = λg x (x, y, z) f y (x, y, z) = λg y (x, y, z) f z (x, y, z) = λg z (x, y, z) g(x, y, z) = 0 For functions of two variables this becomes: f x (x, y) = λg x (x, y) f y (x, y) = λg y (x, y) g(x, y) = 0

Example (1 of 3) Find the extreme values of f (x, y) = 2x 3 y subject to x 2 + y 2 = 4. 3 2 1 y 0 1 2 3 3 2 1 0 1 2 3 x

Example (2 of 3) 2 y 0 1 1 10 2 5 z 0 5 10 2 1 0 x 1 2

Example (3 of 3) System of equations: 6x 2 y = 2λx 2x 3 = 2λy x 2 + y 2 = 4 Cases: If x = 0 then λ = 0 and y = ±2. If x 0 then x 2 = 3y 2 and y = ±1 and x = ± 3. Maximum f (± 3, ±1) = 6 3, minimum f (± 3, 1) = 6 3.

Inequality Constraint (1 of 3) Find the extrema of f (x, y) = 4xy subject to x 2 + 4y 2 8. 3 2 1 y 0 1 2 3 3 2 1 0 1 2 3 x

Example (2 of 3) 2 y 0 2 5 z 0 5 2 0 x 2

Example (3 of 3) System of equations: Cases: 4y = 2λx 4x = 8λy x 2 + 4y 2 = 8 If λ = 1 then (x, y) = (±2, ±1). If λ = 1 then (x, y) = (±2, 1). Maximum f (±2, ±1) = 8, minimum f (±2, 1) = 8. There is a critical point at (x, y) = (0, 0) but this is a saddle point according to the Second Derivatives Test.

Two Equality Constraints (1 of 3) Example Maximize f (x, y, z) = 3x + y + 2z subject to y 2 + z 2 = 1 and x + y z = 0. 2 y 1 0 1 2 2 1 z 0 1 2 2 1 x 0 1 2

Two Equality Constraints (2 of 3) (3x + y + 2z) = λ (y 2 + z 2 1) + µ (x + y z) This is equivalent to the system of equations: 3 = µ 1 = 2λy + µ 2 = 2λz µ 1 = y 2 + z 2 0 = x + y z

Two Equality Constraints (3 of 3) The five equations can be reduced to: 1 = λy 5 = 2λz 1 = y 2 + z 2 0 = x + y z The first 3 equations yield λ = ± 29/2, then (x, y, z) = (±7/ 29, 2/ 29, ±5/ 29). Maximum: f (7/ 29, 2/ 29, 5/ 29) = 29 and minimum: f ( 7/ 29, 2/ 29, 5/ 29) = 29.

Homework Read Section 12.8. Pages 1020-1022: 1, 5, 9, 13, 17, 21, 25, 29, 33, 37, 41, 45