COPYRIGHTED MATERIAL. Index

Size: px
Start display at page:

Download "COPYRIGHTED MATERIAL. Index"

Transcription

1 Rao bindex.tex V3-05/21/ :46am Page 803 Index A Absolute minimum, 63 Active constraint, 8, 94 Addition of constraints, 218 Addition of new variables, 214 Additive algorithm, 605 Adjoint equations, 682 Adjoint variable, 682 Admissible variations, 78 All-integer problem, 588 Analytical methods, 253 Answers to selected problems, 795 Ant colony optimization, 3, 693, 714 algorithm, 717 ant searching behavior, 715 basic concept, 714 evaporation, 716 path retracing, 715 pheromone trail, 715 pheromone updating, 715 Applications of geometric programming, 525 Approximate mean, 642 Approximate variance, 642 Arithmetic-geometric inequality, 500 Artificial variables, 139 Augmented Lagrange multiplier method, 459 equality-constrained problems, 459 inequality-constrained problems, 462 mixed equality-inequality-constrained problems, 463 Augmented Lagrangian function, 460 Availability of computer programs, 786 Average, 635 B Balas algorithm, 604 Balas method, 589, 604 Barrier methods, 433 Basic feasible solution, 131, 136 Basic set operations, 724 Basic solution, 130, 136 Basic variables, 136 Basis, 130 Basis vector approach, 743 Beale s function, 365 Beam-column, 55 Bearing, 531 Behavior constraints, 7 BFGS formula, 353 BFGS method, 360 Bias of random directions, 312 Binary numbers, 607 Binary programming, 624 Binary variables, 607 Bivariate distribution, 639 Boltzmann s constant, 703 Boltzmann s probability distribution, 703 Boundary value problem, 549 Bounded objective function method, 764 Bound point, 8 Brachistochrone problem, 671 Bracket function, 443, 696 Branch and bound method, 609 Branching, 610 Brown s badly scaled function, 365 Broydon-Fletcher-Goldfarb-Shanno method, 304, 360 COPYRIGHTED MATERIAL C Calculus methods, 3 Calculus of variations, 3, 668 Canonical form, 133 Cantilever beam, 527 Cauchy method, 304, 339 Cauchy s inequality, 500 Central limit theorem, 647 Chance constrained programming,

2 Rao bindex.tex V3-05/21/ :46am Page Index Change in constraint coefficients, 215 Change in cost coefficients, 212 Change in right hand side constants, 208 Characteristics of constrained problem, 380 Choice of method, 784 Circular annular plate, 690 Classical optimization techniques, 63 Classification: of optimization problems, 14 of unconstrained minimization methods, 304 Classification of optimization problems based on: deterministic nature of variables, 29 existence of constraints, 14 nature of design variables, 15 nature of equations involved, 19 number of objective functions, 32 permissible values of design variables, 28 physical structure of the problem, 16 separability of the functions, 30 Closed half space, 128 Cluster analysis, 3 Coefficient of variation, 636 Collapse mechanism, 121 Comparison: of constrained methods, 785 of elimination methods, 272 of methods, 294 of unconstrained methods, 784 Complementary geometric programming, 520 degree of difficulty, 523 solution procedure, 522 Complement of a fuzzy set, 724 Complex method, 384 Composite constraint surface, 8 Computational aspects of optimization, 784 Computer programs, availability of, 786, 788 Computer program for: ant colony optimization, 789 fuzzy logic toolbox, 788 genetic algorithm and direct search toolbox, 788 modern optimization methods, 788 multiobjective optimization, 789 neural network toolbox, 788 particle swarm optimization, 788 simulated annealing algorithm, 788 Concave function, 779 Concept of cutting plane, 591 Concept of suboptimization, 549 Concrete beam, 29 Condition number of a matrix, 306 Cone clutch, 49, 528 Conjugate directions, 319 Conjugate gradient method, 341, 355, 361 Consistency condition, 220 Constrained minimization (GMP), 508 Constrained optimization problem, 6, 380 characteristics, 380 Constrained optimization techniques, 380 Constrained variation, 77, 79 Constraint qualification, 98 Constraint surface, 8 Contact stress between cylinders, 297 Contact stress between spheres, 250 Continuous beams, 576 Continuous dynamic programming, 573 Continuous feasible solution, 609 Continuous random variable, 634 Contours of objective function, 10 Contraction, 332 Contraction coefficient, 332 Control variables, 16 Control vector, 678 Convergence of constrained problems, 464 Convergence of order p, 305 Conversion of final to initial value problem, 566 Conversion of nonserial to serial system, 548 Convex: function, 779 polygon, 127 polyhedron, 127, 129 polytope, 129 programming problem, 98, 104, 442 set, 129

3 Rao bindex.tex V3-05/21/ :46am Page 805 Index 805 Cooling fin, 675 Correlation, 640 Correlation coefficient, 640 Correlation matrix, 646 Covariance, 640 Covariance matrix, 648 CPM and PERT, 3 Crane hook, 60 Crisp set theory, 723 Criterion function, 9 Critical points, 750 Crossover, 699 Cubic interpolation method, 253, 280 Cumulative distribution function, 634 Curse of dimensionality, 573 Curve of minimum time of descent, 672 Cutting plane method, 390, 589 algorithm, 387 geometric interpretation, 388 Cyclic process, 331 Cylinders in contact, 297 D Darcy-Weisbach equation, 663 Darwin s theory, 694 Davidon-Fletcher-Powell method, 304, 354 DC motor, 53 Decision variables, 6 Decomposition principle, 177, 200 Degenerate solution, 142 Degree of difficulty, 496 Derivatives of eigenvalues and eigenvectors, 747 of static displacements and stresses, 745 of transient response, 749 Descent direction, 336 Descent methods, 304, 335 Design constraints, 7 Design equations, 547 Design of: cantilever beam, 527 column, 11 cone clutch, 528 continuous beams, 576 drainage system, 579 four bar mechanism, 535 gear train, 579 helical spring, 529, 659 hydraulic cylinder, 527 lightly loaded bearing, 531 planar truss, 249 two bar truss, 533 Design of experiments, 3 Design point, 7 Design space, 7 Design variable linking, 738 Design variables, 6 Design vector, 6 DFP formula, 352 DFP method, 354 Dichotomous search, 253, 257 Differential calculus methods, 253, 493 Differential of f, 68 Direction finding problem, 395 Direct methods, 380, 383 Direct root method, 253, 286 Direct search methods, 309 Direct substitution, 76 Discrete programming problem, 588 Discrete random variable, 634 Discriminate analysis, 3 Drainage system, 579 Dual function, 501 Duality in linear programming, 192 Duality theorems, 195 Dual problem, 192, 509 Dual simplex method, 195 Dynamic optimization problem, 16 Dynamic programming, 3, 544 applications, 576 calculus method of solution, 555 computational procedure, 553 continuous, 573 conversion of final to initial value problem, 566 problem of dimensionality, 572 recurrence relation, 551 tabular method of solution, 560 E Electrical bridge network, 52 Elementary operations, 133 Elimination methods, 253, 254

4 Rao bindex.tex V3-05/21/ :46am Page Index Elimination methods comparison, 271 Engineering applications of optimization, 5 Engineering optimization literature, 35 Equality constraints, 6 Euler equation, 671 Euler-Lagrange equation, 671 Evaluation of gradient, 337 Event, 633 Exhaustive search, 253, 256 Expansion, 331 Expansion coefficient, 332 Expected value, 635 Experiment, 633 Extended interior penalty function, 451 Exterior penalty function method, 443, 455 algorithm, 445 convergence proof, 447 mixed equality-inequality constraints, 455 parametric constraints, 459 Extrapolation of design vector, 448 Extrapolation of objective function, 450 Extrapolation technique, 447 Extreme point, 130 F Factor analysis, 3 Failure mechanisms of portal frame, 246 Fast reanalysis techniques, 740 Fathomed, 610 Feasible direction, 95, 393 Feasible direction methods, 393, 394 Feasible solution, 130 Feasible space, 8 Fibonacci method, 253, 263 Fibonacci numbers, 263 Final interval of uncertainty, 263, 272 Final value problem, 548 First level problem, 757 First order methods, 305 Fitness, 696 Fletcher and Powell s helical valley function, 364 Fletcher-Reeves method, 304, 341 algorithm, 343 Floor design, 542 Flow chart: for augmented Lagrange multiplier method, 461 for cubic interpolation method, 284 for Fibonacci search method, 266 for linear extended penalty function method, 453 for parallel simulated annealing, 762 for Powell s method, 325 for simplex algorithm, 143 for simplex method, 153 for simulated annealing, 706 for two-phase simplex method, 153 Flywheel design, 482 Forced boundary conditions, 671 Four bar mechanism, 535 Four bar truss, 60, 557 Free boundary conditions, 671 Free point, 8 Freudenstein and Roth function, 364 Functional, 669 Functional constraints, 7 Function of a random variable, 638 Function of several random variables, 640 mean, 641 variance, 641 Fuzzy decision, 726 Fuzzy feasible region, 822 Fuzzy optimization, 3, 693, 722 computational procedure, 726 fuzzy set theory, 722 Fuzzy systems, 722, 725 G Game theory, 3 Gaussian distribution, 643 Gear train, 579 General iterative scheme of optimization, 305 Generalized penalty function method, 619 Generalized reduced gradient, 415 Generalized reduced gradient method, 412 algorithm, 416 General primal dual relations, 193

5 Rao bindex.tex V3-05/21/ :46am Page 807 Index 807 Genetic algorithms, 3, 693, 694, 701 Genetic operators, 697 Geometric boundary conditions, 671 Geometric constraints, 7 Geometric programming, 3, 22, 492 applications, 525 arithmetic-geometric inequality, 500 complementary geometric programming, 520 constrained problem, 508, 509 degree of difficulty, 496 mixed inequality constraints, 518 normality condition, 495 orthogonality conditions, 495 primal dual relations, 501 unconstrained problem, 493 Geometry of linear programming problems, 124 Global criterion method, 764 Global minimum, 63 Goal programming method, 765 Golden mean, 270 Golden section, 270 Golden section method, 253, 267 Gomory s constraint, 592 Gomory s cutting plane method, 591 for all integer problem, 592 graphical representation, 589 for mixed integer problem, 599 Gradient, 95, 335 Gradient evaluation, 337 Gradient of a function, 335 Gradient methods, 335 Gradient projection method, 404 algorithm, 409 Graphical optimization, 10 Graphical representation, 589 Grid search method, 304, 314 H Hamiltonian, 682 Helical spring, 22, 529 Helical torsional spring, 541 Hessian matrix, 71, 302 Heuristic search methods, 381 Historical development, 3 Hitchcock-Koopman s problem, 221 Hollow circular shaft, 51 Hopfield network, 729 Huang s family of updates, 353 Hydraulic cylinder design, 527 Hyperplane, 128 I Identifying optimal point, 140 Ill conditioned matrix, 306 Improving nonoptimal solution, 141 Inactive constraint, 94 Incremental response approach, 740 Independent events, 633 Independent random variables, 639 Indirect methods, 335, 380, 428 Indirect updated method, 361 Inequality constraints, 6, 93 Infeasibility form, 152 Infinite number of solutions, 148 Inflection point, 65 Initial value problem, 548 Input state variables, 546 Integer feasible solution, 610 Integer lattice points, 591 Integer linear programming, 589 Integer nonlinear programming, 606 Integer polynomial programming, 606 Integer programming, 3, 28, 588 Interior method, 222 Interior penalty function method, 432, 454 convergence proof, 438 extrapolation technique, 447 iterative process, 433 penalty parameter, 435 starting feasible point, 434 Interpolation methods, 253, 271 Interpretation of Lagrange multipliers, 90 Intersection of convex sets, 131 Intersection of fuzzy sets, 725 Interval halving method, 260 Interval of uncertainty, 256, 263 Introduction to optimization, 1 Inverse update formulas, 353 Inverted utility function method, 764 Iterative process of optimization, 252

6 Rao bindex.tex V3-05/21/ :46am Page Index J Jacobian, 82 Joint density function, 639 Joint distribution function, 639 Jointly distributed random variables, 639 Joint normal density function, 646 K Karmarkar s method, 222 algorithm, 226 conversion of problem, 224 statement of problem, 223 Kohonen network, 729 Kuhn-Tucker conditions, 98, 401 testing, 465 L Lagrange method, 85 necessary conditions, 86 sufficiency conditions, 87 Lagrange multipliers, 85, 675, 682 Lagrangian function, 86, 230 Learning process, 728 Lexicographic method, 765 Limit design of frames, 120 Linear convergence, 305 Linear extended penalty function, 451 Linearization of constraints, 387 Linearization of objective, 387 Linear programming, 3, 26, 119, 177 additional topics, 177 applications, 120 definitions, 127 theorems, 127 two phases, 150 Linear programming problem, 26 as a dynamic programming problem, 569 geometry, 124 infinite solutions, 126, 148 matrix form, 122 scalar form, 122 standard form, 122 unbounded solution, 127, 146 Linear simultaneous equations, 133 Line segment, 128, 202 Local minimum, 63 M Machining economics problem, 525 Marginal density function, 639 Markov processes, 3 Marquardt method, 304, 348 Mathematical programming techniques, 1, 3 MATLAB, 791 creating m-files, 793 defining matrices, 792 features, 791 introduction, 791 optimization toolbox, 793 special characters, 791 using programs, 794 MATLAB solutions, 37 binary programming problem, 624 constrained optimization problem, 474 goal attainment method, 767 interior point method, 235 linear programming problem, 156 one-dimensional problem, 294 quadratic programming problem, 237 unconstrained optimization problem, 365 Matrix methods of structural analysis, 248 Maxwell distribution, 663 Mean, 635 Membership function, 723 Merit function, 9 Method of constrained variation, 77 Method of Lagrange multipliers, 85 Methods of feasible directions, 393 Methods of operations research, 2 Metropolis criterion, 703 MIMD architecture, 761 Minimum cost pipeline, 585 Minimum drag, 672 Mixed constraints, 453 exterior penalty function method, 455 interior penalty function method, 454 Mixed equality and inequality constraints, 453 Mixed integer problem, 588 Model coordination method, 755 Modern optimization techniques, 3, 4, 693 Monotonicity, 547

7 Rao bindex.tex V3-05/21/ :46am Page 809 Index 809 Motivation of simplex method, 138 Multibay cantilever truss, 578 Multilayer feedforward network, 729 Multilevel optimization, 755 Multimodal function, 254 Multiobjective optimization, 761 Multiobjective programming, 3, 9, 33 Multiobjective programming problem, 9, 33 Multiple objective functions, 9 Multistage decision problem, 544, 548 Multistage decision process, 545 Multivariable optimization, 68 with equality constraints, 75 with inequality constraints, 93 necessary conditions, 69, 81, 94, 98 with no constraints, 68 sufficiency conditions, 70, 83 Multivariate distribution, 639 Mutation, 700 N Natural boundary conditions, 671 Necessary conditions for optimal control, 679 Negative definite matrix, 71 Network methods, 3 Neural network based methods, 693, 727 Neural networks, 3, 728 Neuron, 728 Newton method, 253, 286, 304, 345 Newton Raphson method, 287 Node, 610 Nonbasic variables, 136 Nonconvex sets, 129 Nondegenerate solution, 131 Nongradient methods, 304 Nonlinear programming, 3, 248, 301, 380 Nonlinear programming problem, 19 Nonpivotal variables, 135 Nontraditional optimization techniques, 3 Normal distribution, 643 Normality condition, 495 Normalization condition, 635 Normalization of constraints, 436 Normalized beta function integrand, 620 Norm of a matrix, 306 Norm of a vector, 305 Number of experiments, 272 Numerical integration, 458 O Objective function, 6, 9 Objective function surfaces, 9 Offspring, 700 One degree of difficulty problem, 515, 526, 532 One dimensional minimization methods, 248 Operations research, 1, 3 Optimal basic solution, 131 Optimal control problem, 16 Optimal control theory, 668, 678 Optimality criteria, 683 multiple displacement constraints, 684 single displacement constraint, 683 Optimality criteria methods, 668, 683 Optimal layout of a truss, 577 Optimal solution, 131 Optimization, 1 Optimization of fuzzy systems, 722, 725 Optimization problems classification, 14 statement, 6 Optimization techniques, 3, 35 Optimization toolbox, 36 Optimum machining conditions, 525 Orthogonal directions, 319 Orthogonality conditions, 495 Output state variables, 546 Overachievement, 766 P Parallel processing, 760 Parallel simulated annealing, 761 Parameter optimization problem, 15 Parametric constraint, 456 Parametric programming, 207 Parent, 700 Pareto optimum solution, 763 Particle swarm optimization, 3, 693, 708 computational implementation, 709 inertia term, 710 inertia weight, 711

8 Rao bindex.tex V3-05/21/ :46am Page Index Particle swarm optimization (continued) particle, 708 position, 708 velocity, 708 Pattern directions, 318 Pattern recognition, 3 Pattern search methods, 304 Penalty function, 696 Penalty function method: basic approach, 430 convergence criteria, 435 convergence proof, 438, 447 exterior method, 443 extrapolation, 447 initial value of parameter, 435 interior method, 432 iterative process, 433, 445 mixed equality and inequality constraints, 453 normalization of constraints, 436 parametric constraints, 456 penalty parameter, 431 starting feasible point, 434 Penalty parameter, 431 Performance index, 16, 679 Perturbing the design vector, 465 Phase I of simplex method, 151 Phase II of simplex method, 152 Pivot operation, 134 Pivot reduction, 135 Point in n-dimensional space, 128 Polynomial programming problem, 589 Population, 697 Positive definite matrix, 71 Positive semidefinite matrix, 71 Post optimality analysis, 207 Posynomial, 22, 492 Powell s badly scaled function, 365 Powell s method, 304, 319 algorithm, 323 convergence criterion, 326 flow chart, 325 Powell s quartic function, 364 Power screw, 57 Practical aspects of optimization, 737 Practical considerations, 293 Preassigned parameters, 6 Precision points, 535 Predual function, 500 Pressure vessel, 59 Primal and dual programs, 505, 510 Primal dual relations, 193, 501 Primal function, 500 Primal problem, 192, 509 Principle of optimality, 549 Probabilistic programming, 632 Probability, definition, 632, 633 Probability density function, 633 Probability distribution function, 634 Probability distributions, 643 Probability mass function, 634 Probability theory, 632 Problem of dimensionality, 572 Projected Lagrangian method, 425 Projection matrix, 405 Proportional damping, 749 Pseudo dual simplex method, 606 Q Quadratically convergent method, 319 Quadratic convergence, 287, 305, 325 Quadratic extended penalty function, 452 Quadratic form, 71 Quadratic interpolation method, 253, 273 Quadratic programming, 3, 24, 229 Quasi-Newton condition, 304 Quasi-Newton method, 253, 288, 350 Queueing theory, 3 R Railroad track, 48 Random jumping method, 311 Random search methods, 304, 309, 383 Random variables, 633 Random walk with direction exploitation, 313 Random walk method, 312 Rank 1 updates, 351 Rank 2 updates, 352 Rate of change of a function, 338 Rate of convergence, 305 Real valued programming problem, 28 Reanalysis, 740

9 Rao bindex.tex V3-05/21/ :46am Page 811 Index 811 Reciprocal approximation, 685 Recurrence relationship, 551 Reduced basis technique, 737 Reduction ratio, 265 Reduction of size, 737 Refitting, 277 Reflection, 328 Reflection coefficient, 330 Reflection process, 329 Regression analysis, 3 Regular simplex, 328 Relative frequency of occurrence, 636 Relative minimum, 63 Reliability theory, 3 Renewal theory, 3 Reproduction, 697 Reservoir pump installation, 505 Reservoir system, 160 Return function, 546 Revised simplex method, 177 step-by-step procedure, 182 theoretical development, 178 Rigid frame, 120 Rocket in outer space, 16 Rosenbrock s parabolic valley function, 363 Rosen s gradient projection method, 404 algorithm, 409 determination of step length, 407 projection matrix, 405 Roulette-wheel selection scheme, 698 S Saddle point, 73 Scaffolding system, 26, 57 Scaling of constraints, 787 Scaling of design variables, 305, 787 Search with accelerated step size, 255 Search with fixed step size, 254 Secant method, 253, 290 Second level problem, 757 Second order methods, 305 Semidefinite matrix, 71 Sensitivity analysis, 207 Sensitivity equations, 751 using Kuhn-Tucker conditions, 752 using the concept of feasible direction, 754 Sensitivity of optimum solution, 751 Sensitivity to problem parameters, 751 Separability, 547 Separability of functions, 31 Separable function, 31 Separable programming, 3, 31 Sequential decision problem, 544 Sequential linear discrete programming, 614 Sequential linear integer programming, 614 Sequential linear programming, 387 geometric interpretation, 388 Sequential quadratic programming, 422 derivation, 422 solution procedure, 425 Sequential unconstrained minimization, 431 Serial multistage decision process, 545 Shadow prices, 92 Shell and tube heat exchanger, 51 Side constraints, 7 Sigmoid function, 728 Signum function, 509 Simplex, 328, 384 Simplex algorithm, 139 flow chart, 143 Simplex method, 138, 304, 328 flow chart, 153 two phases, 150 Simplex multipliers, 180 Simply supported beam, 58 Simulated annealing, 3, 693, 702 Simulation methods, 3 Simultaneous equations, 133 Simultaneous search method, 257 Single stage decision problem, 546 Single variable optimization, 63 Slack variable, 123 Slider crank mechanism, 49 Solid body of revolution, 672 Solution by direct substitution, 76 Solution of linear equations, 133 Spring-cart system, 71 Stamping of circular discs, 49

10 Rao bindex.tex V3-05/21/ :46am Page Index Standard deviation, 635, 636 Standard form of LP problem, 122 Standard normal distribution, 643 Standard normal tables, 643, 645 Starting feasible point, 434 State inversion, 566 Statement of an optimization problem, 6 State transformation, 546 State variables, 16 State vector, 679 Statically determinate truss, 542 Static optimization problem, 15 Stationary point, 65 Stationary values of functionals, 669 Statistical decision theory, 3 Statistically independent events, 633 Statistical methods, 3 Steepest ascent direction, 335 Steepest descent method, 304, 339 convergence criteria, 341 Step-cone pulley, 19 Step length determination, 398, 407 Stochastic process techniques, 3 Stochastic programming, 3, 29, 632 geometric programming, 659 linear programming, 647 nonlinear programming, 652 Structural error, 535 Structural optimization packages, 787 Suboptimization, 551 SUMT, 431 Superlinear convergence, 305, 361 Surplus variable, 124 Survival of the fittest, 696 Symmetric primal-dual relations, 192 System reliability, 583 T Taylor s series expansion, 68, 642 Tentative solution, 670 Termination criteria, 401 Test functions (unconstrained nonlinear programming), 363 Beale s function, 365 Brown s badly scaled function, 365 Fletcher and Powell s helical valley, 364 Freudenstein and Roth function, 364 Powell s badly scaled function, 365 Powell s quartic function, 364 Rosenbrock s parabolic valley, 363 Wood s function, 365 Testing for concavity, 779 Testing for convexity, 779 Testing Kuhn-Tucker conditions, 465 Test problems (constrained nonlinear programming), 467 heat exchanger, 473 speed reducer (gear train), 472 three-bar truss, 467 welded beam, bar space truss, 468 Trajectory optimization problem, 16 Transformation techniques, 428 Transformation of variables, 381, 428 Transportation array, 221 Transportation problem, 177, 220 Transportation technique, 221 Transversality conditions, 682 Trapezoidal rule, 458 Travelling salesperson, 52 Trial, 254 Truss, 47, 55, 60, 248, 481, 487, 578, 623, 686, 691, 692, 741, 745, 758, 772 Tubular column design, 10, 654 Two-bar truss, 47, 55, 487, 533, 758 Two degree of difficulty problem, 526 Two phases of simplex method, 150 Two stage compressor, 67 Types of multistage decision problems, 548 U Unbounded solution, 127, 142, 146 Unconstrained minimization (GMP), 493 Unconstrained optimization problem, 6, 301 Unconstrained optimization techniques, 301

11 Rao bindex.tex V3-05/21/ :46am Page 813 Index 813 Underachievement, 766 Uniform distribution, 643 Unimodal function, 253 Union of fuzzy sets, 725 Univariate distribution, 639 Univariate method, 304, 315 Unrestricted search, 253, 254 Usable direction, 97 Usable feasible direction, 393 Utility function method, 763 V Valuation set, 723 Variable metric method, 354, 361 Variance, 636 Variation, 669 Variational operator, 669 Vector minimization problem, 762 Vector of simplex multipliers, 180 Venn diagram, 723 Vertex, 130 W Water resource system, 241 Water tank design, 550 Weighting function method, 764 Weights, 501 Well conditioned matrix, 306 Wood s function, 365 Z Zero degree of difficulty problem, 511, 525, 531 Zero-one LP problem, 608 Zero-one polynomial programming, 608 Zero-one problem, 588 Zero-one programming problems, 588, 604 Zeroth order methods, 304 Zoutendijk s method, 381, 394 determination of step length, 398 direction finding problem, 395 termination criteria, 401

12 Rao bindex.tex V3-05/21/ :46am Page 814

APPLIED OPTIMIZATION WITH MATLAB PROGRAMMING

APPLIED OPTIMIZATION WITH MATLAB PROGRAMMING APPLIED OPTIMIZATION WITH MATLAB PROGRAMMING Second Edition P. Venkataraman Rochester Institute of Technology WILEY JOHN WILEY & SONS, INC. CONTENTS PREFACE xiii 1 Introduction 1 1.1. Optimization Fundamentals

More information

OPTIMIZATION METHODS

OPTIMIZATION METHODS D. Nagesh Kumar Associate Professor Department of Civil Engineering, Indian Institute of Science, Bangalore - 50 0 Email : nagesh@civil.iisc.ernet.in URL: http://www.civil.iisc.ernet.in/~nagesh Brief Contents

More information

David G. Luenberger Yinyu Ye. Linear and Nonlinear. Programming. Fourth Edition. ö Springer

David G. Luenberger Yinyu Ye. Linear and Nonlinear. Programming. Fourth Edition. ö Springer David G. Luenberger Yinyu Ye Linear and Nonlinear Programming Fourth Edition ö Springer Contents 1 Introduction 1 1.1 Optimization 1 1.2 Types of Problems 2 1.3 Size of Problems 5 1.4 Iterative Algorithms

More information

Contents. I Basics 1. Copyright by SIAM. Unauthorized reproduction of this article is prohibited.

Contents. I Basics 1. Copyright by SIAM. Unauthorized reproduction of this article is prohibited. page v Preface xiii I Basics 1 1 Optimization Models 3 1.1 Introduction... 3 1.2 Optimization: An Informal Introduction... 4 1.3 Linear Equations... 7 1.4 Linear Optimization... 10 Exercises... 12 1.5

More information

Nonlinear Programming

Nonlinear Programming Nonlinear Programming SECOND EDITION Dimitri P. Bertsekas Massachusetts Institute of Technology WWW site for book Information and Orders http://world.std.com/~athenasc/index.html Athena Scientific, Belmont,

More information

INTRODUCTION TO LINEAR AND NONLINEAR PROGRAMMING

INTRODUCTION TO LINEAR AND NONLINEAR PROGRAMMING INTRODUCTION TO LINEAR AND NONLINEAR PROGRAMMING DAVID G. LUENBERGER Stanford University TT ADDISON-WESLEY PUBLISHING COMPANY Reading, Massachusetts Menlo Park, California London Don Mills, Ontario CONTENTS

More information

Theoretical Concepts of Machine Learning

Theoretical Concepts of Machine Learning Theoretical Concepts of Machine Learning Part 2 Institute of Bioinformatics Johannes Kepler University, Linz, Austria Outline 1 Introduction 2 Generalization Error 3 Maximum Likelihood 4 Noise Models 5

More information

LECTURE 13: SOLUTION METHODS FOR CONSTRAINED OPTIMIZATION. 1. Primal approach 2. Penalty and barrier methods 3. Dual approach 4. Primal-dual approach

LECTURE 13: SOLUTION METHODS FOR CONSTRAINED OPTIMIZATION. 1. Primal approach 2. Penalty and barrier methods 3. Dual approach 4. Primal-dual approach LECTURE 13: SOLUTION METHODS FOR CONSTRAINED OPTIMIZATION 1. Primal approach 2. Penalty and barrier methods 3. Dual approach 4. Primal-dual approach Basic approaches I. Primal Approach - Feasible Direction

More information

Module 1 Lecture Notes 2. Optimization Problem and Model Formulation

Module 1 Lecture Notes 2. Optimization Problem and Model Formulation Optimization Methods: Introduction and Basic concepts 1 Module 1 Lecture Notes 2 Optimization Problem and Model Formulation Introduction In the previous lecture we studied the evolution of optimization

More information

George B. Dantzig Mukund N. Thapa. Linear Programming. 1: Introduction. With 87 Illustrations. Springer

George B. Dantzig Mukund N. Thapa. Linear Programming. 1: Introduction. With 87 Illustrations. Springer George B. Dantzig Mukund N. Thapa Linear Programming 1: Introduction With 87 Illustrations Springer Contents FOREWORD PREFACE DEFINITION OF SYMBOLS xxi xxxiii xxxvii 1 THE LINEAR PROGRAMMING PROBLEM 1

More information

Chapter II. Linear Programming

Chapter II. Linear Programming 1 Chapter II Linear Programming 1. Introduction 2. Simplex Method 3. Duality Theory 4. Optimality Conditions 5. Applications (QP & SLP) 6. Sensitivity Analysis 7. Interior Point Methods 1 INTRODUCTION

More information

Linear programming and duality theory

Linear programming and duality theory Linear programming and duality theory Complements of Operations Research Giovanni Righini Linear Programming (LP) A linear program is defined by linear constraints, a linear objective function. Its variables

More information

Programming, numerics and optimization

Programming, numerics and optimization Programming, numerics and optimization Lecture C-4: Constrained optimization Łukasz Jankowski ljank@ippt.pan.pl Institute of Fundamental Technological Research Room 4.32, Phone +22.8261281 ext. 428 June

More information

Today. Golden section, discussion of error Newton s method. Newton s method, steepest descent, conjugate gradient

Today. Golden section, discussion of error Newton s method. Newton s method, steepest descent, conjugate gradient Optimization Last time Root finding: definition, motivation Algorithms: Bisection, false position, secant, Newton-Raphson Convergence & tradeoffs Example applications of Newton s method Root finding in

More information

Introduction to Optimization

Introduction to Optimization Introduction to Optimization Second Order Optimization Methods Marc Toussaint U Stuttgart Planned Outline Gradient-based optimization (1st order methods) plain grad., steepest descent, conjugate grad.,

More information

CHAPTER 2 CONVENTIONAL AND NON-CONVENTIONAL TECHNIQUES TO SOLVE ORPD PROBLEM

CHAPTER 2 CONVENTIONAL AND NON-CONVENTIONAL TECHNIQUES TO SOLVE ORPD PROBLEM 20 CHAPTER 2 CONVENTIONAL AND NON-CONVENTIONAL TECHNIQUES TO SOLVE ORPD PROBLEM 2.1 CLASSIFICATION OF CONVENTIONAL TECHNIQUES Classical optimization methods can be classified into two distinct groups:

More information

CT79 SOFT COMPUTING ALCCS-FEB 2014

CT79 SOFT COMPUTING ALCCS-FEB 2014 Q.1 a. Define Union, Intersection and complement operations of Fuzzy sets. For fuzzy sets A and B Figure Fuzzy sets A & B The union of two fuzzy sets A and B is a fuzzy set C, written as C=AUB or C=A OR

More information

Some Advanced Topics in Linear Programming

Some Advanced Topics in Linear Programming Some Advanced Topics in Linear Programming Matthew J. Saltzman July 2, 995 Connections with Algebra and Geometry In this section, we will explore how some of the ideas in linear programming, duality theory,

More information

Optimal Control Techniques for Dynamic Walking

Optimal Control Techniques for Dynamic Walking Optimal Control Techniques for Dynamic Walking Optimization in Robotics & Biomechanics IWR, University of Heidelberg Presentation partly based on slides by Sebastian Sager, Moritz Diehl and Peter Riede

More information

Linear Programming Problems

Linear Programming Problems Linear Programming Problems Two common formulations of linear programming (LP) problems are: min Subject to: 1,,, 1,2,,;, max Subject to: 1,,, 1,2,,;, Linear Programming Problems The standard LP problem

More information

Data Mining Chapter 8: Search and Optimization Methods Fall 2011 Ming Li Department of Computer Science and Technology Nanjing University

Data Mining Chapter 8: Search and Optimization Methods Fall 2011 Ming Li Department of Computer Science and Technology Nanjing University Data Mining Chapter 8: Search and Optimization Methods Fall 2011 Ming Li Department of Computer Science and Technology Nanjing University Search & Optimization Search and Optimization method deals with

More information

Index. affine dependency, 133 minimal, 133 affine hull, 392 affinely independent, 393 α-bb, 230, 258, 297 approximate solutions, 9 approximation, 86

Index. affine dependency, 133 minimal, 133 affine hull, 392 affinely independent, 393 α-bb, 230, 258, 297 approximate solutions, 9 approximation, 86 Index affine dependency, 133 minimal, 133 affine hull, 392 affinely independent, 393 α-bb, 230, 258, 297 approximate solutions, 9 approximation, 86 AP X, 10 aspiration level, 86, 110 atomic clusters, 372

More information

Numerical Optimization

Numerical Optimization Numerical Optimization Quantitative Macroeconomics Raül Santaeulàlia-Llopis MOVE-UAB and Barcelona GSE Fall 2018 Raül Santaeulàlia-Llopis (MOVE-UAB,BGSE) QM: Numerical Optimization Fall 2018 1 / 46 1 Introduction

More information

Characterizing Improving Directions Unconstrained Optimization

Characterizing Improving Directions Unconstrained Optimization Final Review IE417 In the Beginning... In the beginning, Weierstrass's theorem said that a continuous function achieves a minimum on a compact set. Using this, we showed that for a convex set S and y not

More information

Local and Global Minimum

Local and Global Minimum Local and Global Minimum Stationary Point. From elementary calculus, a single variable function has a stationary point at if the derivative vanishes at, i.e., 0. Graphically, the slope of the function

More information

Constrained and Unconstrained Optimization

Constrained and Unconstrained Optimization Constrained and Unconstrained Optimization Carlos Hurtado Department of Economics University of Illinois at Urbana-Champaign hrtdmrt2@illinois.edu Oct 10th, 2017 C. Hurtado (UIUC - Economics) Numerical

More information

MATLAB. Advanced Mathematics and Mechanics Applications Using. Third Edition. David Halpern University of Alabama CHAPMAN & HALL/CRC

MATLAB. Advanced Mathematics and Mechanics Applications Using. Third Edition. David Halpern University of Alabama CHAPMAN & HALL/CRC Advanced Mathematics and Mechanics Applications Using MATLAB Third Edition Howard B. Wilson University of Alabama Louis H. Turcotte Rose-Hulman Institute of Technology David Halpern University of Alabama

More information

Mathematics GCSE 9 1 Higher Syllabus. Yes. Does the subject set according to ability? Skills Covered. Unit

Mathematics GCSE 9 1 Higher Syllabus. Yes. Does the subject set according to ability? Skills Covered. Unit Mathematics GCSE 9 1 Higher Syllabus Does the subject set according to ability? Unit Unit 1 Unit 2 Unit 3 Unit 4 Yes Skills Covered understand and apply place value correctly. estimate values including

More information

AQA GCSE Maths - Higher Self-Assessment Checklist

AQA GCSE Maths - Higher Self-Assessment Checklist AQA GCSE Maths - Higher Self-Assessment Checklist Number 1 Use place value when calculating with decimals. 1 Order positive and negative integers and decimals using the symbols =,, , and. 1 Round to

More information

Introduction to Mathematical Programming IE496. Final Review. Dr. Ted Ralphs

Introduction to Mathematical Programming IE496. Final Review. Dr. Ted Ralphs Introduction to Mathematical Programming IE496 Final Review Dr. Ted Ralphs IE496 Final Review 1 Course Wrap-up: Chapter 2 In the introduction, we discussed the general framework of mathematical modeling

More information

Introduction. Linear because it requires linear functions. Programming as synonymous of planning.

Introduction. Linear because it requires linear functions. Programming as synonymous of planning. LINEAR PROGRAMMING Introduction Development of linear programming was among the most important scientific advances of mid-20th cent. Most common type of applications: allocate limited resources to competing

More information

Short Reminder of Nonlinear Programming

Short Reminder of Nonlinear Programming Short Reminder of Nonlinear Programming Kaisa Miettinen Dept. of Math. Inf. Tech. Email: kaisa.miettinen@jyu.fi Homepage: http://www.mit.jyu.fi/miettine Contents Background General overview briefly theory

More information

Kernel Methods & Support Vector Machines

Kernel Methods & Support Vector Machines & Support Vector Machines & Support Vector Machines Arvind Visvanathan CSCE 970 Pattern Recognition 1 & Support Vector Machines Question? Draw a single line to separate two classes? 2 & Support Vector

More information

Unconstrained Optimization Principles of Unconstrained Optimization Search Methods

Unconstrained Optimization Principles of Unconstrained Optimization Search Methods 1 Nonlinear Programming Types of Nonlinear Programs (NLP) Convexity and Convex Programs NLP Solutions Unconstrained Optimization Principles of Unconstrained Optimization Search Methods Constrained Optimization

More information

DM545 Linear and Integer Programming. Lecture 2. The Simplex Method. Marco Chiarandini

DM545 Linear and Integer Programming. Lecture 2. The Simplex Method. Marco Chiarandini DM545 Linear and Integer Programming Lecture 2 The Marco Chiarandini Department of Mathematics & Computer Science University of Southern Denmark Outline 1. 2. 3. 4. Standard Form Basic Feasible Solutions

More information

Probabilistic Graphical Models

Probabilistic Graphical Models School of Computer Science Probabilistic Graphical Models Theory of Variational Inference: Inner and Outer Approximation Eric Xing Lecture 14, February 29, 2016 Reading: W & J Book Chapters Eric Xing @

More information

Advanced Operations Research Techniques IE316. Quiz 2 Review. Dr. Ted Ralphs

Advanced Operations Research Techniques IE316. Quiz 2 Review. Dr. Ted Ralphs Advanced Operations Research Techniques IE316 Quiz 2 Review Dr. Ted Ralphs IE316 Quiz 2 Review 1 Reading for The Quiz Material covered in detail in lecture Bertsimas 4.1-4.5, 4.8, 5.1-5.5, 6.1-6.3 Material

More information

Classical Gradient Methods

Classical Gradient Methods Classical Gradient Methods Note simultaneous course at AMSI (math) summer school: Nonlin. Optimization Methods (see http://wwwmaths.anu.edu.au/events/amsiss05/) Recommended textbook (Springer Verlag, 1999):

More information

Classification of Optimization Problems and the Place of Calculus of Variations in it

Classification of Optimization Problems and the Place of Calculus of Variations in it Lecture 1 Classification of Optimization Problems and the Place of Calculus of Variations in it ME256 Indian Institute of Science G. K. Ananthasuresh Professor, Mechanical Engineering, Indian Institute

More information

Linear Optimization and Extensions: Theory and Algorithms

Linear Optimization and Extensions: Theory and Algorithms AT&T Linear Optimization and Extensions: Theory and Algorithms Shu-Cherng Fang North Carolina State University Sarai Puthenpura AT&T Bell Labs Prentice Hall, Englewood Cliffs, New Jersey 07632 Contents

More information

Chapter 14 Global Search Algorithms

Chapter 14 Global Search Algorithms Chapter 14 Global Search Algorithms An Introduction to Optimization Spring, 2015 Wei-Ta Chu 1 Introduction We discuss various search methods that attempts to search throughout the entire feasible set.

More information

MATHEMATICS II: COLLECTION OF EXERCISES AND PROBLEMS

MATHEMATICS II: COLLECTION OF EXERCISES AND PROBLEMS MATHEMATICS II: COLLECTION OF EXERCISES AND PROBLEMS GRADO EN A.D.E. GRADO EN ECONOMÍA GRADO EN F.Y.C. ACADEMIC YEAR 2011-12 INDEX UNIT 1.- AN INTRODUCCTION TO OPTIMIZATION 2 UNIT 2.- NONLINEAR PROGRAMMING

More information

Introduction to Optimization Problems and Methods

Introduction to Optimization Problems and Methods Introduction to Optimization Problems and Methods wjch@umich.edu December 10, 2009 Outline 1 Linear Optimization Problem Simplex Method 2 3 Cutting Plane Method 4 Discrete Dynamic Programming Problem Simplex

More information

Introduction to Design Optimization

Introduction to Design Optimization Introduction to Design Optimization First Edition Krishnan Suresh i Dedicated to my family. They mean the world to me. ii Origins of this Text Preface Like many other textbooks, this text has evolved from

More information

Chapter 15 Introduction to Linear Programming

Chapter 15 Introduction to Linear Programming Chapter 15 Introduction to Linear Programming An Introduction to Optimization Spring, 2015 Wei-Ta Chu 1 Brief History of Linear Programming The goal of linear programming is to determine the values of

More information

Modern Methods of Data Analysis - WS 07/08

Modern Methods of Data Analysis - WS 07/08 Modern Methods of Data Analysis Lecture XV (04.02.08) Contents: Function Minimization (see E. Lohrmann & V. Blobel) Optimization Problem Set of n independent variables Sometimes in addition some constraints

More information

M. Sc. (Artificial Intelligence and Machine Learning)

M. Sc. (Artificial Intelligence and Machine Learning) Course Name: Advanced Python Course Code: MSCAI 122 This course will introduce students to advanced python implementations and the latest Machine Learning and Deep learning libraries, Scikit-Learn and

More information

Index. ,a-possibility efficient solution, programming, 275

Index. ,a-possibility efficient solution, programming, 275 Index,a-possibility efficient solution, 196 0-1 programming, 275 aggregation, 31 of fuzzy number, 55 operator, 37, 45 agreement-discordance principle, 61 agricultural economics, 205 Arrow's impossibility

More information

Optimization. (Lectures on Numerical Analysis for Economists III) Jesús Fernández-Villaverde 1 and Pablo Guerrón 2 February 20, 2018

Optimization. (Lectures on Numerical Analysis for Economists III) Jesús Fernández-Villaverde 1 and Pablo Guerrón 2 February 20, 2018 Optimization (Lectures on Numerical Analysis for Economists III) Jesús Fernández-Villaverde 1 and Pablo Guerrón 2 February 20, 2018 1 University of Pennsylvania 2 Boston College Optimization Optimization

More information

Introduction to Design Optimization: Search Methods

Introduction to Design Optimization: Search Methods Introduction to Design Optimization: Search Methods 1-D Optimization The Search We don t know the curve. Given α, we can calculate f(α). By inspecting some points, we try to find the approximated shape

More information

FOUNDATION HIGHER. F Autumn 1, Yr 9 Autumn 2, Yr 9 Spring 1, Yr 9 Spring 2, Yr 9 Summer 1, Yr 9 Summer 2, Yr 9

FOUNDATION HIGHER. F Autumn 1, Yr 9 Autumn 2, Yr 9 Spring 1, Yr 9 Spring 2, Yr 9 Summer 1, Yr 9 Summer 2, Yr 9 Year: 9 GCSE Mathematics FOUNDATION F Autumn 1, Yr 9 Autumn 2, Yr 9 Spring 1, Yr 9 Spring 2, Yr 9 Summer 1, Yr 9 Summer 2, Yr 9 HIGHER Integers and place value Decimals Indices, powers and roots Factors,multiples

More information

Computational Methods. Constrained Optimization

Computational Methods. Constrained Optimization Computational Methods Constrained Optimization Manfred Huber 2010 1 Constrained Optimization Unconstrained Optimization finds a minimum of a function under the assumption that the parameters can take on

More information

Introduction to Design Optimization: Search Methods

Introduction to Design Optimization: Search Methods Introduction to Design Optimization: Search Methods 1-D Optimization The Search We don t know the curve. Given α, we can calculate f(α). By inspecting some points, we try to find the approximated shape

More information

Mathematics 6 12 Section 26

Mathematics 6 12 Section 26 Mathematics 6 12 Section 26 1 Knowledge of algebra 1. Apply the properties of real numbers: closure, commutative, associative, distributive, transitive, identities, and inverses. 2. Solve linear equations

More information

STRUCTURAL & MULTIDISCIPLINARY OPTIMIZATION

STRUCTURAL & MULTIDISCIPLINARY OPTIMIZATION STRUCTURAL & MULTIDISCIPLINARY OPTIMIZATION Pierre DUYSINX Patricia TOSSINGS Department of Aerospace and Mechanical Engineering Academic year 2018-2019 1 Course objectives To become familiar with the introduction

More information

Introduction to optimization methods and line search

Introduction to optimization methods and line search Introduction to optimization methods and line search Jussi Hakanen Post-doctoral researcher jussi.hakanen@jyu.fi How to find optimal solutions? Trial and error widely used in practice, not efficient and

More information

Convex Optimization. Lijun Zhang Modification of

Convex Optimization. Lijun Zhang   Modification of Convex Optimization Lijun Zhang zlj@nju.edu.cn http://cs.nju.edu.cn/zlj Modification of http://stanford.edu/~boyd/cvxbook/bv_cvxslides.pdf Outline Introduction Convex Sets & Functions Convex Optimization

More information

25. NLP algorithms. ˆ Overview. ˆ Local methods. ˆ Constrained optimization. ˆ Global methods. ˆ Black-box methods.

25. NLP algorithms. ˆ Overview. ˆ Local methods. ˆ Constrained optimization. ˆ Global methods. ˆ Black-box methods. CS/ECE/ISyE 524 Introduction to Optimization Spring 2017 18 25. NLP algorithms ˆ Overview ˆ Local methods ˆ Constrained optimization ˆ Global methods ˆ Black-box methods ˆ Course wrap-up Laurent Lessard

More information

Department Curriculum Map (new GCSE)

Department Curriculum Map (new GCSE) Department Curriculum Map 2014-15 (new GCSE) Department Mathematics required in Year 11 Foundation 1. Structure and calculation: N1 to N9 Fractions, decimals and percentages: N10 to N12 Measure and accuracy:

More information

GEOMETRIC TOOLS FOR COMPUTER GRAPHICS

GEOMETRIC TOOLS FOR COMPUTER GRAPHICS GEOMETRIC TOOLS FOR COMPUTER GRAPHICS PHILIP J. SCHNEIDER DAVID H. EBERLY MORGAN KAUFMANN PUBLISHERS A N I M P R I N T O F E L S E V I E R S C I E N C E A M S T E R D A M B O S T O N L O N D O N N E W

More information

KS4 Curriculum Plan Maths HIGHER TIER Year 9 Autumn Term 1 Unit 1: Number

KS4 Curriculum Plan Maths HIGHER TIER Year 9 Autumn Term 1 Unit 1: Number KS4 Curriculum Plan Maths HIGHER TIER Year 9 Autumn Term 1 Unit 1: Number 1.1 Number problems and reasoning 1.2 Place value and estimating 1.3 HCF and LCM 1.4 Calculating with powers (indices) 1.5 Zero,

More information

The Course Structure for the MCA Programme

The Course Structure for the MCA Programme The Course Structure for the MCA Programme SEMESTER - I MCA 1001 Problem Solving and Program Design with C 3 (3-0-0) MCA 1003 Numerical & Statistical Methods 4 (3-1-0) MCA 1007 Discrete Mathematics 3 (3-0-0)

More information

THEORY OF LINEAR AND INTEGER PROGRAMMING

THEORY OF LINEAR AND INTEGER PROGRAMMING THEORY OF LINEAR AND INTEGER PROGRAMMING ALEXANDER SCHRIJVER Centrum voor Wiskunde en Informatica, Amsterdam A Wiley-Inter science Publication JOHN WILEY & SONS^ Chichester New York Weinheim Brisbane Singapore

More information

DETERMINISTIC OPERATIONS RESEARCH

DETERMINISTIC OPERATIONS RESEARCH DETERMINISTIC OPERATIONS RESEARCH Models and Methods in Optimization Linear DAVID J. RADER, JR. Rose-Hulman Institute of Technology Department of Mathematics Terre Haute, IN WILEY A JOHN WILEY & SONS,

More information

A Study on the Optimization Methods for Optomechanical Alignment

A Study on the Optimization Methods for Optomechanical Alignment A Study on the Optimization Methods for Optomechanical Alignment Ming-Ta Yu a, Tsung-Yin Lin b *, Yi-You Li a, and Pei-Feng Shu a a Dept. of Mech. Eng., National Chiao Tung University, Hsinchu 300, Taiwan,

More information

Integers & Absolute Value Properties of Addition Add Integers Subtract Integers. Add & Subtract Like Fractions Add & Subtract Unlike Fractions

Integers & Absolute Value Properties of Addition Add Integers Subtract Integers. Add & Subtract Like Fractions Add & Subtract Unlike Fractions Unit 1: Rational Numbers & Exponents M07.A-N & M08.A-N, M08.B-E Essential Questions Standards Content Skills Vocabulary What happens when you add, subtract, multiply and divide integers? What happens when

More information

Section Notes 5. Review of Linear Programming. Applied Math / Engineering Sciences 121. Week of October 15, 2017

Section Notes 5. Review of Linear Programming. Applied Math / Engineering Sciences 121. Week of October 15, 2017 Section Notes 5 Review of Linear Programming Applied Math / Engineering Sciences 121 Week of October 15, 2017 The following list of topics is an overview of the material that was covered in the lectures

More information

Linear methods for supervised learning

Linear methods for supervised learning Linear methods for supervised learning LDA Logistic regression Naïve Bayes PLA Maximum margin hyperplanes Soft-margin hyperplanes Least squares resgression Ridge regression Nonlinear feature maps Sometimes

More information

Mathematics Year 9-11 Skills and Knowledge Checklist. Name: Class: Set : 1 Date Year 9 MEG :

Mathematics Year 9-11 Skills and Knowledge Checklist. Name: Class: Set : 1 Date Year 9 MEG : Personal targets to help me achieve my grade : AFL Sheet Number 1 : Standard Form, Decimals, Fractions and Percentages Standard Form I can write a number as a product of it s prime factors I can use the

More information

LECTURE 6: INTERIOR POINT METHOD. 1. Motivation 2. Basic concepts 3. Primal affine scaling algorithm 4. Dual affine scaling algorithm

LECTURE 6: INTERIOR POINT METHOD. 1. Motivation 2. Basic concepts 3. Primal affine scaling algorithm 4. Dual affine scaling algorithm LECTURE 6: INTERIOR POINT METHOD 1. Motivation 2. Basic concepts 3. Primal affine scaling algorithm 4. Dual affine scaling algorithm Motivation Simplex method works well in general, but suffers from exponential-time

More information

DISCRETE CONVEX ANALYSIS

DISCRETE CONVEX ANALYSIS DISCRETE CONVEX ANALYSIS o KAZUO MUROTA University of Tokyo; PRESTO, JST Tokyo, Japan Society for Industrial and Applied Mathematics Philadelphia List of Figures Notation Preface xi xiii xxi 1 Introduction

More information

Numerical Optimization: Introduction and gradient-based methods

Numerical Optimization: Introduction and gradient-based methods Numerical Optimization: Introduction and gradient-based methods Master 2 Recherche LRI Apprentissage Statistique et Optimisation Anne Auger Inria Saclay-Ile-de-France November 2011 http://tao.lri.fr/tiki-index.php?page=courses

More information

DEPARTMENT - Mathematics. Coding: N Number. A Algebra. G&M Geometry and Measure. S Statistics. P - Probability. R&P Ratio and Proportion

DEPARTMENT - Mathematics. Coding: N Number. A Algebra. G&M Geometry and Measure. S Statistics. P - Probability. R&P Ratio and Proportion DEPARTMENT - Mathematics Coding: N Number A Algebra G&M Geometry and Measure S Statistics P - Probability R&P Ratio and Proportion YEAR 7 YEAR 8 N1 Integers A 1 Simplifying G&M1 2D Shapes N2 Decimals S1

More information

Statistical Modeling with Spline Functions Methodology and Theory

Statistical Modeling with Spline Functions Methodology and Theory This is page 1 Printer: Opaque this Statistical Modeling with Spline Functions Methodology and Theory Mark H. Hansen University of California at Los Angeles Jianhua Z. Huang University of Pennsylvania

More information

YEAR 11 GCSE MATHS REVISION CHECKLIST HIGHER TIER

YEAR 11 GCSE MATHS REVISION CHECKLIST HIGHER TIER YEAR 11 GCSE MATHS REVISION CHECKLIST HIGHER TIER TOPICS ARE CATEGORISED VIA MATHS STRANDS NUMBER TOPICS 1 Number Grade 3 to 9 J K L 1.1 Number problems and Work out the total number of ways of performing

More information

Outline. CS38 Introduction to Algorithms. Linear programming 5/21/2014. Linear programming. Lecture 15 May 20, 2014

Outline. CS38 Introduction to Algorithms. Linear programming 5/21/2014. Linear programming. Lecture 15 May 20, 2014 5/2/24 Outline CS38 Introduction to Algorithms Lecture 5 May 2, 24 Linear programming simplex algorithm LP duality ellipsoid algorithm * slides from Kevin Wayne May 2, 24 CS38 Lecture 5 May 2, 24 CS38

More information

Optimization. Industrial AI Lab.

Optimization. Industrial AI Lab. Optimization Industrial AI Lab. Optimization An important tool in 1) Engineering problem solving and 2) Decision science People optimize Nature optimizes 2 Optimization People optimize (source: http://nautil.us/blog/to-save-drowning-people-ask-yourself-what-would-light-do)

More information

16.410/413 Principles of Autonomy and Decision Making

16.410/413 Principles of Autonomy and Decision Making 16.410/413 Principles of Autonomy and Decision Making Lecture 17: The Simplex Method Emilio Frazzoli Aeronautics and Astronautics Massachusetts Institute of Technology November 10, 2010 Frazzoli (MIT)

More information

Constrained Optimization COS 323

Constrained Optimization COS 323 Constrained Optimization COS 323 Last time Introduction to optimization objective function, variables, [constraints] 1-dimensional methods Golden section, discussion of error Newton s method Multi-dimensional

More information

CURRICULUM STRUCTURE Topics Covered Term 1: Term 2: Term 3:

CURRICULUM STRUCTURE Topics Covered Term 1: Term 2: Term 3: CURRICULUM STRUCTURE Topics Covered Term 1: Term 2: Term 3: Year 7 The four operations Place value Ordering numbers Inverse operations Perimeter and area of shapes Fractions and Decimals Order of operations

More information

Multi Layer Perceptron trained by Quasi Newton learning rule

Multi Layer Perceptron trained by Quasi Newton learning rule Multi Layer Perceptron trained by Quasi Newton learning rule Feed-forward neural networks provide a general framework for representing nonlinear functional mappings between a set of input variables and

More information

GCSE Higher Revision List

GCSE Higher Revision List GCSE Higher Revision List Level 8/9 Topics I can work with exponential growth and decay on the calculator. I can convert a recurring decimal to a fraction. I can simplify expressions involving powers or

More information

QstatLab: software for statistical process control and robust engineering

QstatLab: software for statistical process control and robust engineering QstatLab: software for statistical process control and robust engineering I.N.Vuchkov Iniversity of Chemical Technology and Metallurgy 1756 Sofia, Bulgaria qstat@dir.bg Abstract A software for quality

More information

Smarter Balanced Vocabulary (from the SBAC test/item specifications)

Smarter Balanced Vocabulary (from the SBAC test/item specifications) Example: Smarter Balanced Vocabulary (from the SBAC test/item specifications) Notes: Most terms area used in multiple grade levels. You should look at your grade level and all of the previous grade levels.

More information

SECONDARY DRAFT SYLLABUS. 2. Representation of functions. 3. Types of functions. 4. Composition of functions (two and three)

SECONDARY DRAFT SYLLABUS. 2. Representation of functions. 3. Types of functions. 4. Composition of functions (two and three) et et et CLASS IX Topic :Set Language et et 1. Describing and representing sets SECONDARY DRAFT SYLLABUS Able to describe a set in Descriptive, Set- builder and roster forms and through Venn diagram. Use

More information

IE598 Big Data Optimization Summary Nonconvex Optimization

IE598 Big Data Optimization Summary Nonconvex Optimization IE598 Big Data Optimization Summary Nonconvex Optimization Instructor: Niao He April 16, 2018 1 This Course Big Data Optimization Explore modern optimization theories, algorithms, and big data applications

More information

Year 8 Mathematics Curriculum Map

Year 8 Mathematics Curriculum Map Year 8 Mathematics Curriculum Map Topic Algebra 1 & 2 Number 1 Title (Levels of Exercise) Objectives Sequences *To generate sequences using term-to-term and position-to-term rule. (5-6) Quadratic Sequences

More information

5 Machine Learning Abstractions and Numerical Optimization

5 Machine Learning Abstractions and Numerical Optimization Machine Learning Abstractions and Numerical Optimization 25 5 Machine Learning Abstractions and Numerical Optimization ML ABSTRACTIONS [some meta comments on machine learning] [When you write a large computer

More information

PITSCO Math Individualized Prescriptive Lessons (IPLs)

PITSCO Math Individualized Prescriptive Lessons (IPLs) Orientation Integers 10-10 Orientation I 20-10 Speaking Math Define common math vocabulary. Explore the four basic operations and their solutions. Form equations and expressions. 20-20 Place Value Define

More information

Linear and Integer Programming :Algorithms in the Real World. Related Optimization Problems. How important is optimization?

Linear and Integer Programming :Algorithms in the Real World. Related Optimization Problems. How important is optimization? Linear and Integer Programming 15-853:Algorithms in the Real World Linear and Integer Programming I Introduction Geometric Interpretation Simplex Method Linear or Integer programming maximize z = c T x

More information

Hands-On Standards Deluxe Grades: 7, 8 States: California Content Standards

Hands-On Standards Deluxe Grades: 7, 8 States: California Content Standards Hands-On Standards Deluxe Grades: 7, 8 States: Hands-On Standards Deluxe Edition Kit, Grades 5-6: Algebra Summary: This resource guide meets 5 and 6 math curriculum standards by matching activities to

More information

Read: H&L chapters 1-6

Read: H&L chapters 1-6 Viterbi School of Engineering Daniel J. Epstein Department of Industrial and Systems Engineering ISE 330: Introduction to Operations Research Fall 2006 (Oct 16): Midterm Review http://www-scf.usc.edu/~ise330

More information

Mathematics GCSE 9-1 Curriculum Planner (3 Year Course)

Mathematics GCSE 9-1 Curriculum Planner (3 Year Course) Mathematics GCSE 9-1 Curriculum Planner (3 Year Course) Year 9 Week 1 2 3 4 5 6 7 8 HT 9 1 0 Chapter 1 Calculations Chapter 2 Expressions Ch 1, 2 Test Chapter 3 Angles, polygons Chapter 3 11 12 13 14 15

More information

YEAR 12 Core 1 & 2 Maths Curriculum (A Level Year 1)

YEAR 12 Core 1 & 2 Maths Curriculum (A Level Year 1) YEAR 12 Core 1 & 2 Maths Curriculum (A Level Year 1) Algebra and Functions Quadratic Functions Equations & Inequalities Binomial Expansion Sketching Curves Coordinate Geometry Radian Measures Sine and

More information

KS4 3 Year scheme of Work Year 10 Higher

KS4 3 Year scheme of Work Year 10 Higher KS4 3 Year scheme of Work Year 10 Higher Review: Equations A2 Substitute numerical values into formulae and expressions, including scientific formulae unfamiliar formulae will be given in the question

More information

TOPIC LIST GCSE MATHEMATICS HIGHER TIER (Bold HIGHER TIER ONLY) Number Topic Red Amber Green

TOPIC LIST GCSE MATHEMATICS HIGHER TIER (Bold HIGHER TIER ONLY) Number Topic Red Amber Green TOPIC LIST GCSE MATHEMATICS HIGHER TIER (Bold HIGHER TIER ONLY) Number Order whole, decimal, fraction and negative numbers Use the symbols =,, Add, subtract, multiply, divide whole numbers using written

More information

- number of elements - complement linear, simple quadratic and cubic sequences - exponential sequences and - simple combinations of these

- number of elements - complement linear, simple quadratic and cubic sequences - exponential sequences and - simple combinations of these IGCSE Mathematics Revision checklist 2016. Syllabus 1 Numbers, set notation and language 1 Identify and use: - natural s - prime s - square s - common factors (HCF) - common multiples (LCM) - rational

More information

Mathematics Year 9-11 Skills and Knowledge Checklist. Name: Class: Set : Premier Date Year 9 MEG :

Mathematics Year 9-11 Skills and Knowledge Checklist. Name: Class: Set : Premier Date Year 9 MEG : Personal targets to help me achieve my grade : AFL Sheet Number 1 : Standard Form, Decimals, Fractions and Percentages Standard Form I can write a number as a product of it s prime factors I can use the

More information

Convexity: an introduction

Convexity: an introduction Convexity: an introduction Geir Dahl CMA, Dept. of Mathematics and Dept. of Informatics University of Oslo 1 / 74 1. Introduction 1. Introduction what is convexity where does it arise main concepts and

More information

Themes in the Texas CCRS - Mathematics

Themes in the Texas CCRS - Mathematics 1. Compare real numbers. a. Classify numbers as natural, whole, integers, rational, irrational, real, imaginary, &/or complex. b. Use and apply the relative magnitude of real numbers by using inequality

More information