The Projected Subgradient Algorithm In Convex Optimization
DOWNLOAD
Download The Projected Subgradient Algorithm In Convex Optimization PDF/ePub or read online books in Mobi eBooks. Click Download or Read Online button to get The Projected Subgradient Algorithm In Convex Optimization book now. This website allows unlimited access to, at the time of writing, more than 1.5 million titles, including hundreds of thousands of titles in various foreign languages. If the content not found or just blank you must refresh this page
The Projected Subgradient Algorithm In Convex Optimization
DOWNLOAD
Author : Alexander J. Zaslavski
language : en
Publisher: Springer
Release Date : 2020-11-26
The Projected Subgradient Algorithm In Convex Optimization written by Alexander J. Zaslavski and has been published by Springer this book supported file pdf, txt, epub, kindle and other format this book has been release on 2020-11-26 with Mathematics categories.
This focused monograph presents a study of subgradient algorithms for constrained minimization problems in a Hilbert space. The book is of interest for experts in applications of optimization to engineering and economics. The goal is to obtain a good approximate solution of the problem in the presence of computational errors. The discussion takes into consideration the fact that for every algorithm its iteration consists of several steps and that computational errors for different steps are different, in general. The book is especially useful for the reader because it contains solutions to a number of difficult and interesting problems in the numerical optimization. The subgradient projection algorithm is one of the most important tools in optimization theory and its applications. An optimization problem is described by an objective function and a set of feasible points. For this algorithm each iteration consists of two steps. The first step requires a calculation of a subgradient of the objective function; the second requires a calculation of a projection on the feasible set. The computational errors in each of these two steps are different. This book shows that the algorithm discussed, generates a good approximate solution, if all the computational errors are bounded from above by a small positive constant. Moreover, if computational errors for the two steps of the algorithm are known, one discovers an approximate solution and how many iterations one needs for this. In addition to their mathematical interest, the generalizations considered in this book have a significant practical meaning.
The Projected Subgradient Algorithm In Convex Optimization
DOWNLOAD
Author : Alexander J. Zaslavski
language : en
Publisher: Springer Nature
Release Date : 2020-11-25
The Projected Subgradient Algorithm In Convex Optimization written by Alexander J. Zaslavski and has been published by Springer Nature this book supported file pdf, txt, epub, kindle and other format this book has been release on 2020-11-25 with Mathematics categories.
This focused monograph presents a study of subgradient algorithms for constrained minimization problems in a Hilbert space. The book is of interest for experts in applications of optimization to engineering and economics. The goal is to obtain a good approximate solution of the problem in the presence of computational errors. The discussion takes into consideration the fact that for every algorithm its iteration consists of several steps and that computational errors for different steps are different, in general. The book is especially useful for the reader because it contains solutions to a number of difficult and interesting problems in the numerical optimization. The subgradient projection algorithm is one of the most important tools in optimization theory and its applications. An optimization problem is described by an objective function and a set of feasible points. For this algorithm each iteration consists of two steps. The first step requires a calculation of a subgradient of the objective function; the second requires a calculation of a projection on the feasible set. The computational errors in each of these two steps are different. This book shows that the algorithm discussed, generates a good approximate solution, if all the computational errors are bounded from above by a small positive constant. Moreover, if computational errors for the two steps of the algorithm are known, one discovers an approximate solution and how many iterations one needs for this. In addition to their mathematical interest, the generalizations considered in this book have a significant practical meaning.
Stochastic Optimization
DOWNLOAD
Author : Stanislav Uryasev
language : en
Publisher: Springer Science & Business Media
Release Date : 2001-05-31
Stochastic Optimization written by Stanislav Uryasev and has been published by Springer Science & Business Media this book supported file pdf, txt, epub, kindle and other format this book has been release on 2001-05-31 with Technology & Engineering categories.
Stochastic programming is the study of procedures for decision making under the presence of uncertainties and risks. Stochastic programming approaches have been successfully used in a number of areas such as energy and production planning, telecommunications, and transportation. Recently, the practical experience gained in stochastic programming has been expanded to a much larger spectrum of applications including financial modeling, risk management, and probabilistic risk analysis. Major topics in this volume include: (1) advances in theory and implementation of stochastic programming algorithms; (2) sensitivity analysis of stochastic systems; (3) stochastic programming applications and other related topics. Audience: Researchers and academies working in optimization, computer modeling, operations research and financial engineering. The book is appropriate as supplementary reading in courses on optimization and financial engineering.
Convex Optimization
DOWNLOAD
Author : Stephen P. Boyd
language : en
Publisher: Cambridge University Press
Release Date : 2004-03-08
Convex Optimization written by Stephen P. Boyd and has been published by Cambridge University Press this book supported file pdf, txt, epub, kindle and other format this book has been release on 2004-03-08 with Business & Economics categories.
Convex optimization problems arise frequently in many different fields. This book provides a comprehensive introduction to the subject, and shows in detail how such problems can be solved numerically with great efficiency. The book begins with the basic elements of convex sets and functions, and then describes various classes of convex optimization problems. Duality and approximation techniques are then covered, as are statistical estimation techniques. Various geometrical problems are then presented, and there is detailed discussion of unconstrained and constrained minimization problems, and interior-point methods. The focus of the book is on recognizing convex optimization problems and then finding the most appropriate technique for solving them. It contains many worked examples and homework exercises and will appeal to students, researchers and practitioners in fields such as engineering, computer science, mathematics, statistics, finance and economics.
Convex Optimization With Computational Errors
DOWNLOAD
Author : Alexander J. Zaslavski
language : en
Publisher: Springer Nature
Release Date : 2020-01-31
Convex Optimization With Computational Errors written by Alexander J. Zaslavski and has been published by Springer Nature this book supported file pdf, txt, epub, kindle and other format this book has been release on 2020-01-31 with Mathematics categories.
The book is devoted to the study of approximate solutions of optimization problems in the presence of computational errors. It contains a number of results on the convergence behavior of algorithms in a Hilbert space, which are known as important tools for solving optimization problems. The research presented in the book is the continuation and the further development of the author's (c) 2016 book Numerical Optimization with Computational Errors, Springer 2016. Both books study the algorithms taking into account computational errors which are always present in practice. The main goal is, for a known computational error, to find out what an approximate solution can be obtained and how many iterates one needs for this. The main difference between this new book and the 2016 book is that in this present book the discussion takes into consideration the fact that for every algorithm, its iteration consists of several steps and that computational errors for different steps are generally, different. This fact, which was not taken into account in the previous book, is indeed important in practice. For example, the subgradient projection algorithm consists of two steps. The first step is a calculation of a subgradient of the objective function while in the second one we calculate a projection on the feasible set. In each of these two steps there is a computational error and these two computational errors are different in general. It may happen that the feasible set is simple and the objective function is complicated. As a result, the computational error, made when one calculates the projection, is essentially smaller than the computational error of the calculation of the subgradient. Clearly, an opposite case is possible too. Another feature of this book is a study of a number of important algorithms which appeared recently in the literature and which are not discussed in the previous book. This monograph contains 12 chapters. Chapter 1 is an introduction. In Chapter 2 we study the subgradient projection algorithm for minimization of convex and nonsmooth functions. We generalize the results of [NOCE] and establish results which has no prototype in [NOCE]. In Chapter 3 we analyze the mirror descent algorithm for minimization of convex and nonsmooth functions, under the presence of computational errors. For this algorithm each iteration consists of two steps. The first step is a calculation of a subgradient of the objective function while in the second one we solve an auxiliary minimization problem on the set of feasible points. In each of these two steps there is a computational error. We generalize the results of [NOCE] and establish results which has no prototype in [NOCE]. In Chapter 4 we analyze the projected gradient algorithm with a smooth objective function under the presence of computational errors. In Chapter 5 we consider an algorithm, which is an extension of the projection gradient algorithm used for solving linear inverse problems arising in signal/image processing. In Chapter 6 we study continuous subgradient method and continuous subgradient projection algorithm for minimization of convex nonsmooth functions and for computing the saddle points of convex-concave functions, under the presence of computational errors. All the results of this chapter has no prototype in [NOCE]. In Chapters 7-12 we analyze several algorithms under the presence of computational errors which were not considered in [NOCE]. Again, each step of an iteration has a computational errors and we take into account that these errors are, in general, different. An optimization problems with a composite objective function is studied in Chapter 7. A zero-sum game with two-players is considered in Chapter 8. A predicted decrease approximation-based method is used in Chapter 9 for constrained convex optimization. Chapter 10 is devoted to minimization of quasiconvex functions. Minimization of sharp weakly convex functions is discussed in Chapter 11. Chapter 12 is devoted to a generalized projected subgradient method for minimization of a convex function over a set which is not necessarily convex. The book is of interest for researchers and engineers working in optimization. It also can be useful in preparation courses for graduate students. The main feature of the book which appeals specifically to this audience is the study of the influence of computational errors for several important optimization algorithms. The book is of interest for experts in applications of optimization to engineering and economics.
Optimization In Banach Spaces
DOWNLOAD
Author : Alexander J. Zaslavski
language : en
Publisher: Springer Nature
Release Date : 2022-09-29
Optimization In Banach Spaces written by Alexander J. Zaslavski and has been published by Springer Nature this book supported file pdf, txt, epub, kindle and other format this book has been release on 2022-09-29 with Mathematics categories.
The book is devoted to the study of constrained minimization problems on closed and convex sets in Banach spaces with a Frechet differentiable objective function. Such problems are well studied in a finite-dimensional space and in an infinite-dimensional Hilbert space. When the space is Hilbert there are many algorithms for solving optimization problems including the gradient projection algorithm which is one of the most important tools in the optimization theory, nonlinear analysis and their applications. An optimization problem is described by an objective function and a set of feasible points. For the gradient projection algorithm each iteration consists of two steps. The first step is a calculation of a gradient of the objective function while in the second one we calculate a projection on the feasible set. In each of these two steps there is a computational error. In our recent research we show that the gradient projection algorithm generates a good approximate solution, if all the computational errors are bounded from above by a small positive constant. It should be mentioned that the properties of a Hilbert space play an important role. When we consider an optimization problem in a general Banach space the situation becomes more difficult and less understood. On the other hand such problems arise in the approximation theory. The book is of interest for mathematicians working in optimization. It also can be useful in preparation courses for graduate students. The main feature of the book which appeals specifically to this audience is the study of algorithms for convex and nonconvex minimization problems in a general Banach space. The book is of interest for experts in applications of optimization to the approximation theory. In this book the goal is to obtain a good approximate solution of the constrained optimization problem in a general Banach space under the presence of computational errors. It is shown that the algorithm generates a good approximate solution, if the sequence of computational errors is bounded from above by a small constant. The book consists of four chapters. In the first we discuss several algorithms which are studied in the book and prove a convergence result for an unconstrained problem which is a prototype of our results for the constrained problem. In Chapter 2 we analyze convex optimization problems. Nonconvex optimization problems are studied in Chapter 3. In Chapter 4 we study continuous algorithms for minimization problems under the presence of computational errors. The algorithm generates a good approximate solution, if the sequence of computational errors is bounded from above by a small constant. The book consists of four chapters. In the first we discuss several algorithms which are studied in the book and prove a convergence result for an unconstrained problem which is a prototype of our results for the constrained problem. In Chapter 2 we analyze convex optimization problems. Nonconvex optimization problems are studied in Chapter 3. In Chapter 4 we study continuous algorithms for minimization problems under the presence of computational errors.
Optimization On Solution Sets Of Common Fixed Point Problems
DOWNLOAD
Author : Alexander J. Zaslavski
language : en
Publisher: Springer Nature
Release Date : 2021-08-09
Optimization On Solution Sets Of Common Fixed Point Problems written by Alexander J. Zaslavski and has been published by Springer Nature this book supported file pdf, txt, epub, kindle and other format this book has been release on 2021-08-09 with Mathematics categories.
This book is devoted to a detailed study of the subgradient projection method and its variants for convex optimization problems over the solution sets of common fixed point problems and convex feasibility problems. These optimization problems are investigated to determine good solutions obtained by different versions of the subgradient projection algorithm in the presence of sufficiently small computational errors. The use of selected algorithms is highlighted including the Cimmino type subgradient, the iterative subgradient, and the dynamic string-averaging subgradient. All results presented are new. Optimization problems where the underlying constraints are the solution sets of other problems, frequently occur in applied mathematics. The reader should not miss the section in Chapter 1 which considers some examples arising in the real world applications. The problems discussed have an important impact in optimization theory as well. The book will be useful for researches interested in the optimization theory and its applications.
Minimization Methods For Non Differentiable Functions
DOWNLOAD
Author : N.Z. Shor
language : en
Publisher: Springer Science & Business Media
Release Date : 2012-12-06
Minimization Methods For Non Differentiable Functions written by N.Z. Shor and has been published by Springer Science & Business Media this book supported file pdf, txt, epub, kindle and other format this book has been release on 2012-12-06 with Science categories.
In recent years much attention has been given to the development of auto matic systems of planning, design and control in various branches of the national economy. Quality of decisions is an issue which has come to the forefront, increasing the significance of optimization algorithms in math ematical software packages for al,ltomatic systems of various levels and pur poses. Methods for minimizing functions with discontinuous gradients are gaining in importance and the ~xperts in the computational methods of mathematical programming tend to agree that progress in the development of algorithms for minimizing nonsmooth functions is the key to the con struction of efficient techniques for solving large scale problems. This monograph summarizes to a certain extent fifteen years of the author's work on developing generalized gradient methods for nonsmooth minimization. This work started in the department of economic cybernetics of the Institute of Cybernetics of the Ukrainian Academy of Sciences under the supervision of V.S. Mikhalevich, a member of the Ukrainian Academy of Sciences, in connection with the need for solutions to important, practical problems of optimal planning and design. In Chap. I we describe basic classes of nonsmooth functions that are dif ferentiable almost everywhere, and analyze various ways of defining generalized gradient sets. In Chap. 2 we study in detail various versions of the su bgradient method, show their relation to the methods of Fejer-type approximations and briefly present the fundamentals of e-subgradient methods.
Convex Optimization For Signal Processing And Communications
DOWNLOAD
Author : Chong-Yung Chi
language : en
Publisher: CRC Press
Release Date : 2017-01-24
Convex Optimization For Signal Processing And Communications written by Chong-Yung Chi and has been published by CRC Press this book supported file pdf, txt, epub, kindle and other format this book has been release on 2017-01-24 with Technology & Engineering categories.
Convex Optimization for Signal Processing and Communications: From Fundamentals to Applications provides fundamental background knowledge of convex optimization, while striking a balance between mathematical theory and applications in signal processing and communications. In addition to comprehensive proofs and perspective interpretations for core convex optimization theory, this book also provides many insightful figures, remarks, illustrative examples, and guided journeys from theory to cutting-edge research explorations, for efficient and in-depth learning, especially for engineering students and professionals. With the powerful convex optimization theory and tools, this book provides you with a new degree of freedom and the capability of solving challenging real-world scientific and engineering problems.
An Easy Path To Convex Analysis And Applications
DOWNLOAD
Author : Boris Mordukhovich
language : en
Publisher: Springer Nature
Release Date : 2023-06-16
An Easy Path To Convex Analysis And Applications written by Boris Mordukhovich and has been published by Springer Nature this book supported file pdf, txt, epub, kindle and other format this book has been release on 2023-06-16 with Mathematics categories.
This book examines the most fundamental parts of convex analysis and its applications to optimization and location problems. Accessible techniques of variational analysis are employed to clarify and simplify some basic proofs in convex analysis and to build a theory of generalized differentiation for convex functions and sets in finite dimensions. The book serves as a bridge for the readers who have just started using convex analysis to reach deeper topics in the field. Detailed proofs are presented for most of the results in the book and also included are many figures and exercises for better understanding the material. Applications provided include both the classical topics of convex optimization and important problems of modern convex optimization, convex geometry, and facility location.