Maximum Principle and Dynamic Programming Viscosity Solution Approach

From Open-Loop to Closed-Loop

By: Bing Sun, Bao-Zhu Guo, Zhen-Zhen Tao

Write A Review

eText | 1 July 2025

At a Glance

Format
ePUB

eText

$259.01

or 4 interest-free payments of $64.75 with

Instant online reading in your Booktopia eTextbook Library *

Why choose an eTextbook?

Instant Access *

Purchase and read your book immediately

Read Aloud

Listen and follow along as Bookshelf reads to you

Study Tools

Built-in study tools like highlights and more

* eTextbooks are not downloadable to your eReader or an app and can be accessed via web browsers only. You must be connected to the internet and have no technical issues with your device or browser that could prevent the eTextbook from operating.

This book is concerned with optimal control problems of dynamical systems described by partial differential equations (PDEs). The content covers the theory and numerical algorithms, starting with open-loop control and ending with closed-loop control. It includes Pontryagin's maximum principle and the Bellman dynamic programming principle based on the notion of viscosity solution. The Bellman dynamic programming method can produce the optimal control in feedback form, making it more appealing for online implementations and robustness. The determination of the optimal feedback control law is of fundamental importance in optimal control and can be argued as the Holy Grail of control theory.

The book is organized into five chapters. Chapter 1 presents necessary mathematical knowledge. Chapters 2 and 3 (Part 1) focus on the open-loop control while Chapter 4 and 5 (Part 2) focus on the closed-loop control. In this monograph, we incorporate the notion of viscosity solution of PDE with dynamic programming approach. The dynamic programming viscosity solution (DPVS) approach is then used to investigate optimal control problems. In each problem, the optimal feedback law is synthesized and numerically demonstrated. The last chapter presents multiple algorithms for the DPVS approach, including an upwind finite-difference scheme with the convergence proof. It is worth noting that the dynamic systems considered are primarily of technical or biologic origin, which is a highlight of the book.

This book is systematic and self-contained. It can serve the expert as a ready reference for control theory of infinite-dimensional systems. These chapters taken together would also make a one-semester course for graduate with first courses in PDE-constrained optimal control.