Approximate solutions of the bellman equation of deterministic control theory

I. Capuzzo Dolcetta, H. Ishii

Research output: Contribution to journalArticle

89 Citations (Scopus)

Abstract

We consider an infinite horizon discounted optimal control problem and its time discretized approximation, and study the rate of convergence of the approximate solutions to the value function of the original problem. In particular we prove the rate is of order 1 as the discretization step tends to zero, provided a semiconcavity assumption is satisfied. We also characterize the limit of the optimal controls for the approximate problems within the framework of the theory of relaxed controls.

Original languageEnglish
Pages (from-to)161-181
Number of pages21
JournalApplied Mathematics & Optimization
Volume11
Issue number1
DOIs
Publication statusPublished - 1984 Feb
Externally publishedYes

Fingerprint

Bellman Equation
Control theory
Control Theory
Approximate Solution
Relaxed Controls
Infinite Horizon
Value Function
Optimal Control Problem
Optimal Control
Rate of Convergence
Discretization
Tend
Zero
Approximation
Framework

ASJC Scopus subject areas

  • Applied Mathematics
  • Mathematics(all)

Cite this

Approximate solutions of the bellman equation of deterministic control theory. / Dolcetta, I. Capuzzo; Ishii, H.

In: Applied Mathematics & Optimization, Vol. 11, No. 1, 02.1984, p. 161-181.

Research output: Contribution to journalArticle

Dolcetta, I. Capuzzo ; Ishii, H. / Approximate solutions of the bellman equation of deterministic control theory. In: Applied Mathematics & Optimization. 1984 ; Vol. 11, No. 1. pp. 161-181.
@article{ac8e42eecd7041e380fcef80dadd872e,
title = "Approximate solutions of the bellman equation of deterministic control theory",
abstract = "We consider an infinite horizon discounted optimal control problem and its time discretized approximation, and study the rate of convergence of the approximate solutions to the value function of the original problem. In particular we prove the rate is of order 1 as the discretization step tends to zero, provided a semiconcavity assumption is satisfied. We also characterize the limit of the optimal controls for the approximate problems within the framework of the theory of relaxed controls.",
author = "Dolcetta, {I. Capuzzo} and H. Ishii",
year = "1984",
month = "2",
doi = "10.1007/BF01442176",
language = "English",
volume = "11",
pages = "161--181",
journal = "Applied Mathematics and Optimization",
issn = "0095-4616",
publisher = "Springer New York",
number = "1",

}

TY - JOUR

T1 - Approximate solutions of the bellman equation of deterministic control theory

AU - Dolcetta, I. Capuzzo

AU - Ishii, H.

PY - 1984/2

Y1 - 1984/2

N2 - We consider an infinite horizon discounted optimal control problem and its time discretized approximation, and study the rate of convergence of the approximate solutions to the value function of the original problem. In particular we prove the rate is of order 1 as the discretization step tends to zero, provided a semiconcavity assumption is satisfied. We also characterize the limit of the optimal controls for the approximate problems within the framework of the theory of relaxed controls.

AB - We consider an infinite horizon discounted optimal control problem and its time discretized approximation, and study the rate of convergence of the approximate solutions to the value function of the original problem. In particular we prove the rate is of order 1 as the discretization step tends to zero, provided a semiconcavity assumption is satisfied. We also characterize the limit of the optimal controls for the approximate problems within the framework of the theory of relaxed controls.

UR - http://www.scopus.com/inward/record.url?scp=34250115257&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=34250115257&partnerID=8YFLogxK

U2 - 10.1007/BF01442176

DO - 10.1007/BF01442176

M3 - Article

VL - 11

SP - 161

EP - 181

JO - Applied Mathematics and Optimization

JF - Applied Mathematics and Optimization

SN - 0095-4616

IS - 1

ER -