Operations Research 14:699-719

Wiley.

This paper discusses the discrete-time Bayesian optimal control of stochastic dynamic systems where some vectors, which augment the system state vectors and the observed state vectors by additional variables, constitute multi-dimensional Markov chains. Optimal control of such Markovian control systems is considered under the assumption that only a part of the components of such vectors is observed by the control system. Certain conditional probability densities needed in deriving optimal control policies are derived, and computational procedures which determine optimal control sequences are given.

This report is part of the RAND Corporation Paper series. The paper was a product of the RAND Corporation from 1948 to 2003 that captured speeches, memorials, and derivative research, usually prepared on authors' own time and meant to be the scholarly or scientific contribution of individual authors to their professional fields. Papers were less formal than reports and did not require rigorous peer review. This document and trademark(s) contained herein are protected by law. This representation of RAND intellectual property is provided for noncommercial use only.

Get Citation Alerts New Citation Alert added!

J. Math. Anal. Applic., 10, 174–205.

Library translation 1122, Royal Aircraft Establishment.

Also available in the ACM Digital LibraryCommunications of the ACM, 9 [#1]: 36-45

AIAA Journal, 3 (8), 1445-1450.

Republished as The Mathematical Foundations of Learning Machines, San Francisco: Morgan Kaufmann Publishers, 1990McGraw-Hill. Republished in 1990.