Dynamic programming with partial information to overcome navigational uncertainty in a nautical environment

Beeler, Chris, Li, Xinkai, Crowley, Mark, Fraser, Maia, Tamblyn, Isaac

arXiv.org Artificial Intelligence 

In an MDP, the state of the system is known, however, Uncertainty creates a major obstacle in solving control in a POMDP it must be estimated, leading to some problems. The goal of these problems is to construct a policy amount of uncertainty. Much of the difficulty in solving that is expected to produce optimal trajectories. In some a POMDP stems from estimating the state of the system cases, uncertainty only causes deviations from the optimal before choosing an action. This is where the majority of trajectory, which may still result in an acceptable solution.