Markov Decision Processes: Discrete Stochastic Dynamic Programming

By Martin L. Puterman

Book Overview

A Markov chain is a sequence of events where the probability of each event is dependent on the event immediately preceding it, but independent of earlier events. Models and numerical equations are used to describe the patterns. This process is particularly useful in operations research and decision science for plotting the sequence of actions which will cause a system to perform optimally.

• Format: Hardcover
• Language: English
• ISBN: 0471619779
• ISBN13: 9780471619772
• Release Date: April 1994
• Publisher: Wiley-Interscience
• Length: 672 Pages
• Weight: 1.85 lbs.
• Dimensions: 1.5" x 6.5" x 9.6"