Discrete-Time Markov Control Processes: Basic Optimality Criteria

Hardcover | December 1, 1995

byOnesimo Hernandez-Lerma

not yet rated|write a review
This book provides a unified, comprehensive treatment of some recent theoretical developments on Markov control processes. Interest is mainly confined to MCPs with Borel state and control spaces, and possibly unbounded costs and non-compact control constraint sets. The control model studied is sufficiently general to include virtually all the usual discrete-time stochastic control models that appear in applications to engineering, economics, mathematical population processes, operations research, and management science. Much of the material appears for the first time in book form.

Pricing and Purchase Info

$192.95 online
$219.95 list price (save 12%)
In stock online
Ships free on orders over $25

From Our Editors

This book provides a unified, comprehensive treatment of some recent theoretical developments on Markov control processes. Interest is mainly confined to MPCs with Borel state and control spaces, and possibly unbounded costs and noncompact control constraint sets. The control model studied is sufficiently general to include virtually a...

From the Publisher

This book provides a unified, comprehensive treatment of some recent theoretical developments on Markov control processes. Interest is mainly confined to MCPs with Borel state and control spaces, and possibly unbounded costs and non-compact control constraint sets. The control model studied is sufficiently general to include virtually ...

From the Jacket

This book provides a unified, comprehensive treatment of some recent theoretical developments on Markov control processes. Interest is mainly confined to MPCs with Borel state and control spaces, and possibly unbounded costs and noncompact control constraint sets. The control model studied is sufficiently general to include virtually a...

Format:HardcoverDimensions:230 pages, 9.25 × 6.1 × 0.39 inPublished:December 1, 1995Publisher:Springer

The following ISBNs are associated with this title:

ISBN - 10:0387945792

ISBN - 13:9780387945798

Look for similar items by category:

Customer Reviews of Discrete-Time Markov Control Processes: Basic Optimality Criteria

Reviews

Extra Content

Table of Contents

Contents: Introduction and Summary.- Markov Control Processes.- Finite Horizon Problems.- Infinite-Horizon Discounted-Cost Problems.- Long-Run Average Cost Problems.- The Linear Programming Formulation.- Appendices: Conditional Expectation, Stochastic Kernels, Multifunctions and Selectors, Convergence of Probability Measures.

From Our Editors

This book provides a unified, comprehensive treatment of some recent theoretical developments on Markov control processes. Interest is mainly confined to MPCs with Borel state and control spaces, and possibly unbounded costs and noncompact control constraint sets. The control model studied is sufficiently general to include virtually all of the usual discrete-time stochastic control models that appear in applications to engineering, economics, mathematical population processes, operations research, and management science. Much of the material appears for the first time in book form.