We found 9 results
indigoBooksonésimo hernández lerma

Sort By:

Sorted By: Top Matches
Filtered By:
Books
1 - 9 of 9 Results
Top Matches
Continuous-Time Markov Decision Processes: Theory and Applications
Paperback

|March 14, 2012

$125.49 online

$136.95list price

save 8%

In stock online

Not available in stores

Continuous-time Markov decision processes (MDPs), also known as controlled Markov chains, are used for modeling decision-making problems that arise in operations research (for instance, inventory, manufacturing, and queueing systems), computer…
Markov Chains and Invariant Probabilities
Paperback

|October 23, 2012

$130.86 online

$137.95list price

save 5%

In stock online

Not available in stores

This book is about discrete-time, time-homogeneous, Markov chains (Mes) and their ergodic behavior. To this end, most of the material is in fact about stable Mes, by which we mean Mes that admit an invariant probability measure. To state this more…
Further Topics on Discrete-Time Markov Control Processes
Paperback

|October 12, 2012

$181.42 online

$193.50list price

save 6%

In stock online

Not available in stores

This book presents the second part of a two-volume series devoted to a sys­ tematic exposition of some recent developments in the theory of discrete­ time Markov control processes (MCPs). As in the first part, hereafter re­ ferred to as…
Adaptive Markov Control Processes
Paperback

|October 29, 2012

$116.82 online

$137.95list price

save 15%

In stock online

Not available in stores

This book is concerned with a class of discrete-time stochastic control processes known as controlled Markov processes (CMP's), also known as Markov decision processes or Markov dynamic programs. Starting in the mid-1950swith Richard Bellman, many…
Discrete-Time Markov Control Processes: Basic Optimality Criteria
Paperback

|September 30, 2012

$174.65 online

$193.50list price

save 9%

In stock online

Not available in stores

This book presents the first part of a planned two-volume series devoted to a systematic exposition of some recent developments in the theory of discrete-time Markov control processes (MCPs). Interest is mainly confined to MCPs with Borel state and…
Optimization, Control, and Applications of Stochastic Systems: In Honor of Onésimo Hernández-Lerma

Available for download

Not available in stores

This volume provides a general overview of discrete- and continuous-time Markov control processes and stochastic games, along with a look at the range of applications of stochastic control and some of its recent theoretical developments. These topics include…
Selected Topics On Continuous-time Controlled Markov Chains And Markov Games

In stock online

Not available in stores

This book concerns continuous-time controlled Markov chains, also known as continuous-time Markov decision processes. They form a class of stochastic control problems in which a single decision-maker wishes to optimize a given objective function. This book is…
Further Topics on Discrete-Time Markov Control Processes

In stock online

Not available in stores

This book presents the second part of a two-volume series devoted to a sys­ tematic exposition of some recent developments in the theory of discrete­ time Markov control processes (MCPs). As in the first part, hereafter re­ ferred to as "Volume I" (see…
Discrete-Time Markov Control Processes: Basic Optimality Criteria
Hardcover

|December 1, 1995

$198.17 online

$219.95list price

save 9%

In stock online

Not available in stores

This book presents the first part of a planned two-volume series devoted to a systematic exposition of some recent developments in the theory of discrete-time Markov control processes (MCPs). Interest is mainly confined to MCPs with Borel state and control (or…