Markov Processes for Stochastic Modeling

Other | September 1, 2008

byIbe, Oliver, Oliver Ibe

not yet rated|write a review
Markov processes are used to model systems with limited memory. They are used in many areas including communications systems, transportation networks, image segmentation and analysis, biological systems and DNA sequence analysis, random atomic motion and diffusion in physics, social mobility, population studies, epidemiology, animal and insect migration, queueing systems, resource management, dams, financial engineering, actuarial science, and decision systems.

This book, which is written for upper level undergraduate and graduate students, and researchers, presents a unified presentation of Markov processes. In addition to traditional topics such as Markovian queueing system, the book discusses such topics as continuous-time random walk,correlated random walk, Brownian motion, diffusion processes, hidden Markov models, Markov random fields, Markov point processes and Markov chain Monte Carlo. Continuous-time random walk is currently used in econophysics to model the financial market, which has traditionally been modelled as a Brownian motion. Correlated random walk is popularly used in ecological studies to model animal and insect movement. Hidden Markov models are used in speech analysis and DNA sequence analysis while Markov random fields and Markov point processes are used in image analysis. Thus, the book is designed to have a very broad appeal.

- Provides the practical, current applications of Markov processes
- Coverage of HMM, Point processes, and Monte Carlo
- Includes enough theory to help students gain throrough understanding of the subject
- Principles can be immediately applied in many specific research projects, saving researchers time
- End of chapter exercises provide reinforcement, practice and increased understanding to the student

Pricing and Purchase Info

$90.89 online
$118.04 list price (save 23%)
In stock online
Ships free on orders over $25

From the Publisher

Markov processes are used to model systems with limited memory. They are used in many areas including communications systems, transportation networks, image segmentation and analysis, biological systems and DNA sequence analysis, random atomic motion and diffusion in physics, social mobility, population studies, epidemiology, animal an...

Dr Ibe has been teaching at U Mass since 2003. He also has more than 20 years of experience in the corporate world, most recently as Chief Technology Officer at Sineria Networks and Director of Network Architecture for Spike Broadband Corp.

other books by Ibe, Oliver

Fundamentals of Stochastic Networks
Fundamentals of Stochastic Networks

Kobo ebook|Aug 24 2011

$139.99

Student Solutions Manual for Markov Processes for Stochastic Modeling
Student Solutions Manual for Markov Processes for Stoch...

Kobo ebook|Nov 1 2008

$15.19 online$19.67list price(save 22%)
Markov Processes for Stochastic Modeling
Markov Processes for Stochastic Modeling

Kobo ebook|May 22 2013

$85.49 online$111.00list price(save 22%)
see all books by Ibe, Oliver
Format:OtherDimensions:512 pages, 1 × 1 × 1 inPublished:September 1, 2008Publisher:Academic PressLanguage:English

The following ISBNs are associated with this title:

ISBN - 10:0080922457

ISBN - 13:9780080922454

Customer Reviews of Markov Processes for Stochastic Modeling

Reviews

Extra Content

Table of Contents

Preface
Acknowledgments
1. Basic Concepts
2. Introduction to Markov Processes
3. Discrete-Time Markov Chains
4. Continuous-Time Markov Chains
5. Markovian Queueing Systems
6. Markov Renewal Processes
7. Markovian Arrival Processes
8. Random Walk
9. Brownian Motion and Diffusion Processes
10. Controlled Markov Processes
11. Hidden Markov Models
12. Markov Random Fields
13. Markov Point Processes
14. Markov Chain Monte Carlo
References
Index